-- Logs begin at Wed 2022-03-30 00:45:14 UTC, end at Wed 2022-03-30 01:45:45 UTC. -- Mar 30 01:13:56.435390 dv-cinder-817135-7-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Mar 30 01:13:56.443118 dv-cinder-817135-7-iscsi devstack@keystone.service[79685]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Mar 30 01:13:56.447847 dv-cinder-817135-7-iscsi devstack@keystone.service[79685]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Mar 30 01:13:56 2022] *** Mar 30 01:13:56.448040 dv-cinder-817135-7-iscsi devstack@keystone.service[79685]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Mar 30 01:13:56.448179 dv-cinder-817135-7-iscsi devstack@keystone.service[79685]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Mar 30 01:13:56.448315 dv-cinder-817135-7-iscsi devstack@keystone.service[79685]: nodename: dv-cinder-817135-7-iscsi Mar 30 01:13:56.448447 dv-cinder-817135-7-iscsi devstack@keystone.service[79685]: machine: x86_64 Mar 30 01:13:56.448580 dv-cinder-817135-7-iscsi devstack@keystone.service[79685]: clock source: unix Mar 30 01:13:56.448710 dv-cinder-817135-7-iscsi devstack@keystone.service[79685]: pcre jit disabled Mar 30 01:13:56.448845 dv-cinder-817135-7-iscsi devstack@keystone.service[79685]: detected number of CPU cores: 4 Mar 30 01:13:56.448979 dv-cinder-817135-7-iscsi devstack@keystone.service[79685]: current working directory: / Mar 30 01:13:56.449110 dv-cinder-817135-7-iscsi devstack@keystone.service[79685]: detected binary path: /usr/bin/uwsgi-core Mar 30 01:13:56.449248 dv-cinder-817135-7-iscsi devstack@keystone.service[79685]: your processes number limit is 47680 Mar 30 01:13:56.449381 dv-cinder-817135-7-iscsi devstack@keystone.service[79685]: your memory page size is 4096 bytes Mar 30 01:13:56.449516 dv-cinder-817135-7-iscsi devstack@keystone.service[79685]: detected max file descriptor number: 2048 Mar 30 01:13:56.449672 dv-cinder-817135-7-iscsi devstack@keystone.service[79685]: lock engine: pthread robust mutexes Mar 30 01:13:56.449957 dv-cinder-817135-7-iscsi devstack@keystone.service[79685]: thunder lock: enabled Mar 30 01:13:56.450276 dv-cinder-817135-7-iscsi devstack@keystone.service[79685]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Mar 30 01:13:56.450481 dv-cinder-817135-7-iscsi devstack@keystone.service[79685]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Mar 30 01:13:56.495636 dv-cinder-817135-7-iscsi devstack@keystone.service[79685]: Python main interpreter initialized at 0x55b87d6e19c0 Mar 30 01:13:56.495636 dv-cinder-817135-7-iscsi devstack@keystone.service[79685]: python threads support enabled Mar 30 01:13:56.495636 dv-cinder-817135-7-iscsi devstack@keystone.service[79685]: your server socket listen backlog is limited to 100 connections Mar 30 01:13:56.495636 dv-cinder-817135-7-iscsi devstack@keystone.service[79685]: your mercy for graceful operations on workers is 90 seconds Mar 30 01:13:56.496035 dv-cinder-817135-7-iscsi devstack@keystone.service[79685]: mapped 403077 bytes (393 KB) for 2 cores Mar 30 01:13:56.496113 dv-cinder-817135-7-iscsi devstack@keystone.service[79685]: *** Operational MODE: preforking *** Mar 30 01:13:56.496371 dv-cinder-817135-7-iscsi devstack@keystone.service[79685]: *** uWSGI is running in multiple interpreter mode *** Mar 30 01:13:56.496371 dv-cinder-817135-7-iscsi devstack@keystone.service[79685]: spawned uWSGI master process (pid: 79685) Mar 30 01:13:56.496589 dv-cinder-817135-7-iscsi systemd[1]: Started Devstack devstack@keystone.service. Mar 30 01:13:56.497711 dv-cinder-817135-7-iscsi devstack@keystone.service[79685]: spawned uWSGI worker 1 (pid: 79701, cores: 1) Mar 30 01:13:56.497711 dv-cinder-817135-7-iscsi devstack@keystone.service[79685]: spawned uWSGI worker 2 (pid: 79702, cores: 1) Mar 30 01:13:56.497711 dv-cinder-817135-7-iscsi devstack@keystone.service[79685]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Mar 30 01:14:02.360645 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 30 01:14:02.360645 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: from cryptography.utils import int_from_bytes Mar 30 01:14:02.361472 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 30 01:14:02.361472 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: from cryptography.utils import int_from_bytes Mar 30 01:14:02.372113 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 30 01:14:02.372113 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: from cryptography.utils import int_from_bytes Mar 30 01:14:02.372568 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 30 01:14:02.372568 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: from cryptography.utils import int_from_bytes Mar 30 01:14:02.407256 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 30 01:14:02.407522 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 30 01:14:02.407671 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] command line args: [] {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 30 01:14:02.407899 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 30 01:14:02.408077 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] ================================================================================ {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 30 01:14:02.408331 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] admin_token = **** {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.408578 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] config_dir = [] {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.408765 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.408945 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] config_source = [] {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.409121 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] debug = True {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.409317 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.411607 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.411607 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.411607 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.411607 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.411607 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] list_limit = None {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.411607 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] log_config_append = None {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.411607 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.411607 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] log_dir = None {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.411607 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] log_file = None {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.412575 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.412575 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.412575 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.412999 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.412999 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.413406 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.413406 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.413763 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.413763 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.414121 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.414303 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.414485 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.414736 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.414937 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.415230 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.415690 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.30/identity {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.415859 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] publish_errors = False {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.416096 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.416307 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.416478 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.416715 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.416956 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.417191 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] standard_threads = False {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.417401 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 30 01:14:02.417576 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.417764 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 30 01:14:02.417923 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.418086 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] command line args: [] {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 30 01:14:02.418225 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.418225 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] use_journal = False {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.418505 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 30 01:14:02.418680 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] use_json = False {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.418846 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] ================================================================================ {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 30 01:14:02.418972 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] use_stderr = False {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.419107 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] admin_token = **** {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.419241 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] use_syslog = False {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.419405 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] config_dir = [] {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.419535 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.419660 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.419789 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.419925 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] config_source = [] {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.419925 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] debug = True {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.420167 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.420298 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.420460 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.420599 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.420754 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.420890 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.421015 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.421175 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.421319 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.421457 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.421589 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.421715 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] list_limit = None {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.421838 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.421961 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] log_config_append = None {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.421961 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.422219 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.422344 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] log_dir = None {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.422474 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.422604 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] log_file = None {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.422821 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.422968 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.423094 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.423224 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.423384 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.423541 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.423675 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.423808 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.423955 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.424081 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.424081 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.424317 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.424453 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.424579 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.424704 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.424829 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.424965 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.425098 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.425230 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.425360 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.425501 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.425626 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.425757 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.425890 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.426015 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.426138 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.426262 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.426385 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.426514 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.426648 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.426648 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.426911 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.30/identity {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.427036 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.427237 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] publish_errors = False {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.427412 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.428071 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.428197 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.428197 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.428439 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.428439 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.428681 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.428805 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.428928 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.429052 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.429175 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.429315 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] standard_threads = False {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.429441 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.429576 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.429705 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.429830 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.429953 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.430086 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.430211 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.430335 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] use_journal = False {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.430335 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] use_json = False {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.430575 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.430575 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.430856 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] use_stderr = False {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.430994 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.431121 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] use_syslog = False {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.431251 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.431387 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 01:14:02.431512 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.431644 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.431779 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.431904 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.432027 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.432152 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.432276 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.432408 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.432533 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.432657 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.432780 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.432904 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.433037 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.433173 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.433305 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.433430 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.433554 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.433677 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.433806 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.434006 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.434133 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.434133 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.434368 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.434492 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.434615 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.434833 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.434977 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.435102 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.435226 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.435350 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.435474 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.435606 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.435732 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.435856 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.435980 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.436110 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.436243 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.436370 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.436500 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.436640 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.436766 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.436889 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.437025 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.437159 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.437285 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.437409 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.437532 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.437656 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.437779 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.437911 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.438042 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.438168 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.438292 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.439526 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.439701 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.439938 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.440100 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.440288 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.440474 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.440662 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.440882 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.441046 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.441297 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.441491 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.441663 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.441851 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.442090 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.442288 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.442452 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.442640 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.442857 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.443176 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.443503 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.443700 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.443891 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.444079 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.444266 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.444453 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.444625 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.444797 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.444969 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.445110 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.445237 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.445395 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.445524 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.445649 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.445786 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.445913 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.446065 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.446199 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.446325 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.446449 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.446582 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.446749 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.446885 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.447018 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.447146 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.447282 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.447440 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.447577 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.447703 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.447834 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.447960 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.448092 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.448219 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.448349 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.448474 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.448608 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.448608 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.448852 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.448979 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.449201 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.449328 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.449452 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.449576 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.449709 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.449841 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.449968 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.449968 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.450269 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.450406 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.450602 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.450776 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.450910 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.451035 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.451159 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] auth.external = None {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.451159 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.451417 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.451417 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.451671 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.451803 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.451928 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.452051 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.452185 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] auth.password = None {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.452332 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.452460 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] auth.token = None {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.452585 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.452709 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.452709 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.452952 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.453087 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.453225 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.453351 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.453475 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.453600 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.453730 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.453856 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.453998 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.454126 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.454257 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.454383 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] credential.caching = True {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.454507 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.454632 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.454795 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.454931 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.455064 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.455190 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.455315 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.455439 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.455572 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.455716 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.455941 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.456102 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.456231 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.456364 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.456499 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.456632 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.456759 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.456884 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.457009 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.457141 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.457268 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.457425 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.457565 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.457703 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.457830 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.457955 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.458080 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.458205 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.458339 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.458467 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.458655 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.458811 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] federation.caching = True {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.458939 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.459064 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.459201 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.459329 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.459456 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.459591 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.459717 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.459842 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.459976 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.460110 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.460237 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.460362 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.460489 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.460622 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.460761 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.460888 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.461014 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.461140 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.461274 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.461419 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.461555 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.461688 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.461817 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.462012 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] identity.caching = True {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.462155 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.462292 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.462420 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.462545 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.462672 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] auth.external = None {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.462828 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.462956 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.463093 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.463234 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.463363 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.463495 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.463623 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.463749 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] auth.password = None {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.463882 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.463882 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.464121 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] auth.token = None {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.464245 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.464370 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.464494 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.464627 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.464754 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.464878 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.465012 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.465138 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.465263 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.465464 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.465599 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.465727 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.465852 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.465977 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.466101 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.466234 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] credential.caching = True {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.466360 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.466487 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.466487 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.466780 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.466926 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.467061 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.467061 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.467300 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.467424 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.467549 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.467674 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.467811 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.467938 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.468063 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.468189 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.468314 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.468445 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.468590 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.468590 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.468836 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.468964 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.469089 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.469214 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.469347 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.469347 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.469586 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.469711 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.469836 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.469969 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.470103 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.470230 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.470365 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] federation.caching = True {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.470491 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.470623 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.470785 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.470925 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.471054 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.471179 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.471304 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.471429 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.471562 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.471700 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.471828 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.472000 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.472149 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.472276 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.472410 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.472541 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.472667 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.472793 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.472918 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.473044 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.473177 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.473304 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.473429 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.473554 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] identity.caching = True {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.473685 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.473812 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.473954 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.474082 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.474749 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.474890 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.475017 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.475144 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.475281 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.475409 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.475541 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.475667 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.475798 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] ldap.user = None {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.475925 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.476058 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.476204 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.476336 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.476462 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.476587 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.476712 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.476845 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.476977 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.477104 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.477229 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.477355 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.477480 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.477614 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.477741 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.477872 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.478009 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.478135 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.478260 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.478395 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.478395 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.478633 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.478788 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.478917 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.479042 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.479177 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.479304 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.479429 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.479554 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.479689 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.479814 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.479952 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.480079 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.480204 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.480328 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.480454 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.480579 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.480711 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.480838 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.480970 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.481096 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.481220 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.481350 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.481495 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.481622 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.481747 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.481872 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.481996 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.482128 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.482266 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.482399 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.482526 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.482652 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.482839 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.482967 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.483104 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.483231 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.483367 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.483493 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.483618 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.483744 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.483878 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.484004 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.484130 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.484254 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.484379 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.484504 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.484637 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.484765 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.484890 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.485024 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.485150 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.485283 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] resource.caching = True {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.485411 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.485536 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.485661 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.485793 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.485919 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.486052 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.486179 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.486303 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.486428 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.486552 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.486677 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.486854 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.486854 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.487096 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.487220 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.487345 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.487469 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.487602 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] ldap.user = None {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.487730 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] role.caching = True {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.487856 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.487981 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] role.driver = sql {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.488105 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.488236 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.488371 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.488498 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.488632 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.488758 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.488892 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.489018 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.489151 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.489278 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.489403 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.489528 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.489654 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.489778 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.490475 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.490613 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.490794 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.491055 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.491197 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.491324 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.491531 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.491668 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.491796 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.491922 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.492048 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.492180 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.492320 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.492447 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.492574 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.492574 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.492811 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.492947 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.493083 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.493210 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.493341 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.493469 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.493594 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.493719 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.493852 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.493979 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.494105 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.494232 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.494357 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.494483 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.494626 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.494794 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.494925 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.495051 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.495177 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.495302 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.495438 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.495438 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.495676 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.495801 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.495927 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.496063 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.496191 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.496191 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.496438 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.496563 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.496689 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.496822 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.496950 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.497076 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.497202 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.497328 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.497453 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.497453 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] token.caching = True {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.497700 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.497825 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.497951 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] resource.caching = True {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.498085 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.498212 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.498349 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.498476 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.498601 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.498769 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.498902 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.499029 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.499177 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.499306 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.499432 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.499557 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.499682 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.499807 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.500076 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.500225 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.500355 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.500481 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.500607 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.500732 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] role.caching = True {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.500866 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.501000 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] role.driver = sql {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.501127 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.501254 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.501380 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.501506 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.501640 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.501768 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.501905 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.502031 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.502163 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.502294 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.502430 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] database.connection = **** {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.502566 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.502727 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.502862 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.502988 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.503113 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.503239 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.503376 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.503505 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.503641 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.503767 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.503893 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.504018 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.504153 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.504280 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.504413 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.504541 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.504674 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.504806 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.504806 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.505066 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.505197 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.505329 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.505494 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.505638 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.505947 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.506090 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.506223 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.506356 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.506488 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.506488 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.506795 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.506982 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.507121 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.507254 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.507386 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.507530 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 30 01:14:02.507674 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.507674 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.507674 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.507674 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.507674 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.507674 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.507674 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.507674 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.507674 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.508803 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.508803 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.508803 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] token.caching = True {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.508803 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.508803 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.508803 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.508803 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.508803 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.508803 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.510040 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.510040 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.510040 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.510040 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.510040 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.510040 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.510040 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.510040 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.510040 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.511167 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.511167 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.511167 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] database.connection = **** {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.511167 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.511167 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.511167 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.511167 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.511167 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.511167 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.512314 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.512314 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.512314 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.512314 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.512314 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.512314 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.512314 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.512314 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.512314 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.513489 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.513489 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.513489 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 01:14:02.513489 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 30 01:14:02.524095 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 01:14:02.524309 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 01:14:02.524535 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 01:14:02.531319 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 01:14:02.531556 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 01:14:02.531938 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 01:14:02.533600 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 01:14:02.541171 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 01:14:02.564161 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 01:14:02.564370 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 01:14:02.574967 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 01:14:02.575197 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 01:14:02.622714 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 01:14:02.623242 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 01:14:02.674914 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 01:14:02.675144 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 01:14:02.675490 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 01:14:02.675735 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 01:14:02.743527 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 01:14:02.743753 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 01:14:02.743978 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 01:14:02.744199 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 01:14:02.744409 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 01:14:02.744497 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 01:14:02.744621 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 01:14:02.744720 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 01:14:02.744850 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 01:14:02.745069 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 01:14:02.745287 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 01:14:02.745505 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 01:14:02.769867 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 01:14:02.770091 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 01:14:02.770336 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 01:14:02.770559 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 01:14:02.770800 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 01:14:02.771021 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 01:14:02.771172 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 01:14:02.771282 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 01:14:02.771360 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 01:14:02.771592 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 01:14:02.771819 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 01:14:02.772039 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 01:14:02.772255 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 01:14:02.772468 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 01:14:02.783201 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 01:14:02.783312 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 01:14:02.796229 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 01:14:02.796533 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 01:14:02.796669 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 01:14:02.796752 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 01:14:02.796815 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 01:14:02.796916 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 01:14:02.797017 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 01:14:02.797133 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 01:14:02.797216 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 01:14:02.797345 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 01:14:02.797430 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 01:14:02.797556 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 01:14:02.797640 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 01:14:02.797766 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 01:14:02.815746 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.815954 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.816058 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Mar 30 01:14:02.816165 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Mar 30 01:14:02.816292 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.816495 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Mar 30 01:14:02.816576 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.816692 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Mar 30 01:14:02.816783 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.816958 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.817056 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.817217 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.817308 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.817469 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.817569 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.817720 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.828794 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.829072 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.829155 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.829341 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.829427 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.829600 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.829682 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.829875 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.837776 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 30 01:14:02.839552 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 30 01:14:02.841254 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 30 01:14:02.841535 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.841663 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 30 01:14:02.841846 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.842095 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.842252 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.842395 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.842535 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.842676 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.842901 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.843047 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.843188 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.843326 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.843476 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.843627 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.843779 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.843919 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.844057 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.844196 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.844345 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.844486 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.844624 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.871125 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.871827 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.872692 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 30 01:14:02.872975 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.873460 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 30 01:14:02.873741 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.878229 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 30 01:14:02.878505 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.878925 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.879078 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 30 01:14:02.879219 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.879627 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.886841 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 30 01:14:02.887121 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.888134 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 30 01:14:02.888418 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.891579 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 30 01:14:02.891867 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.892154 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.892533 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.892848 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 30 01:14:02.892996 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.893135 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.893281 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.893429 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.893571 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.893707 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.893845 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.893982 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.894188 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.894457 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.894742 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.913017 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.913293 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.913469 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.913688 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.917796 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 30 01:14:02.918149 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 30 01:14:02.921406 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.921699 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.921870 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.922046 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.926812 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 30 01:14:02.927149 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 30 01:14:02.930907 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 30 01:14:02.931465 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 30 01:14:02.934491 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.934817 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.935047 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.935195 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.935405 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.935550 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.935689 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.935828 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.935978 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.936126 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.936267 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.936405 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.955396 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 30 01:14:02.955677 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.955940 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.956088 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 30 01:14:02.956228 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.956366 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.956669 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.956838 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.964176 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.964860 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.965857 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.966130 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.966567 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.966867 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.969293 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 30 01:14:02.969579 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.969859 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.970023 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 30 01:14:02.970165 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.970314 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.970455 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.970594 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.970837 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.971134 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.983604 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 30 01:14:02.983879 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.984162 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.984321 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 30 01:14:02.984471 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.984619 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.984763 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.984902 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.985041 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.985189 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.985329 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.985468 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.987043 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:02.987338 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:03.003894 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 30 01:14:03.006418 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 30 01:14:03.007721 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 30 01:14:03.009844 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 30 01:14:03.010984 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:03.013140 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:03.013914 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:03.015599 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 30 01:14:03.015877 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:03.016154 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:03.024162 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:03.025835 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 30 01:14:03.029150 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:03.029702 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:03.117740 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:03.119456 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 30 01:14:03.119744 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:03.120027 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:03.127433 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:03.128998 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 30 01:14:03.131883 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:03.132219 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:03.132546 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:03.132842 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:03.133131 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:03.133421 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:03.141405 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 30 01:14:03.141691 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:03.141973 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:03.142446 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 30 01:14:03.142777 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:03.143040 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:03.149980 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 30 01:14:03.150401 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:03.150682 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:03.150875 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 30 01:14:03.151027 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:03.151175 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:03.151331 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:03.151507 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:03.151656 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:03.151796 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:03.151932 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:03.152080 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:03.152232 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:03.152371 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:03.152554 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:03.152764 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:03.152907 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:03.153044 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:03.153182 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:03.153320 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:03.153505 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:03.153663 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:03.153894 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:03.154173 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:03.154733 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:03.154997 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:03.155268 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:03.155539 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 01:14:03.191700 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55b87d6e19c0 pid: 79702 (default app) Mar 30 01:14:03.194825 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55b87d6e19c0 pid: 79701 (default app) Mar 30 01:14:03.195787 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c5cb8-8495-4dfa-bff9-5bbe6bc7665e None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:03.196081 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c5cb8-8495-4dfa-bff9-5bbe6bc7665e None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:03.196358 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c5cb8-8495-4dfa-bff9-5bbe6bc7665e None None] PATH_INFO: `/v3` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:03.200565 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1/1] 10.222.0.30 () {50 vars in 791 bytes} [Wed Mar 30 01:14:03 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:11.406574 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b584a-2e07-497e-a880-67d4286e1b4a None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:11.407187 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b584a-2e07-497e-a880-67d4286e1b4a None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:11.407187 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b584a-2e07-497e-a880-67d4286e1b4a None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:11.412693 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1/2] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:14:11 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 01:14:11.417793 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c26c4-9099-4288-92ae-16e699084876 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:11.418204 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c26c4-9099-4288-92ae-16e699084876 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:11.418377 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c26c4-9099-4288-92ae-16e699084876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:11.448111 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG oslo_db.sqlalchemy.engines [None req-3c9c26c4-9099-4288-92ae-16e699084876 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79702) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 30 01:14:11.634547 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG passlib.handlers.bcrypt [None req-3c9c26c4-9099-4288-92ae-16e699084876 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79702) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Mar 30 01:14:11.634997 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG passlib.handlers.bcrypt [None req-3c9c26c4-9099-4288-92ae-16e699084876 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79702) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Mar 30 01:14:11.690508 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-3c9c26c4-9099-4288-92ae-16e699084876 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:14:11.692075 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-3c9c26c4-9099-4288-92ae-16e699084876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:14:11.814205 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 2/3] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:14:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Mar 30 01:14:11.951364 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b584a-2e07-497e-a880-67d4286e1b4a None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:11.983812 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG oslo_db.sqlalchemy.engines [None req-4f1b584a-2e07-497e-a880-67d4286e1b4a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79701) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 30 01:14:12.110578 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b584a-2e07-497e-a880-67d4286e1b4a None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:12.115341 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b13739-0820-43ef-9998-217c01efd58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:12.115988 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b13739-0820-43ef-9998-217c01efd58e admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:12.116266 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b13739-0820-43ef-9998-217c01efd58e admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:12.116536 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b13739-0820-43ef-9998-217c01efd58e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:12.124566 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b13739-0820-43ef-9998-217c01efd58e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:12.175595 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c1b13739-0820-43ef-9998-217c01efd58e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Mar 30 01:14:12.175930 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b13739-0820-43ef-9998-217c01efd58e admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:12.185836 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 2/4] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Mar 30 01:14:11 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 30 01:14:12.192047 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9c26c4-9099-4288-92ae-16e699084876 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:12.206024 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9c26c4-9099-4288-92ae-16e699084876 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:12.210400 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86cae33-b573-4b62-b602-83ae9754b39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:12.211532 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86cae33-b573-4b62-b602-83ae9754b39f admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:12.211816 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86cae33-b573-4b62-b602-83ae9754b39f admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:12.212095 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86cae33-b573-4b62-b602-83ae9754b39f admin admin] PATH_INFO: `/v3/projects/8e7672bb827a4f4ea1fedd14bfb4311b` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:12.213566 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86cae33-b573-4b62-b602-83ae9754b39f admin admin] RBAC: Authorizing `identity:get_project(project_id=8e7672bb827a4f4ea1fedd14bfb4311b)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:12.265209 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b86cae33-b573-4b62-b602-83ae9754b39f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Mar 30 01:14:12.265540 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86cae33-b573-4b62-b602-83ae9754b39f admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:12.270112 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 3/5] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Mar 30 01:14:12 2022] GET /identity/v3/projects/8e7672bb827a4f4ea1fedd14bfb4311b => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:14.532802 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12077ae3-52da-4994-aa4f-47f94d4f87b5 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:14.533324 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12077ae3-52da-4994-aa4f-47f94d4f87b5 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:14.533430 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12077ae3-52da-4994-aa4f-47f94d4f87b5 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:14.537929 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 3/6] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:14:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 01:14:14.543182 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365bb2f3-9c56-4755-9c99-da0256be3714 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:14.543573 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365bb2f3-9c56-4755-9c99-da0256be3714 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:14.543729 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365bb2f3-9c56-4755-9c99-da0256be3714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:14.562343 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-365bb2f3-9c56-4755-9c99-da0256be3714 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:14:14.563862 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-365bb2f3-9c56-4755-9c99-da0256be3714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:14:14.572353 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 4/7] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:14:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Mar 30 01:14:14.595062 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12077ae3-52da-4994-aa4f-47f94d4f87b5 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:14.606879 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12077ae3-52da-4994-aa4f-47f94d4f87b5 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:14.610993 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65614bd9-a74b-4c2d-8892-cca0ab9f1de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:14.611616 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65614bd9-a74b-4c2d-8892-cca0ab9f1de1 admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:14.611896 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65614bd9-a74b-4c2d-8892-cca0ab9f1de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:14.612171 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65614bd9-a74b-4c2d-8892-cca0ab9f1de1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:14.619720 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65614bd9-a74b-4c2d-8892-cca0ab9f1de1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:14.621477 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65614bd9-a74b-4c2d-8892-cca0ab9f1de1 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:14.629945 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 4/8] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Mar 30 01:14:14 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 30 01:14:14.635911 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365bb2f3-9c56-4755-9c99-da0256be3714 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:14.644661 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365bb2f3-9c56-4755-9c99-da0256be3714 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:14.650082 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a273ae18-d84d-4997-ac23-d7c66796a120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:14.650968 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a273ae18-d84d-4997-ac23-d7c66796a120 admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:14.651251 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a273ae18-d84d-4997-ac23-d7c66796a120 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:14.651523 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a273ae18-d84d-4997-ac23-d7c66796a120 admin admin] PATH_INFO: `/v3/users/e9a5ef9b377048458730d23efb1e6534` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:14.652907 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a273ae18-d84d-4997-ac23-d7c66796a120 admin admin] RBAC: Authorizing `identity:get_user(user_id=e9a5ef9b377048458730d23efb1e6534)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:14.655013 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a273ae18-d84d-4997-ac23-d7c66796a120 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:14.656558 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 5/9] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Mar 30 01:14:14 2022] GET /identity/v3/users/e9a5ef9b377048458730d23efb1e6534 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:16.973152 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de6a94-3b16-404f-b70c-6ef2d20a8736 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:16.973648 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de6a94-3b16-404f-b70c-6ef2d20a8736 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:16.973648 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de6a94-3b16-404f-b70c-6ef2d20a8736 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:16.975438 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 5/10] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:14:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:14:16.980603 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280dbb1b-be82-46a3-8b41-4023dcdcac18 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:16.981019 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280dbb1b-be82-46a3-8b41-4023dcdcac18 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:16.981176 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280dbb1b-be82-46a3-8b41-4023dcdcac18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:16.998115 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-280dbb1b-be82-46a3-8b41-4023dcdcac18 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:14:16.999346 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-280dbb1b-be82-46a3-8b41-4023dcdcac18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:14:17.021243 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25db4f72-d109-49af-ae46-04f834a0e75a None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:17.021542 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25db4f72-d109-49af-ae46-04f834a0e75a None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:17.021819 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25db4f72-d109-49af-ae46-04f834a0e75a None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:17.023573 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 6/11] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:14:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 01:14:17.028441 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea09a8b-9b65-4ab5-a844-763bfa0fc52e None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:17.028717 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea09a8b-9b65-4ab5-a844-763bfa0fc52e None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:17.028991 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea09a8b-9b65-4ab5-a844-763bfa0fc52e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:17.069242 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG passlib.handlers.bcrypt [None req-0ea09a8b-9b65-4ab5-a844-763bfa0fc52e None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79701) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Mar 30 01:14:17.069658 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG passlib.handlers.bcrypt [None req-0ea09a8b-9b65-4ab5-a844-763bfa0fc52e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79701) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Mar 30 01:14:17.077453 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 6/12] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:14:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 01:14:17.101909 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280dbb1b-be82-46a3-8b41-4023dcdcac18 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:17.116630 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-0ea09a8b-9b65-4ab5-a844-763bfa0fc52e None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:14:17.118222 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-0ea09a8b-9b65-4ab5-a844-763bfa0fc52e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:14:17.198207 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280dbb1b-be82-46a3-8b41-4023dcdcac18 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:17.213668 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 7/13] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:14:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 30 01:14:17.230941 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aed1412-e398-4a90-a610-bd9cbd520f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:17.231676 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed1412-e398-4a90-a610-bd9cbd520f98 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:17.231964 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed1412-e398-4a90-a610-bd9cbd520f98 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:17.232244 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed1412-e398-4a90-a610-bd9cbd520f98 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:17.236377 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea09a8b-9b65-4ab5-a844-763bfa0fc52e None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:17.243094 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aed1412-e398-4a90-a610-bd9cbd520f98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:14:17.249960 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-8aed1412-e398-4a90-a610-bd9cbd520f98 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 30 01:14:17.251206 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 7/14] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Mar 30 01:14:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 01:14:17.256830 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aed1412-e398-4a90-a610-bd9cbd520f98 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:17.331619 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea09a8b-9b65-4ab5-a844-763bfa0fc52e None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:17.351106 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aed1412-e398-4a90-a610-bd9cbd520f98 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:17.366170 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b398c6f9-4ab7-4653-9cea-8368139024ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:17.367085 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398c6f9-4ab7-4653-9cea-8368139024ff None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:17.367378 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398c6f9-4ab7-4653-9cea-8368139024ff None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:17.367658 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398c6f9-4ab7-4653-9cea-8368139024ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:17.383582 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66184b05-bce3-490c-959c-7b992c2e03f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:17.384241 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66184b05-bce3-490c-959c-7b992c2e03f9 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:17.384528 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66184b05-bce3-490c-959c-7b992c2e03f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:17.384804 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66184b05-bce3-490c-959c-7b992c2e03f9 None admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:17.385544 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66184b05-bce3-490c-959c-7b992c2e03f9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:14:17.385854 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66184b05-bce3-490c-959c-7b992c2e03f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:17.387287 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66184b05-bce3-490c-959c-7b992c2e03f9 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:17.401816 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 8/15] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Mar 30 01:14:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:14:17.408722 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66184b05-bce3-490c-959c-7b992c2e03f9 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:17.449642 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b398c6f9-4ab7-4653-9cea-8368139024ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:17.451197 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b398c6f9-4ab7-4653-9cea-8368139024ff None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:17.505951 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66184b05-bce3-490c-959c-7b992c2e03f9 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:17.542677 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a29be-dc81-4417-8fcb-7c6111e33c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:17.543567 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a29be-dc81-4417-8fcb-7c6111e33c59 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:17.543848 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a29be-dc81-4417-8fcb-7c6111e33c59 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:17.543980 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 8/16] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Mar 30 01:14:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 30 01:14:17.544111 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a29be-dc81-4417-8fcb-7c6111e33c59 None admin] PATH_INFO: `/v3/users/e9a5ef9b377048458730d23efb1e6534` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:17.545313 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4a29be-dc81-4417-8fcb-7c6111e33c59 None admin] RBAC: Authorizing `identity:get_user(user_id=e9a5ef9b377048458730d23efb1e6534)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:17.546795 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4a29be-dc81-4417-8fcb-7c6111e33c59 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:17.548380 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 9/17] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Mar 30 01:14:17 2022] GET /identity/v3/users/e9a5ef9b377048458730d23efb1e6534 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:14:17.549721 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b398c6f9-4ab7-4653-9cea-8368139024ff None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:17.553612 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a29be-dc81-4417-8fcb-7c6111e33c59 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:17.645174 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b398c6f9-4ab7-4653-9cea-8368139024ff None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:17.648090 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a29be-dc81-4417-8fcb-7c6111e33c59 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:17.678390 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b434bcb-a353-492e-bc04-6c6be6919d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:17.679205 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b434bcb-a353-492e-bc04-6c6be6919d7f None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:17.679487 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b434bcb-a353-492e-bc04-6c6be6919d7f None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:17.679757 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b434bcb-a353-492e-bc04-6c6be6919d7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:17.681149 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c900c51-c808-4f94-bb38-f9b62aa63421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:17.681945 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c900c51-c808-4f94-bb38-f9b62aa63421 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:17.682228 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c900c51-c808-4f94-bb38-f9b62aa63421 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:17.682505 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c900c51-c808-4f94-bb38-f9b62aa63421 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:17.683729 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c900c51-c808-4f94-bb38-f9b62aa63421 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:17.685196 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c900c51-c808-4f94-bb38-f9b62aa63421 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:17.686814 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 10/18] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:14:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:14:17.692387 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c900c51-c808-4f94-bb38-f9b62aa63421 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:17.698464 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b434bcb-a353-492e-bc04-6c6be6919d7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:17.699970 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b434bcb-a353-492e-bc04-6c6be6919d7f None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:17.716760 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-2b434bcb-a353-492e-bc04-6c6be6919d7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:14:17.718073 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 9/19] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:14:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:14:17.723764 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b434bcb-a353-492e-bc04-6c6be6919d7f None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:17.787210 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c900c51-c808-4f94-bb38-f9b62aa63421 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:17.819660 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cee6b30-fe57-4881-b52e-74b2b4e34c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:17.820312 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee6b30-fe57-4881-b52e-74b2b4e34c4a None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:17.820594 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee6b30-fe57-4881-b52e-74b2b4e34c4a None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:17.820871 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee6b30-fe57-4881-b52e-74b2b4e34c4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:17.821688 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cee6b30-fe57-4881-b52e-74b2b4e34c4a None admin] RBAC: Adding query filter params (role.id=36909bbf31d04993bb2a9fe587b572dc, scope.domain.id=default, user.id=e9a5ef9b377048458730d23efb1e6534) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:14:17.821998 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cee6b30-fe57-4881-b52e-74b2b4e34c4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:17.822971 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b434bcb-a353-492e-bc04-6c6be6919d7f None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:17.823474 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cee6b30-fe57-4881-b52e-74b2b4e34c4a None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:17.830016 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 11/20] 10.222.0.30 () {56 vars in 1322 bytes} [Wed Mar 30 01:14:17 2022] GET /identity/v3/role_assignments?user.id=e9a5ef9b377048458730d23efb1e6534&scope.domain.id=default&role.id=36909bbf31d04993bb2a9fe587b572dc => generated 233 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:14:17.859337 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848d47d-a6e4-4081-8ff8-7bbd1cfc86f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:17.860017 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848d47d-a6e4-4081-8ff8-7bbd1cfc86f2 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:17.860300 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848d47d-a6e4-4081-8ff8-7bbd1cfc86f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:17.860573 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848d47d-a6e4-4081-8ff8-7bbd1cfc86f2 None admin] PATH_INFO: `/v3/domains` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:17.861318 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4848d47d-a6e4-4081-8ff8-7bbd1cfc86f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:14:17.861623 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4848d47d-a6e4-4081-8ff8-7bbd1cfc86f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:17.863098 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4848d47d-a6e4-4081-8ff8-7bbd1cfc86f2 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:17.882850 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 10/21] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:14:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:14:20.499092 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b644105-1df6-4158-b93c-caf495093dae None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:20.500002 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b644105-1df6-4158-b93c-caf495093dae None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:20.500535 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b644105-1df6-4158-b93c-caf495093dae None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:20.503070 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 12/22] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:14:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:14:20.512363 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482bc37a-8e3b-470f-9046-c19cd74e54df None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:20.513287 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482bc37a-8e3b-470f-9046-c19cd74e54df None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:20.513775 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482bc37a-8e3b-470f-9046-c19cd74e54df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:20.543721 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-482bc37a-8e3b-470f-9046-c19cd74e54df None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:14:20.545294 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-482bc37a-8e3b-470f-9046-c19cd74e54df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:14:20.631354 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 11/23] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:14:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 01:14:20.678056 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b644105-1df6-4158-b93c-caf495093dae None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:20.804683 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b644105-1df6-4158-b93c-caf495093dae None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:20.847147 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28c88dd-5fee-4cee-b480-b6ee831ea1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:20.847958 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c88dd-5fee-4cee-b480-b6ee831ea1f0 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:20.848243 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c88dd-5fee-4cee-b480-b6ee831ea1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:20.848524 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c88dd-5fee-4cee-b480-b6ee831ea1f0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:20.868204 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28c88dd-5fee-4cee-b480-b6ee831ea1f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:14:20.875091 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-c28c88dd-5fee-4cee-b480-b6ee831ea1f0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 30 01:14:20.884370 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 13/24] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Mar 30 01:14:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:14:20.886530 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482bc37a-8e3b-470f-9046-c19cd74e54df None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:21.030489 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482bc37a-8e3b-470f-9046-c19cd74e54df None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:21.074497 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a44788e-f637-466b-9661-5b77b450af8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:21.075518 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44788e-f637-466b-9661-5b77b450af8a None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:21.076012 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44788e-f637-466b-9661-5b77b450af8a None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:21.076489 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44788e-f637-466b-9661-5b77b450af8a None admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:21.077431 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a44788e-f637-466b-9661-5b77b450af8a None admin] RBAC: Adding query filter params (name=admin) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:14:21.077936 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a44788e-f637-466b-9661-5b77b450af8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:21.079555 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a44788e-f637-466b-9661-5b77b450af8a None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:21.097976 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 12/25] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Mar 30 01:14:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:21.104721 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28c88dd-5fee-4cee-b480-b6ee831ea1f0 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:21.213172 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a7e35-e543-4b5c-9b33-f17e4f9c03bf None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:21.213815 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a7e35-e543-4b5c-9b33-f17e4f9c03bf None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:21.214286 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a7e35-e543-4b5c-9b33-f17e4f9c03bf None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:21.220157 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 13/26] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:14:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:14:21.221711 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf3b71-e013-4aa2-936d-be1b7c992d07 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:21.222210 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf3b71-e013-4aa2-936d-be1b7c992d07 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:21.222692 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf3b71-e013-4aa2-936d-be1b7c992d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:21.242798 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28c88dd-5fee-4cee-b480-b6ee831ea1f0 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:21.263763 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-0baf3b71-e013-4aa2-936d-be1b7c992d07 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:14:21.265303 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-0baf3b71-e013-4aa2-936d-be1b7c992d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:14:21.287349 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe321cf-d447-421c-aa65-ae0883d38a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:21.288512 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe321cf-d447-421c-aa65-ae0883d38a05 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:21.288799 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe321cf-d447-421c-aa65-ae0883d38a05 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:21.289073 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe321cf-d447-421c-aa65-ae0883d38a05 None admin] PATH_INFO: `/v3/users/e9a5ef9b377048458730d23efb1e6534` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:21.292975 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe321cf-d447-421c-aa65-ae0883d38a05 None admin] RBAC: Authorizing `identity:get_user(user_id=e9a5ef9b377048458730d23efb1e6534)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:21.294449 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe321cf-d447-421c-aa65-ae0883d38a05 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:21.296334 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 14/27] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Mar 30 01:14:21 2022] GET /identity/v3/users/e9a5ef9b377048458730d23efb1e6534 => generated 247 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:21.297290 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b8edf-9d1f-4d24-8f11-35a3ab884b47 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:21.297704 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b8edf-9d1f-4d24-8f11-35a3ab884b47 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:21.297826 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b8edf-9d1f-4d24-8f11-35a3ab884b47 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:21.299469 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 15/28] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:14:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:14:21.309005 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2b8edf-9d1f-4d24-8f11-35a3ab884b47 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:21.363911 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 14/29] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:14:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 01:14:21.366484 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81519e29-2572-4bf7-936a-f7de4c3f76b0 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:21.366973 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81519e29-2572-4bf7-936a-f7de4c3f76b0 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:21.367445 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81519e29-2572-4bf7-936a-f7de4c3f76b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:21.384663 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-81519e29-2572-4bf7-936a-f7de4c3f76b0 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:14:21.386180 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-81519e29-2572-4bf7-936a-f7de4c3f76b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:14:21.437935 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2b8edf-9d1f-4d24-8f11-35a3ab884b47 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:21.455431 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 15/30] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:14:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 01:14:21.457039 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c078d17-4357-4620-80e9-51101bcb0bac None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:21.457493 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c078d17-4357-4620-80e9-51101bcb0bac None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:21.457915 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c078d17-4357-4620-80e9-51101bcb0bac None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:21.459975 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 16/31] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:14:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:14:21.464693 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c078d17-4357-4620-80e9-51101bcb0bac None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:21.477765 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79e8d60-e2a7-4686-8406-9d8d1b60b24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:21.478574 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e8d60-e2a7-4686-8406-9d8d1b60b24f None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:21.479186 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e8d60-e2a7-4686-8406-9d8d1b60b24f None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:21.479468 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e8d60-e2a7-4686-8406-9d8d1b60b24f None admin] PATH_INFO: `/v3/domains/default` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:21.480873 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79e8d60-e2a7-4686-8406-9d8d1b60b24f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:21.482504 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79e8d60-e2a7-4686-8406-9d8d1b60b24f None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:21.484721 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 16/32] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:14:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:21.485967 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa54d9-5d7c-46b4-b2e5-f760ad818b6c None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:21.486255 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa54d9-5d7c-46b4-b2e5-f760ad818b6c None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:21.486542 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa54d9-5d7c-46b4-b2e5-f760ad818b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:21.505095 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-bdfa54d9-5d7c-46b4-b2e5-f760ad818b6c None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:14:21.507429 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-bdfa54d9-5d7c-46b4-b2e5-f760ad818b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:14:21.581106 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 17/33] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:14:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 01:14:21.587833 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfa54d9-5d7c-46b4-b2e5-f760ad818b6c None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:21.589379 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c078d17-4357-4620-80e9-51101bcb0bac None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:21.634213 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c258d8-ecbb-4b4a-819b-0590c879c9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:21.634975 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c258d8-ecbb-4b4a-819b-0590c879c9de None admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:21.635263 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c258d8-ecbb-4b4a-819b-0590c879c9de None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:21.635539 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c258d8-ecbb-4b4a-819b-0590c879c9de None admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:21.636344 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c258d8-ecbb-4b4a-819b-0590c879c9de None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:21.637784 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c258d8-ecbb-4b4a-819b-0590c879c9de None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:21.700320 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfa54d9-5d7c-46b4-b2e5-f760ad818b6c None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:21.735427 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae0652c-c03a-4554-9e49-a573b50b2379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:21.736461 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0652c-c03a-4554-9e49-a573b50b2379 None admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:21.736848 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0652c-c03a-4554-9e49-a573b50b2379 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:21.737232 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0652c-c03a-4554-9e49-a573b50b2379 None admin] PATH_INFO: `/v3/domains/default/users/e9a5ef9b377048458730d23efb1e6534/roles/36909bbf31d04993bb2a9fe587b572dc` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:21.739426 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae0652c-c03a-4554-9e49-a573b50b2379 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=e9a5ef9b377048458730d23efb1e6534, role_id=36909bbf31d04993bb2a9fe587b572dc)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:21.741015 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae0652c-c03a-4554-9e49-a573b50b2379 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:21.770022 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 17/34] 10.222.0.30 () {60 vars in 1131 bytes} [Wed Mar 30 01:14:21 2022] POST /identity/v3/roles => generated 225 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:14:21.771581 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c258d8-ecbb-4b4a-819b-0590c879c9de None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:21.871835 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 18/35] 10.222.0.30 () {58 vars in 1361 bytes} [Wed Mar 30 01:14:21 2022] PUT /identity/v3/domains/default/users/e9a5ef9b377048458730d23efb1e6534/roles/36909bbf31d04993bb2a9fe587b572dc => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:14:21.873264 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae0652c-c03a-4554-9e49-a573b50b2379 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:21.884638 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c258d8-ecbb-4b4a-819b-0590c879c9de None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:21.924091 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72211b02-0089-4743-964b-674779c5df05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:21.924776 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72211b02-0089-4743-964b-674779c5df05 None admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:21.925063 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72211b02-0089-4743-964b-674779c5df05 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:21.925346 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72211b02-0089-4743-964b-674779c5df05 None admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:21.926098 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72211b02-0089-4743-964b-674779c5df05 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:21.928621 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72211b02-0089-4743-964b-674779c5df05 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:21.957846 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 18/36] 10.222.0.30 () {60 vars in 1131 bytes} [Wed Mar 30 01:14:21 2022] POST /identity/v3/roles => generated 219 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:14:22.005517 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae0652c-c03a-4554-9e49-a573b50b2379 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:22.011642 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a9b02-e378-4f79-82a9-a4e3842b2762 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:22.011959 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a9b02-e378-4f79-82a9-a4e3842b2762 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:22.012199 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a9b02-e378-4f79-82a9-a4e3842b2762 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:22.014311 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 19/37] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:14:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 01:14:22.019982 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d2e0eb-d21b-48d6-8ec9-be8fdb2b39c8 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:22.020295 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d2e0eb-d21b-48d6-8ec9-be8fdb2b39c8 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:22.020544 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d2e0eb-d21b-48d6-8ec9-be8fdb2b39c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:22.040770 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-22d2e0eb-d21b-48d6-8ec9-be8fdb2b39c8 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:14:22.042348 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-22d2e0eb-d21b-48d6-8ec9-be8fdb2b39c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:14:22.050189 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f7262-f4fe-452a-8c19-52c9d1e58d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:22.051057 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f7262-f4fe-452a-8c19-52c9d1e58d98 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:22.052057 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f7262-f4fe-452a-8c19-52c9d1e58d98 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:22.052534 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f7262-f4fe-452a-8c19-52c9d1e58d98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:22.067536 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071f7262-f4fe-452a-8c19-52c9d1e58d98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:22.072335 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071f7262-f4fe-452a-8c19-52c9d1e58d98 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:22.094645 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-071f7262-f4fe-452a-8c19-52c9d1e58d98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:14:22.095948 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 19/38] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:14:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:14:22.102511 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f7262-f4fe-452a-8c19-52c9d1e58d98 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:22.136518 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 20/39] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:14:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 01:14:22.162932 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d2e0eb-d21b-48d6-8ec9-be8fdb2b39c8 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:22.219137 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f7262-f4fe-452a-8c19-52c9d1e58d98 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:22.258446 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbd058d-5a0d-4e7b-a571-24886e71137c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:22.259218 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd058d-5a0d-4e7b-a571-24886e71137c None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:22.259552 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd058d-5a0d-4e7b-a571-24886e71137c None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:22.259885 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd058d-5a0d-4e7b-a571-24886e71137c None admin] PATH_INFO: `/v3/domains` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:22.260628 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbd058d-5a0d-4e7b-a571-24886e71137c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:14:22.260936 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbd058d-5a0d-4e7b-a571-24886e71137c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:22.262374 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbd058d-5a0d-4e7b-a571-24886e71137c None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:22.274103 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d2e0eb-d21b-48d6-8ec9-be8fdb2b39c8 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:22.285267 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 20/40] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:14:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:14:22.291414 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbd058d-5a0d-4e7b-a571-24886e71137c None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:22.313345 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85525449-0286-45f2-9faf-d12728d002b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:22.314087 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85525449-0286-45f2-9faf-d12728d002b9 None admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:22.314381 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85525449-0286-45f2-9faf-d12728d002b9 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:22.314661 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85525449-0286-45f2-9faf-d12728d002b9 None admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:22.315465 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85525449-0286-45f2-9faf-d12728d002b9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:22.316861 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85525449-0286-45f2-9faf-d12728d002b9 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:22.338110 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 21/41] 10.222.0.30 () {60 vars in 1131 bytes} [Wed Mar 30 01:14:22 2022] POST /identity/v3/roles => generated 223 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:14:22.419728 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbd058d-5a0d-4e7b-a571-24886e71137c None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:22.457584 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efc302a-0935-49c4-b1ff-5d393f5886f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:22.458802 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc302a-0935-49c4-b1ff-5d393f5886f0 None admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:22.459107 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc302a-0935-49c4-b1ff-5d393f5886f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:22.459391 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc302a-0935-49c4-b1ff-5d393f5886f0 None admin] PATH_INFO: `/v3/projects` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:22.460120 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efc302a-0935-49c4-b1ff-5d393f5886f0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:22.461631 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efc302a-0935-49c4-b1ff-5d393f5886f0 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:22.498201 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 21/42] 10.222.0.30 () {60 vars in 1141 bytes} [Wed Mar 30 01:14:22 2022] POST /identity/v3/projects => generated 301 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:14:22.781620 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d0f4ef-690e-4b0b-ac08-6f8ccbd1f790 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:22.782111 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d0f4ef-690e-4b0b-ac08-6f8ccbd1f790 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:22.782111 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d0f4ef-690e-4b0b-ac08-6f8ccbd1f790 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:22.784053 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 22/43] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:14:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:14:22.789462 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2615738f-f7f1-4654-85e5-89c55e89f0e1 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:22.789897 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2615738f-f7f1-4654-85e5-89c55e89f0e1 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:22.790025 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2615738f-f7f1-4654-85e5-89c55e89f0e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:22.806895 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-2615738f-f7f1-4654-85e5-89c55e89f0e1 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:14:22.808391 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-2615738f-f7f1-4654-85e5-89c55e89f0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:14:22.878964 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 22/44] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:14:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 30 01:14:22.902955 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d0f4ef-690e-4b0b-ac08-6f8ccbd1f790 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:23.001574 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d0f4ef-690e-4b0b-ac08-6f8ccbd1f790 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:23.034654 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf9a230-497e-40ef-a833-d8f6c94e57bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:23.035406 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf9a230-497e-40ef-a833-d8f6c94e57bb None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:23.035691 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf9a230-497e-40ef-a833-d8f6c94e57bb None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:23.035967 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf9a230-497e-40ef-a833-d8f6c94e57bb None admin] PATH_INFO: `/v3/domains/default` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:23.037436 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf9a230-497e-40ef-a833-d8f6c94e57bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:23.038906 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf9a230-497e-40ef-a833-d8f6c94e57bb None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:23.040504 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 23/45] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:14:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:23.046098 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2615738f-f7f1-4654-85e5-89c55e89f0e1 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:23.139934 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2615738f-f7f1-4654-85e5-89c55e89f0e1 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:23.171454 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ccd409-f8aa-4df1-acd0-fbda618d8461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:23.172113 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ccd409-f8aa-4df1-acd0-fbda618d8461 None admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:23.172396 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ccd409-f8aa-4df1-acd0-fbda618d8461 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:23.172670 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ccd409-f8aa-4df1-acd0-fbda618d8461 None admin] PATH_INFO: `/v3/projects` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:23.173365 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ccd409-f8aa-4df1-acd0-fbda618d8461 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:23.174839 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ccd409-f8aa-4df1-acd0-fbda618d8461 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:23.202285 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 23/46] 10.222.0.30 () {60 vars in 1141 bytes} [Wed Mar 30 01:14:23 2022] POST /identity/v3/projects => generated 312 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 01:14:24.506982 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd10a50-c9ec-4f3b-bc46-ebddb9078185 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:24.507497 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd10a50-c9ec-4f3b-bc46-ebddb9078185 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:24.507602 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd10a50-c9ec-4f3b-bc46-ebddb9078185 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:24.509271 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 24/47] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:14:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:14:24.514505 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb72436c-60f9-4cc9-b713-2f047419230e None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:24.514930 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb72436c-60f9-4cc9-b713-2f047419230e None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:24.515084 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb72436c-60f9-4cc9-b713-2f047419230e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:24.532836 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-eb72436c-60f9-4cc9-b713-2f047419230e None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:14:24.533998 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-eb72436c-60f9-4cc9-b713-2f047419230e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:14:24.599659 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 24/48] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:14:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 01:14:24.623223 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd10a50-c9ec-4f3b-bc46-ebddb9078185 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:24.730176 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd10a50-c9ec-4f3b-bc46-ebddb9078185 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:24.764383 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5039f0d2-a289-4005-9dba-f6b7e7331826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:24.765395 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039f0d2-a289-4005-9dba-f6b7e7331826 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:24.765817 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039f0d2-a289-4005-9dba-f6b7e7331826 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:24.766229 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039f0d2-a289-4005-9dba-f6b7e7331826 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:24.778148 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5039f0d2-a289-4005-9dba-f6b7e7331826 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:14:24.785348 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-5039f0d2-a289-4005-9dba-f6b7e7331826 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 30 01:14:24.791489 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 25/49] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Mar 30 01:14:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 01:14:24.792574 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb72436c-60f9-4cc9-b713-2f047419230e None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:24.891390 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb72436c-60f9-4cc9-b713-2f047419230e None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:24.924493 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d167d4-f511-423a-8bbc-2f893da86f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:24.925165 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d167d4-f511-423a-8bbc-2f893da86f8b None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:24.925450 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d167d4-f511-423a-8bbc-2f893da86f8b None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:24.925729 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d167d4-f511-423a-8bbc-2f893da86f8b None admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:24.926477 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d167d4-f511-423a-8bbc-2f893da86f8b None admin] RBAC: Adding query filter params (name=admin) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:14:24.926822 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d167d4-f511-423a-8bbc-2f893da86f8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:24.928935 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d167d4-f511-423a-8bbc-2f893da86f8b None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:24.936914 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 25/50] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Mar 30 01:14:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:14:24.942512 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5039f0d2-a289-4005-9dba-f6b7e7331826 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:25.038610 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5039f0d2-a289-4005-9dba-f6b7e7331826 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:25.071203 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa2acf-91dc-4b39-b9b3-089697da9112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:25.072078 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa2acf-91dc-4b39-b9b3-089697da9112 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:25.072369 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa2acf-91dc-4b39-b9b3-089697da9112 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:25.072654 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa2acf-91dc-4b39-b9b3-089697da9112 None admin] PATH_INFO: `/v3/users/e9a5ef9b377048458730d23efb1e6534` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:25.074085 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaa2acf-91dc-4b39-b9b3-089697da9112 None admin] RBAC: Authorizing `identity:get_user(user_id=e9a5ef9b377048458730d23efb1e6534)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:25.075581 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaa2acf-91dc-4b39-b9b3-089697da9112 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:25.077216 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 26/51] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Mar 30 01:14:24 2022] GET /identity/v3/users/e9a5ef9b377048458730d23efb1e6534 => generated 247 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:25.082660 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d167d4-f511-423a-8bbc-2f893da86f8b None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:25.182973 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d167d4-f511-423a-8bbc-2f893da86f8b None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:25.214312 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba325357-8674-4404-ad6e-850bbc66f70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:25.215130 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba325357-8674-4404-ad6e-850bbc66f70d None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:25.215421 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba325357-8674-4404-ad6e-850bbc66f70d None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:25.215757 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba325357-8674-4404-ad6e-850bbc66f70d None admin] PATH_INFO: `/v3/domains/default` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:25.216932 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba325357-8674-4404-ad6e-850bbc66f70d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:25.218387 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba325357-8674-4404-ad6e-850bbc66f70d None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:25.220047 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 26/52] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:14:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:14:25.226574 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa2acf-91dc-4b39-b9b3-089697da9112 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:25.322363 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa2acf-91dc-4b39-b9b3-089697da9112 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:25.354983 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4755a5f0-dc46-4727-86f8-5f3bb0759539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:25.355646 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4755a5f0-dc46-4727-86f8-5f3bb0759539 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:25.355933 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4755a5f0-dc46-4727-86f8-5f3bb0759539 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:25.356214 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4755a5f0-dc46-4727-86f8-5f3bb0759539 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:25.357045 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4755a5f0-dc46-4727-86f8-5f3bb0759539 None admin] RBAC: Adding query filter params (role.id=36909bbf31d04993bb2a9fe587b572dc, scope.domain.id=default, user.id=e9a5ef9b377048458730d23efb1e6534) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:14:25.357363 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4755a5f0-dc46-4727-86f8-5f3bb0759539 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:25.358842 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4755a5f0-dc46-4727-86f8-5f3bb0759539 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:25.367879 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 27/53] 10.222.0.30 () {56 vars in 1322 bytes} [Wed Mar 30 01:14:25 2022] GET /identity/v3/role_assignments?user.id=e9a5ef9b377048458730d23efb1e6534&scope.domain.id=default&role.id=36909bbf31d04993bb2a9fe587b572dc => generated 530 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:14:25.485874 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba5313-59bb-473a-a690-04889a382abe None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:25.486217 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba5313-59bb-473a-a690-04889a382abe None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:25.486589 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba5313-59bb-473a-a690-04889a382abe None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:25.488492 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 27/54] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:14:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:14:25.494730 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73020945-fadd-40f1-ba45-a04cf6290441 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:25.495060 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73020945-fadd-40f1-ba45-a04cf6290441 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:25.495345 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73020945-fadd-40f1-ba45-a04cf6290441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:25.513054 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-73020945-fadd-40f1-ba45-a04cf6290441 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:14:25.514278 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-73020945-fadd-40f1-ba45-a04cf6290441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:14:25.581927 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 28/55] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:14:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 30 01:14:25.606423 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ba5313-59bb-473a-a690-04889a382abe None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:25.703861 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ba5313-59bb-473a-a690-04889a382abe None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:25.735427 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff442d5-003b-4561-b77f-14b6b5d9df78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:25.736206 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff442d5-003b-4561-b77f-14b6b5d9df78 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:25.736487 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff442d5-003b-4561-b77f-14b6b5d9df78 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:25.736760 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff442d5-003b-4561-b77f-14b6b5d9df78 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:25.737915 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff442d5-003b-4561-b77f-14b6b5d9df78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:25.739383 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff442d5-003b-4561-b77f-14b6b5d9df78 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:25.740985 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 28/56] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:14:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:25.746612 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73020945-fadd-40f1-ba45-a04cf6290441 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:25.840150 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73020945-fadd-40f1-ba45-a04cf6290441 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:25.871250 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160317cb-894b-4ffd-934c-e28e6f2da1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:25.871896 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160317cb-894b-4ffd-934c-e28e6f2da1fb None admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:25.872185 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160317cb-894b-4ffd-934c-e28e6f2da1fb None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:25.872465 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160317cb-894b-4ffd-934c-e28e6f2da1fb None admin] PATH_INFO: `/v3/projects` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:25.873177 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160317cb-894b-4ffd-934c-e28e6f2da1fb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:25.874625 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160317cb-894b-4ffd-934c-e28e6f2da1fb None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:25.900918 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 29/57] 10.222.0.30 () {60 vars in 1140 bytes} [Wed Mar 30 01:14:25 2022] POST /identity/v3/projects => generated 298 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:14:28.196947 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2923d559-e524-4fd5-9876-68ce3a9fd24a None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:28.197464 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2923d559-e524-4fd5-9876-68ce3a9fd24a None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:28.197544 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2923d559-e524-4fd5-9876-68ce3a9fd24a None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:28.199315 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 29/58] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:14:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:14:28.204514 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbacb43-5afa-42d4-b83c-bda7b60446d6 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:28.204912 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbacb43-5afa-42d4-b83c-bda7b60446d6 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:28.205085 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbacb43-5afa-42d4-b83c-bda7b60446d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:28.222002 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-9fbacb43-5afa-42d4-b83c-bda7b60446d6 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:14:28.223217 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-9fbacb43-5afa-42d4-b83c-bda7b60446d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:14:28.287963 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 30/59] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:14:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 30 01:14:28.311947 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2923d559-e524-4fd5-9876-68ce3a9fd24a None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:28.408327 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2923d559-e524-4fd5-9876-68ce3a9fd24a None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:28.440088 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a7917-cd7d-47f3-a290-95e8a5a45188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:28.440865 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a7917-cd7d-47f3-a290-95e8a5a45188 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:28.441151 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a7917-cd7d-47f3-a290-95e8a5a45188 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:28.441429 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a7917-cd7d-47f3-a290-95e8a5a45188 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:28.442745 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53a7917-cd7d-47f3-a290-95e8a5a45188 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:28.444517 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53a7917-cd7d-47f3-a290-95e8a5a45188 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:28.446086 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 30/60] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:14:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:28.451386 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbacb43-5afa-42d4-b83c-bda7b60446d6 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:28.546873 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbacb43-5afa-42d4-b83c-bda7b60446d6 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:28.578757 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0136d2f2-e9f1-42a7-994a-deed07872c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:28.579412 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0136d2f2-e9f1-42a7-994a-deed07872c9d None admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:28.579700 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0136d2f2-e9f1-42a7-994a-deed07872c9d None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:28.579980 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0136d2f2-e9f1-42a7-994a-deed07872c9d None admin] PATH_INFO: `/v3/users` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:28.580693 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0136d2f2-e9f1-42a7-994a-deed07872c9d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:28.582136 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0136d2f2-e9f1-42a7-994a-deed07872c9d None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:28.606031 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 31/61] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Mar 30 01:14:28 2022] POST /identity/v3/users => generated 275 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 01:14:32.195828 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4deaa54-d135-438d-9966-0907bb2beebf None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:32.196341 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4deaa54-d135-438d-9966-0907bb2beebf None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:32.196413 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4deaa54-d135-438d-9966-0907bb2beebf None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:32.198172 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 31/62] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:14:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:14:32.199878 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdaffe6-240d-42ec-95f5-2a3cdce3394f None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:32.200350 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdaffe6-240d-42ec-95f5-2a3cdce3394f None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:32.200632 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdaffe6-240d-42ec-95f5-2a3cdce3394f None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:32.204039 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9dc20-34e1-4add-b34b-afda65176a56 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:32.204337 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9dc20-34e1-4add-b34b-afda65176a56 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:32.204623 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9dc20-34e1-4add-b34b-afda65176a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:32.205973 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 32/63] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:14:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:14:32.226376 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-08e9dc20-34e1-4add-b34b-afda65176a56 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:14:32.227624 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-08e9dc20-34e1-4add-b34b-afda65176a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:14:32.244580 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc054745-6b4e-4ba1-9871-40aca8b712fa None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:32.245000 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc054745-6b4e-4ba1-9871-40aca8b712fa None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:32.245516 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc054745-6b4e-4ba1-9871-40aca8b712fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:32.267438 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-dc054745-6b4e-4ba1-9871-40aca8b712fa None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:14:32.268966 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-dc054745-6b4e-4ba1-9871-40aca8b712fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:14:32.307210 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 32/64] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:14:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 01:14:32.308804 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a45d7-0d65-4a32-86fd-310ba0d91b82 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:32.309016 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a45d7-0d65-4a32-86fd-310ba0d91b82 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:32.309297 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a45d7-0d65-4a32-86fd-310ba0d91b82 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:32.311172 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 33/65] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:14:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:14:32.319443 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26933ce0-077a-4dbe-b4e2-9f90dd3d860d None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:32.319977 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26933ce0-077a-4dbe-b4e2-9f90dd3d860d None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:32.320397 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26933ce0-077a-4dbe-b4e2-9f90dd3d860d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:32.349683 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-26933ce0-077a-4dbe-b4e2-9f90dd3d860d None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:14:32.351233 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-26933ce0-077a-4dbe-b4e2-9f90dd3d860d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:14:32.353320 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 33/66] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:14:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 30 01:14:32.355484 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc054745-6b4e-4ba1-9871-40aca8b712fa None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:32.438583 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 34/67] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:14:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 01:14:32.447699 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26933ce0-077a-4dbe-b4e2-9f90dd3d860d None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:32.459545 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc054745-6b4e-4ba1-9871-40aca8b712fa None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:32.497706 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292536b9-22d5-45ea-8f95-5f17c1594ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:32.498991 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292536b9-22d5-45ea-8f95-5f17c1594ccf None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:32.499602 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292536b9-22d5-45ea-8f95-5f17c1594ccf None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:32.499888 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292536b9-22d5-45ea-8f95-5f17c1594ccf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:32.510589 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292536b9-22d5-45ea-8f95-5f17c1594ccf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:14:32.518029 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-292536b9-22d5-45ea-8f95-5f17c1594ccf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 30 01:14:32.519453 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 34/68] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Mar 30 01:14:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:14:32.520160 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292536b9-22d5-45ea-8f95-5f17c1594ccf None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:32.568138 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26933ce0-077a-4dbe-b4e2-9f90dd3d860d None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:32.601354 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e89ee8b-9340-4f90-ad30-b55074062d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:32.602391 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e89ee8b-9340-4f90-ad30-b55074062d38 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:32.602841 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e89ee8b-9340-4f90-ad30-b55074062d38 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:32.603252 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e89ee8b-9340-4f90-ad30-b55074062d38 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:32.614480 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e89ee8b-9340-4f90-ad30-b55074062d38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:14:32.621668 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-6e89ee8b-9340-4f90-ad30-b55074062d38 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 30 01:14:32.623106 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 35/69] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Mar 30 01:14:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:14:32.624249 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c6968-e377-4cb3-9f80-baa8a0a59e38 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:32.624535 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c6968-e377-4cb3-9f80-baa8a0a59e38 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:32.624810 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c6968-e377-4cb3-9f80-baa8a0a59e38 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:32.626464 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 36/70] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:14:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:14:32.628663 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292536b9-22d5-45ea-8f95-5f17c1594ccf None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:32.631556 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2c6968-e377-4cb3-9f80-baa8a0a59e38 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:32.664862 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68637d71-9f5c-4392-953e-372c9f7891c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:32.665677 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68637d71-9f5c-4392-953e-372c9f7891c5 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:32.665938 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68637d71-9f5c-4392-953e-372c9f7891c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:32.666216 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68637d71-9f5c-4392-953e-372c9f7891c5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:32.676060 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68637d71-9f5c-4392-953e-372c9f7891c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:14:32.683572 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-68637d71-9f5c-4392-953e-372c9f7891c5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 30 01:14:32.684751 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 35/71] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Mar 30 01:14:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:14:32.685518 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68637d71-9f5c-4392-953e-372c9f7891c5 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:32.732254 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2c6968-e377-4cb3-9f80-baa8a0a59e38 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:32.764639 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81544f73-bbe1-4bb6-bb22-f484279ee3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:32.765308 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81544f73-bbe1-4bb6-bb22-f484279ee3b4 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:32.765600 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81544f73-bbe1-4bb6-bb22-f484279ee3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:32.765885 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81544f73-bbe1-4bb6-bb22-f484279ee3b4 None admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:32.766639 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81544f73-bbe1-4bb6-bb22-f484279ee3b4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:14:32.766985 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81544f73-bbe1-4bb6-bb22-f484279ee3b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:32.768388 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81544f73-bbe1-4bb6-bb22-f484279ee3b4 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:32.776629 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 37/72] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Mar 30 01:14:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:32.779102 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19927951-8315-4825-9e9e-842599708524 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:32.779401 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19927951-8315-4825-9e9e-842599708524 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:32.779683 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19927951-8315-4825-9e9e-842599708524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:32.780289 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68637d71-9f5c-4392-953e-372c9f7891c5 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:32.796518 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-19927951-8315-4825-9e9e-842599708524 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:14:32.797708 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-19927951-8315-4825-9e9e-842599708524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:14:32.814034 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cef99b8-40f1-4c4c-8b08-1a70bf132ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:32.814721 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef99b8-40f1-4c4c-8b08-1a70bf132ece None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:32.815018 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef99b8-40f1-4c4c-8b08-1a70bf132ece None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:32.815299 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef99b8-40f1-4c4c-8b08-1a70bf132ece None admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:32.816047 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cef99b8-40f1-4c4c-8b08-1a70bf132ece None admin] RBAC: Adding query filter params (name=admin) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:14:32.816357 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cef99b8-40f1-4c4c-8b08-1a70bf132ece None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:32.817771 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cef99b8-40f1-4c4c-8b08-1a70bf132ece None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:32.825627 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 36/73] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Mar 30 01:14:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:32.826934 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7ca3a-1612-467f-99b6-eee8e51ccf64 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:32.827229 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7ca3a-1612-467f-99b6-eee8e51ccf64 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:32.827512 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7ca3a-1612-467f-99b6-eee8e51ccf64 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:32.829302 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 37/74] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:14:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:14:32.830085 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e7ca3a-1612-467f-99b6-eee8e51ccf64 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:32.863008 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 38/75] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:14:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 01:14:32.864115 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19927951-8315-4825-9e9e-842599708524 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:32.933369 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e7ca3a-1612-467f-99b6-eee8e51ccf64 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:32.962346 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19927951-8315-4825-9e9e-842599708524 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:32.966528 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54820e56-f3a1-4dfc-a1bf-c83a166e022a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:32.967221 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54820e56-f3a1-4dfc-a1bf-c83a166e022a None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:32.967506 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54820e56-f3a1-4dfc-a1bf-c83a166e022a None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:32.967784 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54820e56-f3a1-4dfc-a1bf-c83a166e022a None admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:32.968522 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54820e56-f3a1-4dfc-a1bf-c83a166e022a None admin] RBAC: Adding query filter params (name=member) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:14:32.968828 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54820e56-f3a1-4dfc-a1bf-c83a166e022a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:32.970216 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54820e56-f3a1-4dfc-a1bf-c83a166e022a None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:32.977867 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 38/76] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Mar 30 01:14:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:32.977867 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54820e56-f3a1-4dfc-a1bf-c83a166e022a None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:33.000483 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1126d2-665b-4cb2-95b6-4e835717a243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:33.001290 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1126d2-665b-4cb2-95b6-4e835717a243 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:33.001577 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1126d2-665b-4cb2-95b6-4e835717a243 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:33.001855 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1126d2-665b-4cb2-95b6-4e835717a243 None admin] PATH_INFO: `/v3/users/6cf69a2898a141f6bb15a9b7af982ed8` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:33.020910 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1126d2-665b-4cb2-95b6-4e835717a243 None admin] RBAC: Authorizing `identity:get_user(user_id=6cf69a2898a141f6bb15a9b7af982ed8)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:33.023320 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1126d2-665b-4cb2-95b6-4e835717a243 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:33.026068 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 39/77] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Mar 30 01:14:32 2022] GET /identity/v3/users/6cf69a2898a141f6bb15a9b7af982ed8 => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:33.027761 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a238d726-7e3a-4516-b1ec-8123b8a40638 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:33.028208 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a238d726-7e3a-4516-b1ec-8123b8a40638 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:33.028635 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a238d726-7e3a-4516-b1ec-8123b8a40638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:33.048782 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-a238d726-7e3a-4516-b1ec-8123b8a40638 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:14:33.050287 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-a238d726-7e3a-4516-b1ec-8123b8a40638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:14:33.075171 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54820e56-f3a1-4dfc-a1bf-c83a166e022a None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:33.108029 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6324f3c5-0d1e-49b9-b58f-0232d2db9958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:33.108893 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6324f3c5-0d1e-49b9-b58f-0232d2db9958 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:33.109179 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6324f3c5-0d1e-49b9-b58f-0232d2db9958 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:33.109455 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6324f3c5-0d1e-49b9-b58f-0232d2db9958 None admin] PATH_INFO: `/v3/users/e9a5ef9b377048458730d23efb1e6534` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:33.110669 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6324f3c5-0d1e-49b9-b58f-0232d2db9958 None admin] RBAC: Authorizing `identity:get_user(user_id=e9a5ef9b377048458730d23efb1e6534)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:33.112146 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6324f3c5-0d1e-49b9-b58f-0232d2db9958 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:33.113912 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 39/78] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Mar 30 01:14:32 2022] GET /identity/v3/users/e9a5ef9b377048458730d23efb1e6534 => generated 247 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:33.115654 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6324f3c5-0d1e-49b9-b58f-0232d2db9958 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:33.123792 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 40/79] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:14:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 01:14:33.124901 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a238d726-7e3a-4516-b1ec-8123b8a40638 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:33.213636 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6324f3c5-0d1e-49b9-b58f-0232d2db9958 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:33.218522 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a238d726-7e3a-4516-b1ec-8123b8a40638 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:33.246549 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f279d9-7703-4738-bb70-a23c9a689a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:33.247359 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f279d9-7703-4738-bb70-a23c9a689a8f None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:33.247649 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f279d9-7703-4738-bb70-a23c9a689a8f None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:33.247927 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f279d9-7703-4738-bb70-a23c9a689a8f None admin] PATH_INFO: `/v3/roles/member` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:33.250750 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5bd26a-19d5-447b-b0d2-c42ca73b5439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:33.251575 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5bd26a-19d5-447b-b0d2-c42ca73b5439 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:33.251856 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5bd26a-19d5-447b-b0d2-c42ca73b5439 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:33.252129 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5bd26a-19d5-447b-b0d2-c42ca73b5439 None admin] PATH_INFO: `/v3/users/6cf69a2898a141f6bb15a9b7af982ed8` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:33.253296 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5bd26a-19d5-447b-b0d2-c42ca73b5439 None admin] RBAC: Authorizing `identity:get_user(user_id=6cf69a2898a141f6bb15a9b7af982ed8)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:33.254761 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5bd26a-19d5-447b-b0d2-c42ca73b5439 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:33.256514 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 41/80] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Mar 30 01:14:33 2022] GET /identity/v3/users/6cf69a2898a141f6bb15a9b7af982ed8 => generated 275 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:33.257276 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5bd26a-19d5-447b-b0d2-c42ca73b5439 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:33.258246 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f279d9-7703-4738-bb70-a23c9a689a8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:14:33.265260 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-d3f279d9-7703-4738-bb70-a23c9a689a8f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 30 01:14:33.266448 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 40/81] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Mar 30 01:14:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:14:33.267247 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f279d9-7703-4738-bb70-a23c9a689a8f None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:33.353102 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5bd26a-19d5-447b-b0d2-c42ca73b5439 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:33.365332 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f279d9-7703-4738-bb70-a23c9a689a8f None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:33.386220 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924c3f50-0060-464e-af80-ad49a42ef18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:33.386897 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c3f50-0060-464e-af80-ad49a42ef18f None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:33.387186 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c3f50-0060-464e-af80-ad49a42ef18f None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:33.387460 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c3f50-0060-464e-af80-ad49a42ef18f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:33.397780 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bac84b-0c08-485a-9a89-a88fa99a1d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:33.398430 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bac84b-0c08-485a-9a89-a88fa99a1d46 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:33.398749 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bac84b-0c08-485a-9a89-a88fa99a1d46 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:33.399013 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bac84b-0c08-485a-9a89-a88fa99a1d46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:33.452870 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924c3f50-0060-464e-af80-ad49a42ef18f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:33.454327 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924c3f50-0060-464e-af80-ad49a42ef18f None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:33.463404 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bac84b-0c08-485a-9a89-a88fa99a1d46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:33.464866 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bac84b-0c08-485a-9a89-a88fa99a1d46 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:33.546619 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 42/82] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Mar 30 01:14:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 30 01:14:33.547297 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924c3f50-0060-464e-af80-ad49a42ef18f None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:33.559129 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 41/83] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Mar 30 01:14:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 30 01:14:33.560291 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bac84b-0c08-485a-9a89-a88fa99a1d46 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:33.642024 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924c3f50-0060-464e-af80-ad49a42ef18f None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:33.653722 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bac84b-0c08-485a-9a89-a88fa99a1d46 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:33.677284 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b01a6e-1eb2-4492-8492-f493d73d3a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:33.678185 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b01a6e-1eb2-4492-8492-f493d73d3a57 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:33.678473 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b01a6e-1eb2-4492-8492-f493d73d3a57 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:33.678787 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b01a6e-1eb2-4492-8492-f493d73d3a57 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:33.679967 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b01a6e-1eb2-4492-8492-f493d73d3a57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:33.681469 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b01a6e-1eb2-4492-8492-f493d73d3a57 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:33.683138 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 43/84] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:14:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:33.683909 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b01a6e-1eb2-4492-8492-f493d73d3a57 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:33.691642 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644eb008-d8ef-43dc-ba89-7ea4d13a4114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:33.692289 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644eb008-d8ef-43dc-ba89-7ea4d13a4114 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:33.692620 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644eb008-d8ef-43dc-ba89-7ea4d13a4114 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:33.692965 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644eb008-d8ef-43dc-ba89-7ea4d13a4114 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:33.756970 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644eb008-d8ef-43dc-ba89-7ea4d13a4114 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:33.758430 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644eb008-d8ef-43dc-ba89-7ea4d13a4114 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:33.782327 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b01a6e-1eb2-4492-8492-f493d73d3a57 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:33.814947 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b379732-ed43-4b69-b4ba-3dd2fc58e0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:33.815544 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b379732-ed43-4b69-b4ba-3dd2fc58e0ef None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:33.815828 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b379732-ed43-4b69-b4ba-3dd2fc58e0ef None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:33.816105 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b379732-ed43-4b69-b4ba-3dd2fc58e0ef None admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:33.816842 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b379732-ed43-4b69-b4ba-3dd2fc58e0ef None admin] RBAC: Adding query filter params (name=member) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:14:33.817144 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b379732-ed43-4b69-b4ba-3dd2fc58e0ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:33.819063 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b379732-ed43-4b69-b4ba-3dd2fc58e0ef None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:33.826884 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 44/85] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Mar 30 01:14:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:33.827503 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b379732-ed43-4b69-b4ba-3dd2fc58e0ef None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:33.855768 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 42/86] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Mar 30 01:14:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 30 01:14:33.856027 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644eb008-d8ef-43dc-ba89-7ea4d13a4114 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:33.923356 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b379732-ed43-4b69-b4ba-3dd2fc58e0ef None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:33.950506 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644eb008-d8ef-43dc-ba89-7ea4d13a4114 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:33.955254 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66896cb-e68f-4a47-9df4-a0bde3f0e928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:33.956108 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66896cb-e68f-4a47-9df4-a0bde3f0e928 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:33.956393 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66896cb-e68f-4a47-9df4-a0bde3f0e928 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:33.956670 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66896cb-e68f-4a47-9df4-a0bde3f0e928 None admin] PATH_INFO: `/v3/projects/4a955500342c498384e96caede5f019f` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:33.957843 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66896cb-e68f-4a47-9df4-a0bde3f0e928 None admin] RBAC: Authorizing `identity:get_project(project_id=4a955500342c498384e96caede5f019f)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:33.960397 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66896cb-e68f-4a47-9df4-a0bde3f0e928 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:33.962357 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 45/87] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Mar 30 01:14:33 2022] GET /identity/v3/projects/4a955500342c498384e96caede5f019f => generated 298 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:33.962849 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66896cb-e68f-4a47-9df4-a0bde3f0e928 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:33.988916 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f00344f-0dd5-48d7-a660-f9d5e3940795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:33.990380 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00344f-0dd5-48d7-a660-f9d5e3940795 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:33.990671 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00344f-0dd5-48d7-a660-f9d5e3940795 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:33.990982 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00344f-0dd5-48d7-a660-f9d5e3940795 None admin] PATH_INFO: `/v3/projects/4a955500342c498384e96caede5f019f` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:33.992227 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f00344f-0dd5-48d7-a660-f9d5e3940795 None admin] RBAC: Authorizing `identity:get_project(project_id=4a955500342c498384e96caede5f019f)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:33.993746 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f00344f-0dd5-48d7-a660-f9d5e3940795 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:33.995475 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 43/88] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Mar 30 01:14:33 2022] GET /identity/v3/projects/4a955500342c498384e96caede5f019f => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:33.996280 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f00344f-0dd5-48d7-a660-f9d5e3940795 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:34.064534 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66896cb-e68f-4a47-9df4-a0bde3f0e928 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:34.092768 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f00344f-0dd5-48d7-a660-f9d5e3940795 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:34.097520 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908f9c33-df06-428a-bdc0-41017037bb8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:34.098190 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f9c33-df06-428a-bdc0-41017037bb8d None admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:34.098479 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f9c33-df06-428a-bdc0-41017037bb8d None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:34.099381 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f9c33-df06-428a-bdc0-41017037bb8d None admin] PATH_INFO: `/v3/users` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:34.100127 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908f9c33-df06-428a-bdc0-41017037bb8d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:34.101578 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908f9c33-df06-428a-bdc0-41017037bb8d None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:34.125738 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdd0eb2-502a-437e-bef9-885372be98c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:34.126124 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 46/89] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Mar 30 01:14:33 2022] POST /identity/v3/users => generated 289 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:14:34.126604 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd0eb2-502a-437e-bef9-885372be98c2 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:34.126916 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd0eb2-502a-437e-bef9-885372be98c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:34.127025 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908f9c33-df06-428a-bdc0-41017037bb8d None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:34.127281 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd0eb2-502a-437e-bef9-885372be98c2 None admin] PATH_INFO: `/v3/users/6cf69a2898a141f6bb15a9b7af982ed8` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:34.128467 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdd0eb2-502a-437e-bef9-885372be98c2 None admin] RBAC: Authorizing `identity:get_user(user_id=6cf69a2898a141f6bb15a9b7af982ed8)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:34.130461 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdd0eb2-502a-437e-bef9-885372be98c2 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:34.136858 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 44/90] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Mar 30 01:14:33 2022] GET /identity/v3/users/6cf69a2898a141f6bb15a9b7af982ed8 => generated 275 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:34.136858 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdd0eb2-502a-437e-bef9-885372be98c2 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:34.234143 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908f9c33-df06-428a-bdc0-41017037bb8d None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:34.253354 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdd0eb2-502a-437e-bef9-885372be98c2 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:34.273290 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cd4db7-cb43-4b92-aa29-441825146a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:34.274183 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd4db7-cb43-4b92-aa29-441825146a37 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:34.274528 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd4db7-cb43-4b92-aa29-441825146a37 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:34.274847 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd4db7-cb43-4b92-aa29-441825146a37 None admin] PATH_INFO: `/v3/projects/4a955500342c498384e96caede5f019f` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:34.276173 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cd4db7-cb43-4b92-aa29-441825146a37 None admin] RBAC: Authorizing `identity:get_project(project_id=4a955500342c498384e96caede5f019f)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:34.277687 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cd4db7-cb43-4b92-aa29-441825146a37 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:34.279673 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 47/91] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Mar 30 01:14:34 2022] GET /identity/v3/projects/4a955500342c498384e96caede5f019f => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:34.285472 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cd4db7-cb43-4b92-aa29-441825146a37 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:34.292419 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4938c09-7296-42aa-8c89-1b9624195dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:34.293097 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4938c09-7296-42aa-8c89-1b9624195dad None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:34.293382 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4938c09-7296-42aa-8c89-1b9624195dad None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:34.293661 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4938c09-7296-42aa-8c89-1b9624195dad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:34.294566 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4938c09-7296-42aa-8c89-1b9624195dad None admin] RBAC: Adding query filter params (role.id=7ab1dc76ea3e450689be4c2ab56097f4, scope.project.id=4a955500342c498384e96caede5f019f, user.id=6cf69a2898a141f6bb15a9b7af982ed8) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:14:34.294943 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4938c09-7296-42aa-8c89-1b9624195dad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:34.296402 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4938c09-7296-42aa-8c89-1b9624195dad None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:34.302366 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 45/92] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Mar 30 01:14:34 2022] GET /identity/v3/role_assignments?user.id=6cf69a2898a141f6bb15a9b7af982ed8&scope.project.id=4a955500342c498384e96caede5f019f&role.id=7ab1dc76ea3e450689be4c2ab56097f4 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:34.303053 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4938c09-7296-42aa-8c89-1b9624195dad None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:34.416610 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cd4db7-cb43-4b92-aa29-441825146a37 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:34.423045 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4938c09-7296-42aa-8c89-1b9624195dad None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:34.467810 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80782605-c8b1-4b82-8323-748999b4d043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:34.468741 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80782605-c8b1-4b82-8323-748999b4d043 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:34.469030 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80782605-c8b1-4b82-8323-748999b4d043 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:34.469312 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80782605-c8b1-4b82-8323-748999b4d043 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:34.470159 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80782605-c8b1-4b82-8323-748999b4d043 None admin] RBAC: Adding query filter params (role.id=36909bbf31d04993bb2a9fe587b572dc, scope.project.id=4a955500342c498384e96caede5f019f, user.id=e9a5ef9b377048458730d23efb1e6534) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:14:34.470476 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80782605-c8b1-4b82-8323-748999b4d043 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:34.472014 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80782605-c8b1-4b82-8323-748999b4d043 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:34.472932 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b28d075-971b-4fb1-800d-fc44453ab389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:34.473620 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28d075-971b-4fb1-800d-fc44453ab389 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:34.474462 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28d075-971b-4fb1-800d-fc44453ab389 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:34.474776 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28d075-971b-4fb1-800d-fc44453ab389 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:34.479155 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 48/93] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Mar 30 01:14:34 2022] GET /identity/v3/role_assignments?user.id=e9a5ef9b377048458730d23efb1e6534&scope.project.id=4a955500342c498384e96caede5f019f&role.id=36909bbf31d04993bb2a9fe587b572dc => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:34.480032 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80782605-c8b1-4b82-8323-748999b4d043 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:34.561735 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b28d075-971b-4fb1-800d-fc44453ab389 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:34.563310 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b28d075-971b-4fb1-800d-fc44453ab389 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:34.620148 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80782605-c8b1-4b82-8323-748999b4d043 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:34.660572 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0cc67d-6519-4923-84cd-64282bec2c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:34.661770 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0cc67d-6519-4923-84cd-64282bec2c1b None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:34.662061 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0cc67d-6519-4923-84cd-64282bec2c1b None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:34.662340 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0cc67d-6519-4923-84cd-64282bec2c1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:34.663268 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0cc67d-6519-4923-84cd-64282bec2c1b None admin] RBAC: Adding query filter params (role.id=7185d0cfbcd44502b1613bcfe1b42f6f, scope.project.id=4a955500342c498384e96caede5f019f, user.id=6cf69a2898a141f6bb15a9b7af982ed8) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:14:34.663586 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0cc67d-6519-4923-84cd-64282bec2c1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:34.665063 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0cc67d-6519-4923-84cd-64282bec2c1b None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:34.670374 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 46/94] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Mar 30 01:14:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 30 01:14:34.671011 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 49/95] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Mar 30 01:14:34 2022] GET /identity/v3/role_assignments?user.id=6cf69a2898a141f6bb15a9b7af982ed8&scope.project.id=4a955500342c498384e96caede5f019f&role.id=7185d0cfbcd44502b1613bcfe1b42f6f => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:34.675740 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b28d075-971b-4fb1-800d-fc44453ab389 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:34.787814 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b28d075-971b-4fb1-800d-fc44453ab389 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:34.825810 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e449a690-0b37-4471-88a3-9be7efcf665f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:34.826685 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e449a690-0b37-4471-88a3-9be7efcf665f None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:34.826999 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e449a690-0b37-4471-88a3-9be7efcf665f None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:34.827279 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e449a690-0b37-4471-88a3-9be7efcf665f None admin] PATH_INFO: `/v3/projects/621b2aef8d0d4237a71ec556d4371144` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:34.828591 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e449a690-0b37-4471-88a3-9be7efcf665f None admin] RBAC: Authorizing `identity:get_project(project_id=621b2aef8d0d4237a71ec556d4371144)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:34.830102 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e449a690-0b37-4471-88a3-9be7efcf665f None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:34.831989 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 47/96] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Mar 30 01:14:34 2022] GET /identity/v3/projects/621b2aef8d0d4237a71ec556d4371144 => generated 312 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:14:34.838228 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0cc67d-6519-4923-84cd-64282bec2c1b None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:34.961024 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0cc67d-6519-4923-84cd-64282bec2c1b None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:35.003939 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977c35ee-8216-47b0-9c9f-9fea8c698704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:35.004602 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c35ee-8216-47b0-9c9f-9fea8c698704 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:35.004913 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c35ee-8216-47b0-9c9f-9fea8c698704 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:35.005389 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c35ee-8216-47b0-9c9f-9fea8c698704 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:35.006262 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977c35ee-8216-47b0-9c9f-9fea8c698704 None admin] RBAC: Adding query filter params (role.id=7185d0cfbcd44502b1613bcfe1b42f6f, scope.project.id=621b2aef8d0d4237a71ec556d4371144, user.id=6cf69a2898a141f6bb15a9b7af982ed8) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:14:35.006571 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977c35ee-8216-47b0-9c9f-9fea8c698704 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:35.008041 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977c35ee-8216-47b0-9c9f-9fea8c698704 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:35.016648 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 50/97] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Mar 30 01:14:34 2022] GET /identity/v3/role_assignments?user.id=6cf69a2898a141f6bb15a9b7af982ed8&scope.project.id=621b2aef8d0d4237a71ec556d4371144&role.id=7185d0cfbcd44502b1613bcfe1b42f6f => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:37.442278 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab5664-852d-4edb-b7b3-f7fe018ac734 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:37.443448 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab5664-852d-4edb-b7b3-f7fe018ac734 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:37.443930 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab5664-852d-4edb-b7b3-f7fe018ac734 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:37.446104 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 48/98] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:14:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:14:37.451747 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf39ee-ad37-4dc9-973f-f57ca58e8e29 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:37.452603 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf39ee-ad37-4dc9-973f-f57ca58e8e29 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:37.453117 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf39ee-ad37-4dc9-973f-f57ca58e8e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:37.476508 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-06cf39ee-ad37-4dc9-973f-f57ca58e8e29 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:14:37.477997 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-06cf39ee-ad37-4dc9-973f-f57ca58e8e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:14:37.567678 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 51/99] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:14:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 01:14:37.598840 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ab5664-852d-4edb-b7b3-f7fe018ac734 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:37.747947 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ab5664-852d-4edb-b7b3-f7fe018ac734 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:37.795071 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05299a6f-3a4d-42d7-81d6-3ea4ffa87933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:37.795888 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05299a6f-3a4d-42d7-81d6-3ea4ffa87933 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:37.796172 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05299a6f-3a4d-42d7-81d6-3ea4ffa87933 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:37.796452 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05299a6f-3a4d-42d7-81d6-3ea4ffa87933 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:37.805887 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f0d9c-4312-4994-b623-f72a29e68471 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:37.806448 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f0d9c-4312-4994-b623-f72a29e68471 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:37.806958 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f0d9c-4312-4994-b623-f72a29e68471 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:37.809046 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 52/100] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:14:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 01:14:37.813492 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05299a6f-3a4d-42d7-81d6-3ea4ffa87933 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:14:37.814402 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587210a0-de49-40b6-aeb6-bc7561d6b220 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:37.814936 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587210a0-de49-40b6-aeb6-bc7561d6b220 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:37.815412 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587210a0-de49-40b6-aeb6-bc7561d6b220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:37.821799 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-05299a6f-3a4d-42d7-81d6-3ea4ffa87933 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 30 01:14:37.823349 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 49/101] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Mar 30 01:14:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:14:37.828400 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05299a6f-3a4d-42d7-81d6-3ea4ffa87933 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:37.846926 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-587210a0-de49-40b6-aeb6-bc7561d6b220 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:14:37.848325 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-587210a0-de49-40b6-aeb6-bc7561d6b220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:14:37.961331 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 53/102] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:14:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 01:14:37.963011 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4056688-8fe8-4270-9e2c-1113e7798a42 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:37.963447 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4056688-8fe8-4270-9e2c-1113e7798a42 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:37.963853 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4056688-8fe8-4270-9e2c-1113e7798a42 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:37.965638 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 54/103] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:14:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:14:37.980321 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad44a36-cd0b-4740-a4e6-7fffbbbd5f5c None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:37.980873 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad44a36-cd0b-4740-a4e6-7fffbbbd5f5c None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:37.981663 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad44a36-cd0b-4740-a4e6-7fffbbbd5f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:37.986074 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05299a6f-3a4d-42d7-81d6-3ea4ffa87933 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:38.004499 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-bad44a36-cd0b-4740-a4e6-7fffbbbd5f5c None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:14:38.005918 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-bad44a36-cd0b-4740-a4e6-7fffbbbd5f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:14:38.039593 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10442058-2c0d-4a99-b649-e5e51ed2145a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:38.040263 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10442058-2c0d-4a99-b649-e5e51ed2145a None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:38.040548 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10442058-2c0d-4a99-b649-e5e51ed2145a None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:38.040824 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10442058-2c0d-4a99-b649-e5e51ed2145a None admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:38.041585 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10442058-2c0d-4a99-b649-e5e51ed2145a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:14:38.041891 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10442058-2c0d-4a99-b649-e5e51ed2145a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:38.043302 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10442058-2c0d-4a99-b649-e5e51ed2145a None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:38.066819 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 50/104] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Mar 30 01:14:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:14:38.067838 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10442058-2c0d-4a99-b649-e5e51ed2145a None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:38.148827 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 55/105] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:14:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 30 01:14:38.149533 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad44a36-cd0b-4740-a4e6-7fffbbbd5f5c None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:38.200329 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10442058-2c0d-4a99-b649-e5e51ed2145a None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:38.234421 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9000689e-38f3-4b8c-a390-1d6826aef760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:38.235239 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9000689e-38f3-4b8c-a390-1d6826aef760 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:38.235520 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9000689e-38f3-4b8c-a390-1d6826aef760 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:38.235795 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9000689e-38f3-4b8c-a390-1d6826aef760 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:38.236960 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9000689e-38f3-4b8c-a390-1d6826aef760 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:38.238392 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9000689e-38f3-4b8c-a390-1d6826aef760 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:38.241039 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 51/106] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:14:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:38.241825 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9000689e-38f3-4b8c-a390-1d6826aef760 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:38.263545 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad44a36-cd0b-4740-a4e6-7fffbbbd5f5c None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:38.298486 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbcce4e-03fc-44fe-95ba-994f85869ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:38.299394 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbcce4e-03fc-44fe-95ba-994f85869ac9 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:38.299685 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbcce4e-03fc-44fe-95ba-994f85869ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:38.300005 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbcce4e-03fc-44fe-95ba-994f85869ac9 None admin] PATH_INFO: `/v3/users/6cf69a2898a141f6bb15a9b7af982ed8` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:38.301267 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbcce4e-03fc-44fe-95ba-994f85869ac9 None admin] RBAC: Authorizing `identity:get_user(user_id=6cf69a2898a141f6bb15a9b7af982ed8)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:38.303417 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbcce4e-03fc-44fe-95ba-994f85869ac9 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:38.305232 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 56/107] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Mar 30 01:14:38 2022] GET /identity/v3/users/6cf69a2898a141f6bb15a9b7af982ed8 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:38.306299 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a127326a-9981-498b-9e24-f031ca367499 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:38.306591 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a127326a-9981-498b-9e24-f031ca367499 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:38.306978 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a127326a-9981-498b-9e24-f031ca367499 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:38.308657 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 57/108] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:14:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:14:38.309411 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a127326a-9981-498b-9e24-f031ca367499 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:38.350532 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9000689e-38f3-4b8c-a390-1d6826aef760 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:38.383322 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c2beb1-0db5-4302-9013-ff39da8b4ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:38.384119 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c2beb1-0db5-4302-9013-ff39da8b4ba2 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:38.384399 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c2beb1-0db5-4302-9013-ff39da8b4ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:38.384696 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c2beb1-0db5-4302-9013-ff39da8b4ba2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:38.394480 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c2beb1-0db5-4302-9013-ff39da8b4ba2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:14:38.401905 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-a0c2beb1-0db5-4302-9013-ff39da8b4ba2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 30 01:14:38.408025 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 52/109] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Mar 30 01:14:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:14:38.408025 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c2beb1-0db5-4302-9013-ff39da8b4ba2 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:38.420118 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a127326a-9981-498b-9e24-f031ca367499 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:38.455012 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f8b7dd-2e74-481c-8103-7ddcd070f48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:38.455728 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f8b7dd-2e74-481c-8103-7ddcd070f48f None admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:38.456008 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f8b7dd-2e74-481c-8103-7ddcd070f48f None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:38.456274 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f8b7dd-2e74-481c-8103-7ddcd070f48f None admin] PATH_INFO: `/v3/projects` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:38.456979 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f8b7dd-2e74-481c-8103-7ddcd070f48f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:38.459595 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f8b7dd-2e74-481c-8103-7ddcd070f48f None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:38.493891 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 58/110] 10.222.0.30 () {60 vars in 1141 bytes} [Wed Mar 30 01:14:38 2022] POST /identity/v3/projects => generated 302 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:14:38.493891 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2d352-e3c5-46c1-8446-e32a712a101c None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:38.493891 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2d352-e3c5-46c1-8446-e32a712a101c None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:38.493891 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2d352-e3c5-46c1-8446-e32a712a101c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:38.508516 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c2beb1-0db5-4302-9013-ff39da8b4ba2 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:38.513980 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-24f2d352-e3c5-46c1-8446-e32a712a101c None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:14:38.515324 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-24f2d352-e3c5-46c1-8446-e32a712a101c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:14:38.545632 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a7eacf-8096-4959-9da4-65a621075b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:38.546521 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a7eacf-8096-4959-9da4-65a621075b17 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:38.546833 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a7eacf-8096-4959-9da4-65a621075b17 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:38.547112 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a7eacf-8096-4959-9da4-65a621075b17 None admin] PATH_INFO: `/v3/projects/4a955500342c498384e96caede5f019f` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:38.548374 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a7eacf-8096-4959-9da4-65a621075b17 None admin] RBAC: Authorizing `identity:get_project(project_id=4a955500342c498384e96caede5f019f)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:38.549870 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a7eacf-8096-4959-9da4-65a621075b17 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:38.556941 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 53/111] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Mar 30 01:14:38 2022] GET /identity/v3/projects/4a955500342c498384e96caede5f019f => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:38.558447 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e004711e-120c-4bca-8144-3f502b55fccc None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:38.558759 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e004711e-120c-4bca-8144-3f502b55fccc None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:38.559041 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e004711e-120c-4bca-8144-3f502b55fccc None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:38.561025 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 54/112] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:14:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:14:38.561598 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e004711e-120c-4bca-8144-3f502b55fccc None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:38.595380 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 59/113] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:14:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 01:14:38.596108 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f2d352-e3c5-46c1-8446-e32a712a101c None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:38.669876 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e004711e-120c-4bca-8144-3f502b55fccc None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:38.707483 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f2d352-e3c5-46c1-8446-e32a712a101c None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:38.707721 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa04803-6c94-44bf-ad7a-54da7ccae7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:38.708752 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa04803-6c94-44bf-ad7a-54da7ccae7c5 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:38.709038 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa04803-6c94-44bf-ad7a-54da7ccae7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:38.709312 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa04803-6c94-44bf-ad7a-54da7ccae7c5 None admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:38.710073 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa04803-6c94-44bf-ad7a-54da7ccae7c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:14:38.710377 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa04803-6c94-44bf-ad7a-54da7ccae7c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:38.711816 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa04803-6c94-44bf-ad7a-54da7ccae7c5 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:38.722475 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 55/114] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Mar 30 01:14:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:38.727905 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f342572-03dc-435a-bb5d-24cd95d4db07 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:38.727905 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f342572-03dc-435a-bb5d-24cd95d4db07 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:38.727905 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f342572-03dc-435a-bb5d-24cd95d4db07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:38.743885 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-1f342572-03dc-435a-bb5d-24cd95d4db07 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:14:38.745091 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-1f342572-03dc-435a-bb5d-24cd95d4db07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:14:38.751654 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83edfee5-05dc-4c10-9156-0ff37513c6f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:38.752606 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83edfee5-05dc-4c10-9156-0ff37513c6f6 None admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:38.752977 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83edfee5-05dc-4c10-9156-0ff37513c6f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:38.753189 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83edfee5-05dc-4c10-9156-0ff37513c6f6 None admin] PATH_INFO: `/v3/projects/4a955500342c498384e96caede5f019f/users/6cf69a2898a141f6bb15a9b7af982ed8/roles/7ab1dc76ea3e450689be4c2ab56097f4` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:38.755740 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83edfee5-05dc-4c10-9156-0ff37513c6f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=4a955500342c498384e96caede5f019f, user_id=6cf69a2898a141f6bb15a9b7af982ed8, role_id=7ab1dc76ea3e450689be4c2ab56097f4)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:38.757212 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83edfee5-05dc-4c10-9156-0ff37513c6f6 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:38.773404 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 60/115] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Mar 30 01:14:38 2022] PUT /identity/v3/projects/4a955500342c498384e96caede5f019f/users/6cf69a2898a141f6bb15a9b7af982ed8/roles/7ab1dc76ea3e450689be4c2ab56097f4 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:14:38.774259 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83edfee5-05dc-4c10-9156-0ff37513c6f6 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:38.842733 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 56/116] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:14:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 01:14:38.842733 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb48b0e-a1b3-4edd-a28e-408d0f98aaab None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:38.842733 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb48b0e-a1b3-4edd-a28e-408d0f98aaab None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:38.842733 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb48b0e-a1b3-4edd-a28e-408d0f98aaab None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:38.843774 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 57/117] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:14:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:14:38.845072 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb48b0e-a1b3-4edd-a28e-408d0f98aaab None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:38.918755 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83edfee5-05dc-4c10-9156-0ff37513c6f6 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:38.965486 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747974f6-ad63-430a-9837-835a73df9f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:38.966295 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747974f6-ad63-430a-9837-835a73df9f82 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:38.966577 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747974f6-ad63-430a-9837-835a73df9f82 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:38.967735 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747974f6-ad63-430a-9837-835a73df9f82 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:38.982357 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb48b0e-a1b3-4edd-a28e-408d0f98aaab None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:38.984190 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747974f6-ad63-430a-9837-835a73df9f82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:14:38.992970 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-747974f6-ad63-430a-9837-835a73df9f82 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 30 01:14:38.994241 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 61/118] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Mar 30 01:14:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:14:38.995511 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847211a9-6454-433f-ba40-4eb1464770ef None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:38.995801 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847211a9-6454-433f-ba40-4eb1464770ef None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:38.997241 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847211a9-6454-433f-ba40-4eb1464770ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:39.014682 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-847211a9-6454-433f-ba40-4eb1464770ef None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:14:39.015913 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-847211a9-6454-433f-ba40-4eb1464770ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:14:39.028974 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cad5b0-2517-4a56-b825-5b172201d6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:39.030596 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cad5b0-2517-4a56-b825-5b172201d6aa None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:39.031241 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cad5b0-2517-4a56-b825-5b172201d6aa None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:39.031859 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cad5b0-2517-4a56-b825-5b172201d6aa None admin] PATH_INFO: `/v3/users/e9a5ef9b377048458730d23efb1e6534` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:39.033886 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cad5b0-2517-4a56-b825-5b172201d6aa None admin] RBAC: Authorizing `identity:get_user(user_id=e9a5ef9b377048458730d23efb1e6534)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:39.035723 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cad5b0-2517-4a56-b825-5b172201d6aa None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:39.038647 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 58/119] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Mar 30 01:14:38 2022] GET /identity/v3/users/e9a5ef9b377048458730d23efb1e6534 => generated 247 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:39.039602 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cad5b0-2517-4a56-b825-5b172201d6aa None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:39.090751 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 62/120] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:14:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 01:14:39.091837 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847211a9-6454-433f-ba40-4eb1464770ef None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:39.168308 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cad5b0-2517-4a56-b825-5b172201d6aa None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:39.197620 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847211a9-6454-433f-ba40-4eb1464770ef None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:39.214950 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd696a4b-f671-4c2a-a83c-9dc813a6861d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:39.215746 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd696a4b-f671-4c2a-a83c-9dc813a6861d None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:39.216032 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd696a4b-f671-4c2a-a83c-9dc813a6861d None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:39.216312 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd696a4b-f671-4c2a-a83c-9dc813a6861d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:39.232579 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd696a4b-f671-4c2a-a83c-9dc813a6861d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:14:39.236213 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4219e944-e59c-41f1-95b2-8a3337713469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:39.236882 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219e944-e59c-41f1-95b2-8a3337713469 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:39.237170 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219e944-e59c-41f1-95b2-8a3337713469 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:39.237451 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219e944-e59c-41f1-95b2-8a3337713469 None admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:39.238204 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4219e944-e59c-41f1-95b2-8a3337713469 None admin] RBAC: Adding query filter params (name=member) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:14:39.238510 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4219e944-e59c-41f1-95b2-8a3337713469 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:39.240558 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4219e944-e59c-41f1-95b2-8a3337713469 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:39.242901 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-cd696a4b-f671-4c2a-a83c-9dc813a6861d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 30 01:14:39.249613 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 59/121] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Mar 30 01:14:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:14:39.249613 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd696a4b-f671-4c2a-a83c-9dc813a6861d None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:39.254359 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 63/122] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Mar 30 01:14:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:39.256321 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4219e944-e59c-41f1-95b2-8a3337713469 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:39.355287 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd696a4b-f671-4c2a-a83c-9dc813a6861d None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:39.388570 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4219e944-e59c-41f1-95b2-8a3337713469 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:39.389635 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0885936f-bf9c-471d-86de-b89b2f9e9cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:39.390490 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0885936f-bf9c-471d-86de-b89b2f9e9cc1 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:39.390854 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0885936f-bf9c-471d-86de-b89b2f9e9cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:39.391087 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0885936f-bf9c-471d-86de-b89b2f9e9cc1 None admin] PATH_INFO: `/v3/projects/4a955500342c498384e96caede5f019f` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:39.392739 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0885936f-bf9c-471d-86de-b89b2f9e9cc1 None admin] RBAC: Authorizing `identity:get_project(project_id=4a955500342c498384e96caede5f019f)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:39.393731 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0885936f-bf9c-471d-86de-b89b2f9e9cc1 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:39.396459 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 60/123] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Mar 30 01:14:39 2022] GET /identity/v3/projects/4a955500342c498384e96caede5f019f => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:39.397328 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0885936f-bf9c-471d-86de-b89b2f9e9cc1 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:39.430733 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e56de4f-4d96-488d-a097-04d9c78490f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:39.431569 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e56de4f-4d96-488d-a097-04d9c78490f2 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:39.431855 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e56de4f-4d96-488d-a097-04d9c78490f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:39.432188 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e56de4f-4d96-488d-a097-04d9c78490f2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:39.444663 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e56de4f-4d96-488d-a097-04d9c78490f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:14:39.452029 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-5e56de4f-4d96-488d-a097-04d9c78490f2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 30 01:14:39.453421 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 64/124] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Mar 30 01:14:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:14:39.454192 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e56de4f-4d96-488d-a097-04d9c78490f2 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:39.518049 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0885936f-bf9c-471d-86de-b89b2f9e9cc1 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:39.555303 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fafe416-6bb0-45bd-9d2b-0bf0762885dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:39.556052 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fafe416-6bb0-45bd-9d2b-0bf0762885dc None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:39.556361 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fafe416-6bb0-45bd-9d2b-0bf0762885dc None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:39.556602 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fafe416-6bb0-45bd-9d2b-0bf0762885dc None admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:39.557357 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fafe416-6bb0-45bd-9d2b-0bf0762885dc None admin] RBAC: Adding query filter params (name=reader) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:14:39.557666 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fafe416-6bb0-45bd-9d2b-0bf0762885dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:39.559126 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fafe416-6bb0-45bd-9d2b-0bf0762885dc None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:39.573345 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 61/125] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Mar 30 01:14:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:39.573345 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fafe416-6bb0-45bd-9d2b-0bf0762885dc None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:39.573611 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e56de4f-4d96-488d-a097-04d9c78490f2 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:39.608268 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7067c6f-a7fe-4353-b244-ef0ba74625e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:39.609368 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7067c6f-a7fe-4353-b244-ef0ba74625e0 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:39.609818 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7067c6f-a7fe-4353-b244-ef0ba74625e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:39.610249 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7067c6f-a7fe-4353-b244-ef0ba74625e0 None admin] PATH_INFO: `/v3/users/6cf69a2898a141f6bb15a9b7af982ed8` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:39.611686 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7067c6f-a7fe-4353-b244-ef0ba74625e0 None admin] RBAC: Authorizing `identity:get_user(user_id=6cf69a2898a141f6bb15a9b7af982ed8)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:39.613368 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7067c6f-a7fe-4353-b244-ef0ba74625e0 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:39.626678 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 65/126] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Mar 30 01:14:39 2022] GET /identity/v3/users/6cf69a2898a141f6bb15a9b7af982ed8 => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:39.626678 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7067c6f-a7fe-4353-b244-ef0ba74625e0 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:39.681391 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fafe416-6bb0-45bd-9d2b-0bf0762885dc None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:39.717250 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0210789b-982d-4672-8295-56f1ccd169df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:39.718144 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210789b-982d-4672-8295-56f1ccd169df None admin] REQUEST_METHOD: `PUT` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:39.718431 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210789b-982d-4672-8295-56f1ccd169df None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:39.718725 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210789b-982d-4672-8295-56f1ccd169df None admin] PATH_INFO: `/v3/projects/4a955500342c498384e96caede5f019f/users/e9a5ef9b377048458730d23efb1e6534/roles/36909bbf31d04993bb2a9fe587b572dc` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:39.720743 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0210789b-982d-4672-8295-56f1ccd169df None admin] RBAC: Authorizing `identity:create_grant(project_id=4a955500342c498384e96caede5f019f, user_id=e9a5ef9b377048458730d23efb1e6534, role_id=36909bbf31d04993bb2a9fe587b572dc)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:39.722195 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0210789b-982d-4672-8295-56f1ccd169df None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:39.740268 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7067c6f-a7fe-4353-b244-ef0ba74625e0 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:39.743758 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 62/127] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Mar 30 01:14:39 2022] PUT /identity/v3/projects/4a955500342c498384e96caede5f019f/users/e9a5ef9b377048458730d23efb1e6534/roles/36909bbf31d04993bb2a9fe587b572dc => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:14:39.744629 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0210789b-982d-4672-8295-56f1ccd169df None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:39.779414 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93339083-4f7e-4c44-91b2-db1387c9087e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:39.780761 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93339083-4f7e-4c44-91b2-db1387c9087e None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:39.781279 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93339083-4f7e-4c44-91b2-db1387c9087e None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:39.781809 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93339083-4f7e-4c44-91b2-db1387c9087e None admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:39.782862 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93339083-4f7e-4c44-91b2-db1387c9087e None admin] RBAC: Adding query filter params (name=member) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:14:39.783373 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93339083-4f7e-4c44-91b2-db1387c9087e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:39.785041 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93339083-4f7e-4c44-91b2-db1387c9087e None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:39.796274 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 66/128] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Mar 30 01:14:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:39.797491 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93339083-4f7e-4c44-91b2-db1387c9087e None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:39.884749 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0210789b-982d-4672-8295-56f1ccd169df None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:39.921525 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb82b6b-e099-476b-be5a-19b3f36eb760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:39.922874 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb82b6b-e099-476b-be5a-19b3f36eb760 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:39.923003 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93339083-4f7e-4c44-91b2-db1387c9087e None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:39.923607 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb82b6b-e099-476b-be5a-19b3f36eb760 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:39.924082 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb82b6b-e099-476b-be5a-19b3f36eb760 None admin] PATH_INFO: `/v3/users/48175e4bea784051b0ca867c0b1c30bf` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:39.940960 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb82b6b-e099-476b-be5a-19b3f36eb760 None admin] RBAC: Authorizing `identity:get_user(user_id=48175e4bea784051b0ca867c0b1c30bf)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:39.943377 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb82b6b-e099-476b-be5a-19b3f36eb760 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:39.945815 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 63/129] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Mar 30 01:14:39 2022] GET /identity/v3/users/48175e4bea784051b0ca867c0b1c30bf => generated 289 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:39.951839 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb82b6b-e099-476b-be5a-19b3f36eb760 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:39.974997 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36713546-47ce-400a-8820-9fa046fc6a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:39.976334 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36713546-47ce-400a-8820-9fa046fc6a02 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:39.977183 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36713546-47ce-400a-8820-9fa046fc6a02 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:39.978448 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36713546-47ce-400a-8820-9fa046fc6a02 None admin] PATH_INFO: `/v3/projects/621b2aef8d0d4237a71ec556d4371144` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:39.981282 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36713546-47ce-400a-8820-9fa046fc6a02 None admin] RBAC: Authorizing `identity:get_project(project_id=621b2aef8d0d4237a71ec556d4371144)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:39.984642 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36713546-47ce-400a-8820-9fa046fc6a02 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:39.989632 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 67/130] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Mar 30 01:14:39 2022] GET /identity/v3/projects/621b2aef8d0d4237a71ec556d4371144 => generated 312 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:39.991654 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36713546-47ce-400a-8820-9fa046fc6a02 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:40.106514 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36713546-47ce-400a-8820-9fa046fc6a02 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:40.117499 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb82b6b-e099-476b-be5a-19b3f36eb760 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:40.141677 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee4ec6e-f8c8-4192-9036-4c4f71741cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:40.142268 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee4ec6e-f8c8-4192-9036-4c4f71741cb9 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:40.144521 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee4ec6e-f8c8-4192-9036-4c4f71741cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:40.144521 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee4ec6e-f8c8-4192-9036-4c4f71741cb9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:40.155776 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad85e3-126c-495f-a605-6bf3d8c1eedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:40.156933 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad85e3-126c-495f-a605-6bf3d8c1eedd None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:40.157417 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad85e3-126c-495f-a605-6bf3d8c1eedd None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:40.157914 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad85e3-126c-495f-a605-6bf3d8c1eedd None admin] PATH_INFO: `/v3/users/6cf69a2898a141f6bb15a9b7af982ed8` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:40.159363 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ad85e3-126c-495f-a605-6bf3d8c1eedd None admin] RBAC: Authorizing `identity:get_user(user_id=6cf69a2898a141f6bb15a9b7af982ed8)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:40.161517 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ad85e3-126c-495f-a605-6bf3d8c1eedd None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:40.163865 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 64/131] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Mar 30 01:14:39 2022] GET /identity/v3/users/6cf69a2898a141f6bb15a9b7af982ed8 => generated 275 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:40.164827 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad85e3-126c-495f-a605-6bf3d8c1eedd None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:40.215744 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee4ec6e-f8c8-4192-9036-4c4f71741cb9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:40.217234 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee4ec6e-f8c8-4192-9036-4c4f71741cb9 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:40.265464 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad85e3-126c-495f-a605-6bf3d8c1eedd None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:40.300918 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4926bf-cf37-42d7-b565-68480ac20044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:40.302865 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4926bf-cf37-42d7-b565-68480ac20044 None admin] REQUEST_METHOD: `PUT` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:40.303396 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4926bf-cf37-42d7-b565-68480ac20044 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:40.303871 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4926bf-cf37-42d7-b565-68480ac20044 None admin] PATH_INFO: `/v3/projects/621b2aef8d0d4237a71ec556d4371144/users/6cf69a2898a141f6bb15a9b7af982ed8/roles/7185d0cfbcd44502b1613bcfe1b42f6f` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:40.306232 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4926bf-cf37-42d7-b565-68480ac20044 None admin] RBAC: Authorizing `identity:create_grant(project_id=621b2aef8d0d4237a71ec556d4371144, user_id=6cf69a2898a141f6bb15a9b7af982ed8, role_id=7185d0cfbcd44502b1613bcfe1b42f6f)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:40.307935 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4926bf-cf37-42d7-b565-68480ac20044 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:40.321183 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 68/132] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Mar 30 01:14:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 30 01:14:40.321858 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee4ec6e-f8c8-4192-9036-4c4f71741cb9 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:40.329513 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 65/133] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Mar 30 01:14:40 2022] PUT /identity/v3/projects/621b2aef8d0d4237a71ec556d4371144/users/6cf69a2898a141f6bb15a9b7af982ed8/roles/7185d0cfbcd44502b1613bcfe1b42f6f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:14:40.332558 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4926bf-cf37-42d7-b565-68480ac20044 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:40.531295 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee4ec6e-f8c8-4192-9036-4c4f71741cb9 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:40.553865 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4926bf-cf37-42d7-b565-68480ac20044 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:40.596325 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800a5897-3f3e-4d03-ba58-6484b3821b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:40.597201 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a5897-3f3e-4d03-ba58-6484b3821b82 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:40.597488 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a5897-3f3e-4d03-ba58-6484b3821b82 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:40.597957 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a5897-3f3e-4d03-ba58-6484b3821b82 None admin] PATH_INFO: `/v3/projects/4a955500342c498384e96caede5f019f` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:40.599504 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800a5897-3f3e-4d03-ba58-6484b3821b82 None admin] RBAC: Authorizing `identity:get_project(project_id=4a955500342c498384e96caede5f019f)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:40.601175 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800a5897-3f3e-4d03-ba58-6484b3821b82 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:40.603597 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 69/134] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Mar 30 01:14:40 2022] GET /identity/v3/projects/4a955500342c498384e96caede5f019f => generated 298 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:40.609138 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800a5897-3f3e-4d03-ba58-6484b3821b82 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:40.633055 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f8cbb-bbd6-4596-8295-f4c82c05280b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:40.634293 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f8cbb-bbd6-4596-8295-f4c82c05280b None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:40.634809 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f8cbb-bbd6-4596-8295-f4c82c05280b None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:40.635301 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f8cbb-bbd6-4596-8295-f4c82c05280b None admin] PATH_INFO: `/v3/projects/4a955500342c498384e96caede5f019f` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:40.639447 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883f8cbb-bbd6-4596-8295-f4c82c05280b None admin] RBAC: Authorizing `identity:get_project(project_id=4a955500342c498384e96caede5f019f)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:40.641172 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883f8cbb-bbd6-4596-8295-f4c82c05280b None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:40.643166 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 66/135] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Mar 30 01:14:40 2022] GET /identity/v3/projects/4a955500342c498384e96caede5f019f => generated 298 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:40.655461 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f8cbb-bbd6-4596-8295-f4c82c05280b None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:40.764458 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800a5897-3f3e-4d03-ba58-6484b3821b82 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:40.798386 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a4b2f4-9185-4eb0-91c4-91f0dc30cbbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:40.799920 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a4b2f4-9185-4eb0-91c4-91f0dc30cbbd None admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:40.799920 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a4b2f4-9185-4eb0-91c4-91f0dc30cbbd None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:40.799920 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a4b2f4-9185-4eb0-91c4-91f0dc30cbbd None admin] PATH_INFO: `/v3/projects/4a955500342c498384e96caede5f019f/users/6cf69a2898a141f6bb15a9b7af982ed8/roles/7185d0cfbcd44502b1613bcfe1b42f6f` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:40.807622 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a4b2f4-9185-4eb0-91c4-91f0dc30cbbd None admin] RBAC: Authorizing `identity:create_grant(project_id=4a955500342c498384e96caede5f019f, user_id=6cf69a2898a141f6bb15a9b7af982ed8, role_id=7185d0cfbcd44502b1613bcfe1b42f6f)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:40.809091 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a4b2f4-9185-4eb0-91c4-91f0dc30cbbd None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:40.827872 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 70/136] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Mar 30 01:14:40 2022] PUT /identity/v3/projects/4a955500342c498384e96caede5f019f/users/6cf69a2898a141f6bb15a9b7af982ed8/roles/7185d0cfbcd44502b1613bcfe1b42f6f => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:14:40.844970 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f8cbb-bbd6-4596-8295-f4c82c05280b None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:40.896847 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec93c4-1a4b-4dd8-b965-9d5f1f8b960e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:40.897523 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec93c4-1a4b-4dd8-b965-9d5f1f8b960e None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:40.897809 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec93c4-1a4b-4dd8-b965-9d5f1f8b960e None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:40.898092 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec93c4-1a4b-4dd8-b965-9d5f1f8b960e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:40.898966 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcec93c4-1a4b-4dd8-b965-9d5f1f8b960e None admin] RBAC: Adding query filter params (role.id=1dffd8c286fa4de1b7a059d5c5da54f8, scope.project.id=4a955500342c498384e96caede5f019f, user.id=48175e4bea784051b0ca867c0b1c30bf) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:14:40.899279 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcec93c4-1a4b-4dd8-b965-9d5f1f8b960e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:40.900834 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcec93c4-1a4b-4dd8-b965-9d5f1f8b960e None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:40.911751 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 67/137] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Mar 30 01:14:40 2022] GET /identity/v3/role_assignments?user.id=48175e4bea784051b0ca867c0b1c30bf&scope.project.id=4a955500342c498384e96caede5f019f&role.id=1dffd8c286fa4de1b7a059d5c5da54f8 => generated 259 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:14:41.476304 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8a63d-fe4d-4039-ba5b-d8f15cbe9695 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:41.476987 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8a63d-fe4d-4039-ba5b-d8f15cbe9695 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:41.477480 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8a63d-fe4d-4039-ba5b-d8f15cbe9695 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:41.479528 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 71/138] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:14:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:14:41.484965 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e0f5b-ef9f-432c-a5cd-85cc957441e2 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:41.485468 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e0f5b-ef9f-432c-a5cd-85cc957441e2 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:41.485757 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e0f5b-ef9f-432c-a5cd-85cc957441e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:41.515091 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-f40e0f5b-ef9f-432c-a5cd-85cc957441e2 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:14:41.516289 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-f40e0f5b-ef9f-432c-a5cd-85cc957441e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:14:41.602483 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 68/139] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:14:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 01:14:41.646159 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e8a63d-fe4d-4039-ba5b-d8f15cbe9695 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:41.772253 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e8a63d-fe4d-4039-ba5b-d8f15cbe9695 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:41.815364 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f557d8e-e17e-4e6a-8ac9-d9bf5130a2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:41.816168 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f557d8e-e17e-4e6a-8ac9-d9bf5130a2bb None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:41.816464 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f557d8e-e17e-4e6a-8ac9-d9bf5130a2bb None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:41.816741 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f557d8e-e17e-4e6a-8ac9-d9bf5130a2bb None admin] PATH_INFO: `/v3/domains/default` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:41.818072 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f557d8e-e17e-4e6a-8ac9-d9bf5130a2bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:41.819559 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f557d8e-e17e-4e6a-8ac9-d9bf5130a2bb None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:41.821455 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 72/140] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:14:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:41.826734 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40e0f5b-ef9f-432c-a5cd-85cc957441e2 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:41.870978 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5647abf-76ca-45aa-b742-87d7d55cf502 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:41.871278 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5647abf-76ca-45aa-b742-87d7d55cf502 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:41.871548 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5647abf-76ca-45aa-b742-87d7d55cf502 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:41.873482 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 73/141] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:14:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 01:14:41.878137 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699946b6-f3f3-45e6-b9d0-672d90903a81 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:41.878425 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699946b6-f3f3-45e6-b9d0-672d90903a81 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:41.878730 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699946b6-f3f3-45e6-b9d0-672d90903a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:41.903223 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-699946b6-f3f3-45e6-b9d0-672d90903a81 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:14:41.904436 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-699946b6-f3f3-45e6-b9d0-672d90903a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:14:42.006857 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40e0f5b-ef9f-432c-a5cd-85cc957441e2 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:42.016874 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 74/142] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:14:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 30 01:14:42.047337 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fccb24-6d90-4270-888c-d8f98905688d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:42.048018 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fccb24-6d90-4270-888c-d8f98905688d None admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:42.048308 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fccb24-6d90-4270-888c-d8f98905688d None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:42.048589 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fccb24-6d90-4270-888c-d8f98905688d None admin] PATH_INFO: `/v3/users` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:42.049313 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fccb24-6d90-4270-888c-d8f98905688d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:42.050805 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fccb24-6d90-4270-888c-d8f98905688d None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:42.053427 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699946b6-f3f3-45e6-b9d0-672d90903a81 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:42.094440 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 69/143] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Mar 30 01:14:41 2022] POST /identity/v3/users => generated 283 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:14:42.205085 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699946b6-f3f3-45e6-b9d0-672d90903a81 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:42.252898 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96649d66-c3c7-4dbd-a678-f0cdf129701c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:42.253760 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96649d66-c3c7-4dbd-a678-f0cdf129701c None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:42.254062 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96649d66-c3c7-4dbd-a678-f0cdf129701c None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:42.254341 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96649d66-c3c7-4dbd-a678-f0cdf129701c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:42.268297 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96649d66-c3c7-4dbd-a678-f0cdf129701c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:14:42.276058 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-96649d66-c3c7-4dbd-a678-f0cdf129701c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 30 01:14:42.277592 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 75/144] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Mar 30 01:14:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 01:14:42.283577 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fccb24-6d90-4270-888c-d8f98905688d None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:42.436677 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fccb24-6d90-4270-888c-d8f98905688d None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:42.483598 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9553311d-8839-431a-8636-c38ff1dda8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:42.484297 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9553311d-8839-431a-8636-c38ff1dda8a8 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:42.484652 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9553311d-8839-431a-8636-c38ff1dda8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:42.484938 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9553311d-8839-431a-8636-c38ff1dda8a8 None admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:42.485713 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9553311d-8839-431a-8636-c38ff1dda8a8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:14:42.486157 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9553311d-8839-431a-8636-c38ff1dda8a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:42.487635 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9553311d-8839-431a-8636-c38ff1dda8a8 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:42.496891 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 70/145] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Mar 30 01:14:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:42.502437 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96649d66-c3c7-4dbd-a678-f0cdf129701c None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:42.622756 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96649d66-c3c7-4dbd-a678-f0cdf129701c None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:42.668356 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95b00d7-e964-4468-9710-84b256f2f0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:42.669296 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b00d7-e964-4468-9710-84b256f2f0d7 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:42.669591 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b00d7-e964-4468-9710-84b256f2f0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:42.669874 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b00d7-e964-4468-9710-84b256f2f0d7 None admin] PATH_INFO: `/v3/users/6cf69a2898a141f6bb15a9b7af982ed8` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:42.671122 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95b00d7-e964-4468-9710-84b256f2f0d7 None admin] RBAC: Authorizing `identity:get_user(user_id=6cf69a2898a141f6bb15a9b7af982ed8)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:42.672591 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95b00d7-e964-4468-9710-84b256f2f0d7 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:42.674563 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 76/146] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Mar 30 01:14:42 2022] GET /identity/v3/users/6cf69a2898a141f6bb15a9b7af982ed8 => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:42.680350 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9553311d-8839-431a-8636-c38ff1dda8a8 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:42.786313 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9553311d-8839-431a-8636-c38ff1dda8a8 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:42.824769 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e5c7d8-1601-4629-bb44-8e9447cbbae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:42.825428 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e5c7d8-1601-4629-bb44-8e9447cbbae0 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:42.825720 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e5c7d8-1601-4629-bb44-8e9447cbbae0 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:42.826000 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e5c7d8-1601-4629-bb44-8e9447cbbae0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:42.916803 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e5c7d8-1601-4629-bb44-8e9447cbbae0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:42.918694 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e5c7d8-1601-4629-bb44-8e9447cbbae0 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:43.033388 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 71/147] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Mar 30 01:14:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 30 01:14:43.038777 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95b00d7-e964-4468-9710-84b256f2f0d7 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:43.172014 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95b00d7-e964-4468-9710-84b256f2f0d7 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:43.215451 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd8c65-e2f1-4e5f-aee2-3b9479e70919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:43.216345 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd8c65-e2f1-4e5f-aee2-3b9479e70919 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:43.216638 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd8c65-e2f1-4e5f-aee2-3b9479e70919 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:43.216922 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd8c65-e2f1-4e5f-aee2-3b9479e70919 None admin] PATH_INFO: `/v3/projects/4a955500342c498384e96caede5f019f` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:43.218180 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbd8c65-e2f1-4e5f-aee2-3b9479e70919 None admin] RBAC: Authorizing `identity:get_project(project_id=4a955500342c498384e96caede5f019f)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:43.219684 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbd8c65-e2f1-4e5f-aee2-3b9479e70919 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:43.221626 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 77/148] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Mar 30 01:14:43 2022] GET /identity/v3/projects/4a955500342c498384e96caede5f019f => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:43.227835 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e5c7d8-1601-4629-bb44-8e9447cbbae0 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:43.375314 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e5c7d8-1601-4629-bb44-8e9447cbbae0 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:43.428843 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b28f33-5596-46a8-a94f-5e23a4643714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:43.429522 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b28f33-5596-46a8-a94f-5e23a4643714 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:43.429811 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b28f33-5596-46a8-a94f-5e23a4643714 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:43.430089 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b28f33-5596-46a8-a94f-5e23a4643714 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:43.430961 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b28f33-5596-46a8-a94f-5e23a4643714 None admin] RBAC: Adding query filter params (role.id=7ab1dc76ea3e450689be4c2ab56097f4, scope.project.id=4a955500342c498384e96caede5f019f, user.id=6cf69a2898a141f6bb15a9b7af982ed8) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:14:43.431279 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b28f33-5596-46a8-a94f-5e23a4643714 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:43.432735 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b28f33-5596-46a8-a94f-5e23a4643714 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:43.443603 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 72/149] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Mar 30 01:14:43 2022] GET /identity/v3/role_assignments?user.id=6cf69a2898a141f6bb15a9b7af982ed8&scope.project.id=4a955500342c498384e96caede5f019f&role.id=7ab1dc76ea3e450689be4c2ab56097f4 => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:43.803303 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a56867-4a97-4476-9f7c-dcbdec42f8a8 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:43.804025 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a56867-4a97-4476-9f7c-dcbdec42f8a8 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:43.804025 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a56867-4a97-4476-9f7c-dcbdec42f8a8 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:43.805658 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 78/150] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:14:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:14:43.813088 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e4b4b-62c8-4395-99ef-462869b6789e None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:43.813629 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e4b4b-62c8-4395-99ef-462869b6789e None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:43.813629 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e4b4b-62c8-4395-99ef-462869b6789e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:43.820793 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e76c8-9987-430c-b2a4-64b6442f3d2e None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:43.821088 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e76c8-9987-430c-b2a4-64b6442f3d2e None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:43.821388 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e76c8-9987-430c-b2a4-64b6442f3d2e None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:43.823357 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 79/151] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:14:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:14:43.834846 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-494e4b4b-62c8-4395-99ef-462869b6789e None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:14:43.836147 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-494e4b4b-62c8-4395-99ef-462869b6789e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:14:43.837214 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf11c2b-899e-488e-897f-541e56bebebf None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:43.837502 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf11c2b-899e-488e-897f-541e56bebebf None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:43.837782 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf11c2b-899e-488e-897f-541e56bebebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:43.863994 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-dcf11c2b-899e-488e-897f-541e56bebebf None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:14:43.866865 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-dcf11c2b-899e-488e-897f-541e56bebebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:14:43.928820 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 73/152] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:14:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 01:14:43.952038 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 80/153] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:14:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 30 01:14:43.971110 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494e4b4b-62c8-4395-99ef-462869b6789e None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:43.994657 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf11c2b-899e-488e-897f-541e56bebebf None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:44.115722 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494e4b4b-62c8-4395-99ef-462869b6789e None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:44.174513 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf11c2b-899e-488e-897f-541e56bebebf None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:44.190451 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d44c6-e4b4-40cc-9edf-9ed04f7e5c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:44.191282 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d44c6-e4b4-40cc-9edf-9ed04f7e5c21 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:44.191571 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d44c6-e4b4-40cc-9edf-9ed04f7e5c21 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:44.191856 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d44c6-e4b4-40cc-9edf-9ed04f7e5c21 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:44.216344 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3d44c6-e4b4-40cc-9edf-9ed04f7e5c21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:14:44.223764 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-3a3d44c6-e4b4-40cc-9edf-9ed04f7e5c21 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 30 01:14:44.231363 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 74/154] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Mar 30 01:14:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:14:44.232370 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d44c6-e4b4-40cc-9edf-9ed04f7e5c21 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:44.252749 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f55306-ad8f-433c-b27e-68bc1b156787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:44.253943 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f55306-ad8f-433c-b27e-68bc1b156787 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:44.254432 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f55306-ad8f-433c-b27e-68bc1b156787 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:44.255024 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f55306-ad8f-433c-b27e-68bc1b156787 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:44.273864 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f55306-ad8f-433c-b27e-68bc1b156787 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:14:44.281673 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-b7f55306-ad8f-433c-b27e-68bc1b156787 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 30 01:14:44.283163 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 81/155] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Mar 30 01:14:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 01:14:44.292748 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f55306-ad8f-433c-b27e-68bc1b156787 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:44.357454 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d44c6-e4b4-40cc-9edf-9ed04f7e5c21 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:44.399666 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8007a3d4-6b7a-4915-8ad2-040956fd0f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:44.400264 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007a3d4-6b7a-4915-8ad2-040956fd0f9f None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:44.400558 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007a3d4-6b7a-4915-8ad2-040956fd0f9f None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:44.400839 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007a3d4-6b7a-4915-8ad2-040956fd0f9f None admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:44.401611 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8007a3d4-6b7a-4915-8ad2-040956fd0f9f None admin] RBAC: Adding query filter params (name=admin) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:14:44.401924 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8007a3d4-6b7a-4915-8ad2-040956fd0f9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:44.403346 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8007a3d4-6b7a-4915-8ad2-040956fd0f9f None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:44.421921 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 75/156] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Mar 30 01:14:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:44.432258 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8007a3d4-6b7a-4915-8ad2-040956fd0f9f None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:44.467287 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f55306-ad8f-433c-b27e-68bc1b156787 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:44.510311 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9f4fcd-bfc8-4236-982a-347ced82275c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:44.511012 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f4fcd-bfc8-4236-982a-347ced82275c None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:44.511298 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f4fcd-bfc8-4236-982a-347ced82275c None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:44.511578 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f4fcd-bfc8-4236-982a-347ced82275c None admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:44.512342 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9f4fcd-bfc8-4236-982a-347ced82275c None admin] RBAC: Adding query filter params (name=member) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:14:44.512653 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9f4fcd-bfc8-4236-982a-347ced82275c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:44.514055 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9f4fcd-bfc8-4236-982a-347ced82275c None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:44.534181 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 82/157] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Mar 30 01:14:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:14:44.535535 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ba1280-8c2d-49d2-a3ec-08cc0155b8b3 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:44.535826 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ba1280-8c2d-49d2-a3ec-08cc0155b8b3 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:44.536678 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ba1280-8c2d-49d2-a3ec-08cc0155b8b3 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:44.538438 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 83/158] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:14:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:14:44.546803 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ba1280-8c2d-49d2-a3ec-08cc0155b8b3 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:44.639071 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8007a3d4-6b7a-4915-8ad2-040956fd0f9f None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:44.687555 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdc6819-18b4-4b33-aab9-a5f922250343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:44.688371 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc6819-18b4-4b33-aab9-a5f922250343 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:44.688656 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc6819-18b4-4b33-aab9-a5f922250343 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:44.688933 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc6819-18b4-4b33-aab9-a5f922250343 None admin] PATH_INFO: `/v3/users/e9a5ef9b377048458730d23efb1e6534` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:44.690208 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdc6819-18b4-4b33-aab9-a5f922250343 None admin] RBAC: Authorizing `identity:get_user(user_id=e9a5ef9b377048458730d23efb1e6534)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:44.695818 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdc6819-18b4-4b33-aab9-a5f922250343 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:44.697593 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 76/159] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Mar 30 01:14:44 2022] GET /identity/v3/users/e9a5ef9b377048458730d23efb1e6534 => generated 247 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:44.698850 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4263464-7396-4832-9daa-3c4da236cc02 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:44.699157 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4263464-7396-4832-9daa-3c4da236cc02 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:44.699437 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4263464-7396-4832-9daa-3c4da236cc02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:44.732115 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-e4263464-7396-4832-9daa-3c4da236cc02 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:14:44.733308 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-e4263464-7396-4832-9daa-3c4da236cc02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:14:44.741124 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ba1280-8c2d-49d2-a3ec-08cc0155b8b3 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:44.791911 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc54b8-8242-46bd-8fee-1fe08f3d4636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:44.792786 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc54b8-8242-46bd-8fee-1fe08f3d4636 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:44.793063 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc54b8-8242-46bd-8fee-1fe08f3d4636 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:44.793333 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc54b8-8242-46bd-8fee-1fe08f3d4636 None admin] PATH_INFO: `/v3/users/6cf69a2898a141f6bb15a9b7af982ed8` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:44.794575 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadc54b8-8242-46bd-8fee-1fe08f3d4636 None admin] RBAC: Authorizing `identity:get_user(user_id=6cf69a2898a141f6bb15a9b7af982ed8)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:44.796169 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadc54b8-8242-46bd-8fee-1fe08f3d4636 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:44.798134 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 84/160] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Mar 30 01:14:44 2022] GET /identity/v3/users/6cf69a2898a141f6bb15a9b7af982ed8 => generated 275 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:44.798932 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc54b8-8242-46bd-8fee-1fe08f3d4636 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:44.881941 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 77/161] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:14:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 01:14:44.888095 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e20f2-9c49-48bd-b1de-e132eda9808c None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:44.888385 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e20f2-9c49-48bd-b1de-e132eda9808c None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:44.888664 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e20f2-9c49-48bd-b1de-e132eda9808c None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:44.896975 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 78/162] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:14:44 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:14:44.897738 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e20f2-9c49-48bd-b1de-e132eda9808c None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:44.947271 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc54b8-8242-46bd-8fee-1fe08f3d4636 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:45.002619 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd4b79c-fdae-48c9-8929-1195a8b9c552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:45.003349 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4b79c-fdae-48c9-8929-1195a8b9c552 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:45.003786 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4b79c-fdae-48c9-8929-1195a8b9c552 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:45.004071 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4b79c-fdae-48c9-8929-1195a8b9c552 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:45.083321 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd4b79c-fdae-48c9-8929-1195a8b9c552 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:45.085168 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd4b79c-fdae-48c9-8929-1195a8b9c552 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:45.109642 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e20f2-9c49-48bd-b1de-e132eda9808c None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:45.188739 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 85/163] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Mar 30 01:14:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 30 01:14:45.190505 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14a235-f8b7-4e17-a618-69e0775cd256 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:45.191035 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14a235-f8b7-4e17-a618-69e0775cd256 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:45.191509 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14a235-f8b7-4e17-a618-69e0775cd256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:45.203522 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a9613-22d1-4017-8794-37413082ec5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:45.204481 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a9613-22d1-4017-8794-37413082ec5c None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:45.204962 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a9613-22d1-4017-8794-37413082ec5c None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:45.205432 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a9613-22d1-4017-8794-37413082ec5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:45.221113 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-6e14a235-f8b7-4e17-a618-69e0775cd256 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:14:45.222585 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-6e14a235-f8b7-4e17-a618-69e0775cd256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:14:45.339741 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3a9613-22d1-4017-8794-37413082ec5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:45.341280 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3a9613-22d1-4017-8794-37413082ec5c None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:45.353537 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 86/164] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:14:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 01:14:45.354751 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e14a235-f8b7-4e17-a618-69e0775cd256 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:45.501022 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 79/165] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Mar 30 01:14:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 603 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 30 01:14:45.501814 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a9613-22d1-4017-8794-37413082ec5c None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:45.524296 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e14a235-f8b7-4e17-a618-69e0775cd256 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:45.564038 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f9bba8-f921-40be-953b-bde93da7bf72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:45.564837 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f9bba8-f921-40be-953b-bde93da7bf72 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:45.565118 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f9bba8-f921-40be-953b-bde93da7bf72 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:45.565390 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f9bba8-f921-40be-953b-bde93da7bf72 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:45.595296 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f9bba8-f921-40be-953b-bde93da7bf72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:14:45.610852 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-04f9bba8-f921-40be-953b-bde93da7bf72 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 30 01:14:45.612264 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 87/166] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Mar 30 01:14:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:14:45.612887 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f9bba8-f921-40be-953b-bde93da7bf72 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:45.646603 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a9613-22d1-4017-8794-37413082ec5c None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:45.685379 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07617e3e-ccbf-437c-8943-0194004374f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:45.686641 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07617e3e-ccbf-437c-8943-0194004374f6 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:45.687152 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07617e3e-ccbf-437c-8943-0194004374f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:45.687640 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07617e3e-ccbf-437c-8943-0194004374f6 None admin] PATH_INFO: `/v3/projects/4a955500342c498384e96caede5f019f` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:45.689153 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07617e3e-ccbf-437c-8943-0194004374f6 None admin] RBAC: Authorizing `identity:get_project(project_id=4a955500342c498384e96caede5f019f)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:45.691201 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07617e3e-ccbf-437c-8943-0194004374f6 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:45.694448 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 80/167] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Mar 30 01:14:45 2022] GET /identity/v3/projects/4a955500342c498384e96caede5f019f => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:45.695592 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07617e3e-ccbf-437c-8943-0194004374f6 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:45.804130 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07617e3e-ccbf-437c-8943-0194004374f6 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:45.841793 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a163ce64-52d7-4514-92b1-6e73d68ff2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:45.843371 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a163ce64-52d7-4514-92b1-6e73d68ff2ef None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:45.843894 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a163ce64-52d7-4514-92b1-6e73d68ff2ef None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:45.844357 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a163ce64-52d7-4514-92b1-6e73d68ff2ef None admin] PATH_INFO: `/v3/projects/621b2aef8d0d4237a71ec556d4371144` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:45.845760 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a163ce64-52d7-4514-92b1-6e73d68ff2ef None admin] RBAC: Authorizing `identity:get_project(project_id=621b2aef8d0d4237a71ec556d4371144)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:45.847687 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a163ce64-52d7-4514-92b1-6e73d68ff2ef None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:45.850300 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 81/168] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Mar 30 01:14:45 2022] GET /identity/v3/projects/621b2aef8d0d4237a71ec556d4371144 => generated 312 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:45.851462 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a163ce64-52d7-4514-92b1-6e73d68ff2ef None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:45.868851 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f9bba8-f921-40be-953b-bde93da7bf72 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:45.960101 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a163ce64-52d7-4514-92b1-6e73d68ff2ef None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:45.962342 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7d35ba-e1b5-4f96-abed-58d0069c7357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:45.963186 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d35ba-e1b5-4f96-abed-58d0069c7357 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:45.963472 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d35ba-e1b5-4f96-abed-58d0069c7357 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:45.963753 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d35ba-e1b5-4f96-abed-58d0069c7357 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:45.991644 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7d35ba-e1b5-4f96-abed-58d0069c7357 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:14:45.998449 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f319751-c27e-4a6f-9f36-e4db79f9196c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:45.999440 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f319751-c27e-4a6f-9f36-e4db79f9196c None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:45.999936 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f319751-c27e-4a6f-9f36-e4db79f9196c None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:46.000398 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f319751-c27e-4a6f-9f36-e4db79f9196c None admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:46.001351 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f319751-c27e-4a6f-9f36-e4db79f9196c None admin] RBAC: Adding query filter params (name=reader) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:14:46.001844 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f319751-c27e-4a6f-9f36-e4db79f9196c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:46.003021 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-be7d35ba-e1b5-4f96-abed-58d0069c7357 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 30 01:14:46.003640 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f319751-c27e-4a6f-9f36-e4db79f9196c None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:46.004271 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 88/169] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Mar 30 01:14:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 392 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:14:46.006132 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7d35ba-e1b5-4f96-abed-58d0069c7357 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:46.014149 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 82/170] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Mar 30 01:14:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:46.015375 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f319751-c27e-4a6f-9f36-e4db79f9196c None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:46.130976 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f319751-c27e-4a6f-9f36-e4db79f9196c None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:46.152738 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7d35ba-e1b5-4f96-abed-58d0069c7357 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:46.175605 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c719e1-39e3-4bff-9833-c33dcae453b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:46.176401 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c719e1-39e3-4bff-9833-c33dcae453b6 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:46.177476 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c719e1-39e3-4bff-9833-c33dcae453b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:46.177851 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c719e1-39e3-4bff-9833-c33dcae453b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:46.179147 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c719e1-39e3-4bff-9833-c33dcae453b6 None admin] RBAC: Adding query filter params (role.id=7185d0cfbcd44502b1613bcfe1b42f6f, scope.project.id=621b2aef8d0d4237a71ec556d4371144, user.id=6cf69a2898a141f6bb15a9b7af982ed8) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:14:46.179582 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c719e1-39e3-4bff-9833-c33dcae453b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:46.181508 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c719e1-39e3-4bff-9833-c33dcae453b6 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:46.189752 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 83/171] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Mar 30 01:14:46 2022] GET /identity/v3/role_assignments?user.id=6cf69a2898a141f6bb15a9b7af982ed8&scope.project.id=621b2aef8d0d4237a71ec556d4371144&role.id=7185d0cfbcd44502b1613bcfe1b42f6f => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:46.191010 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c719e1-39e3-4bff-9833-c33dcae453b6 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:46.207558 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8f002d-c83a-401d-89a3-4b918c2a1b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:46.208623 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f002d-c83a-401d-89a3-4b918c2a1b49 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:46.209083 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f002d-c83a-401d-89a3-4b918c2a1b49 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:46.209589 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f002d-c83a-401d-89a3-4b918c2a1b49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:46.210747 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8f002d-c83a-401d-89a3-4b918c2a1b49 None admin] RBAC: Adding query filter params (role.id=36909bbf31d04993bb2a9fe587b572dc, scope.project.id=4a955500342c498384e96caede5f019f, user.id=e9a5ef9b377048458730d23efb1e6534) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:14:46.211282 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8f002d-c83a-401d-89a3-4b918c2a1b49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:46.213055 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8f002d-c83a-401d-89a3-4b918c2a1b49 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:46.222293 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 89/172] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Mar 30 01:14:46 2022] GET /identity/v3/role_assignments?user.id=e9a5ef9b377048458730d23efb1e6534&scope.project.id=4a955500342c498384e96caede5f019f&role.id=36909bbf31d04993bb2a9fe587b572dc => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:46.224274 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8f002d-c83a-401d-89a3-4b918c2a1b49 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:46.375741 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c719e1-39e3-4bff-9833-c33dcae453b6 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:46.426434 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67b3298-df29-4cc1-a616-78009153b768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:46.427979 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b3298-df29-4cc1-a616-78009153b768 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:46.428440 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b3298-df29-4cc1-a616-78009153b768 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:46.428952 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b3298-df29-4cc1-a616-78009153b768 None admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:46.431463 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67b3298-df29-4cc1-a616-78009153b768 None admin] RBAC: Adding query filter params (name=member) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:14:46.432039 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67b3298-df29-4cc1-a616-78009153b768 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:46.435459 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67b3298-df29-4cc1-a616-78009153b768 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:46.450579 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 84/173] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Mar 30 01:14:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:46.451247 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8f002d-c83a-401d-89a3-4b918c2a1b49 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:46.452472 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5f78d-eca9-4fa9-933f-f0a43a0ec680 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:46.453184 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5f78d-eca9-4fa9-933f-f0a43a0ec680 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:46.453630 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5f78d-eca9-4fa9-933f-f0a43a0ec680 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:46.455484 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 85/174] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:14:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:14:46.457262 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a5f78d-eca9-4fa9-933f-f0a43a0ec680 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:46.492884 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abb4bca-cdf8-4ebb-ac32-2b02977d9671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:46.493872 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb4bca-cdf8-4ebb-ac32-2b02977d9671 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:46.494223 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb4bca-cdf8-4ebb-ac32-2b02977d9671 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:46.494567 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb4bca-cdf8-4ebb-ac32-2b02977d9671 None admin] PATH_INFO: `/v3/users/48175e4bea784051b0ca867c0b1c30bf` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:46.496045 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abb4bca-cdf8-4ebb-ac32-2b02977d9671 None admin] RBAC: Authorizing `identity:get_user(user_id=48175e4bea784051b0ca867c0b1c30bf)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:46.497808 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abb4bca-cdf8-4ebb-ac32-2b02977d9671 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:46.499817 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 90/175] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Mar 30 01:14:46 2022] GET /identity/v3/users/48175e4bea784051b0ca867c0b1c30bf => generated 289 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:46.501541 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d82546-fead-4ae4-bf68-aaec0c3c1d10 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:46.501976 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d82546-fead-4ae4-bf68-aaec0c3c1d10 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:46.502385 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d82546-fead-4ae4-bf68-aaec0c3c1d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:46.535079 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-15d82546-fead-4ae4-bf68-aaec0c3c1d10 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:14:46.536598 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-15d82546-fead-4ae4-bf68-aaec0c3c1d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:14:46.625446 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a5f78d-eca9-4fa9-933f-f0a43a0ec680 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:46.646250 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 91/176] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:14:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 01:14:46.647536 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d82546-fead-4ae4-bf68-aaec0c3c1d10 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:46.664790 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5952d686-1ceb-4f1f-977f-baecfafcf64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:46.665744 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5952d686-1ceb-4f1f-977f-baecfafcf64c None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:46.666077 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5952d686-1ceb-4f1f-977f-baecfafcf64c None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:46.666531 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5952d686-1ceb-4f1f-977f-baecfafcf64c None admin] PATH_INFO: `/v3/users/6cf69a2898a141f6bb15a9b7af982ed8` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:46.667912 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5952d686-1ceb-4f1f-977f-baecfafcf64c None admin] RBAC: Authorizing `identity:get_user(user_id=6cf69a2898a141f6bb15a9b7af982ed8)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:46.669530 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5952d686-1ceb-4f1f-977f-baecfafcf64c None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:46.671364 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 86/177] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Mar 30 01:14:46 2022] GET /identity/v3/users/6cf69a2898a141f6bb15a9b7af982ed8 => generated 275 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:46.678545 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5952d686-1ceb-4f1f-977f-baecfafcf64c None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:46.775658 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d82546-fead-4ae4-bf68-aaec0c3c1d10 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:46.800419 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5952d686-1ceb-4f1f-977f-baecfafcf64c None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:46.813074 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbdde40-014c-4fc3-8502-42a32b51e239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:46.813943 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbdde40-014c-4fc3-8502-42a32b51e239 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:46.814232 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbdde40-014c-4fc3-8502-42a32b51e239 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:46.814509 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbdde40-014c-4fc3-8502-42a32b51e239 None admin] PATH_INFO: `/v3/projects/4a955500342c498384e96caede5f019f` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:46.815733 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbdde40-014c-4fc3-8502-42a32b51e239 None admin] RBAC: Authorizing `identity:get_project(project_id=4a955500342c498384e96caede5f019f)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:46.817768 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbdde40-014c-4fc3-8502-42a32b51e239 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:46.819588 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 92/178] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Mar 30 01:14:46 2022] GET /identity/v3/projects/4a955500342c498384e96caede5f019f => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:46.820372 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbdde40-014c-4fc3-8502-42a32b51e239 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:46.842341 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa4436c-dd0a-4d00-b906-a567d6e25aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:46.843141 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa4436c-dd0a-4d00-b906-a567d6e25aef None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:46.843593 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa4436c-dd0a-4d00-b906-a567d6e25aef None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:46.843990 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa4436c-dd0a-4d00-b906-a567d6e25aef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:46.920972 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa4436c-dd0a-4d00-b906-a567d6e25aef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:46.922451 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa4436c-dd0a-4d00-b906-a567d6e25aef None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:46.924702 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbdde40-014c-4fc3-8502-42a32b51e239 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:46.959304 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705da9c8-1941-45a7-b785-29490c34b33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:46.960029 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705da9c8-1941-45a7-b785-29490c34b33a None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:46.960313 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705da9c8-1941-45a7-b785-29490c34b33a None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:46.960592 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705da9c8-1941-45a7-b785-29490c34b33a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:46.970690 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705da9c8-1941-45a7-b785-29490c34b33a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:14:46.977658 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-705da9c8-1941-45a7-b785-29490c34b33a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 30 01:14:46.983490 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 93/179] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Mar 30 01:14:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:14:46.983490 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4256ab-6b3c-4aef-b529-aa6eff7f67d1 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:46.983490 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4256ab-6b3c-4aef-b529-aa6eff7f67d1 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:46.983490 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4256ab-6b3c-4aef-b529-aa6eff7f67d1 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:46.983490 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 94/180] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:14:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:14:46.983490 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4256ab-6b3c-4aef-b529-aa6eff7f67d1 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:47.031061 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 87/181] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Mar 30 01:14:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 30 01:14:47.031899 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa4436c-dd0a-4d00-b906-a567d6e25aef None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:47.084942 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4256ab-6b3c-4aef-b529-aa6eff7f67d1 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:47.116819 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29504806-da4f-498b-b611-11f490f98a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:47.117702 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29504806-da4f-498b-b611-11f490f98a7f None admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:47.117984 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29504806-da4f-498b-b611-11f490f98a7f None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:47.118260 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29504806-da4f-498b-b611-11f490f98a7f None admin] PATH_INFO: `/v3/projects/4a955500342c498384e96caede5f019f/users/48175e4bea784051b0ca867c0b1c30bf/roles/1dffd8c286fa4de1b7a059d5c5da54f8` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:47.120223 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29504806-da4f-498b-b611-11f490f98a7f None admin] RBAC: Authorizing `identity:create_grant(project_id=4a955500342c498384e96caede5f019f, user_id=48175e4bea784051b0ca867c0b1c30bf, role_id=1dffd8c286fa4de1b7a059d5c5da54f8)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:47.121659 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29504806-da4f-498b-b611-11f490f98a7f None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:47.124488 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa4436c-dd0a-4d00-b906-a567d6e25aef None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:47.134567 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 95/182] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Mar 30 01:14:46 2022] PUT /identity/v3/projects/4a955500342c498384e96caede5f019f/users/48175e4bea784051b0ca867c0b1c30bf/roles/1dffd8c286fa4de1b7a059d5c5da54f8 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:14:47.135832 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b34b59-38bb-4fbe-8273-bce3c47d6163 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:47.136123 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b34b59-38bb-4fbe-8273-bce3c47d6163 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:47.136403 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b34b59-38bb-4fbe-8273-bce3c47d6163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:47.153949 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-b8b34b59-38bb-4fbe-8273-bce3c47d6163 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:14:47.155495 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-b8b34b59-38bb-4fbe-8273-bce3c47d6163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:14:47.161812 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d54a7ba-fe1a-446d-9838-56ca7c124622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:47.162573 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54a7ba-fe1a-446d-9838-56ca7c124622 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:47.162896 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54a7ba-fe1a-446d-9838-56ca7c124622 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:47.163176 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54a7ba-fe1a-446d-9838-56ca7c124622 None admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:47.163962 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d54a7ba-fe1a-446d-9838-56ca7c124622 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:14:47.164274 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d54a7ba-fe1a-446d-9838-56ca7c124622 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:47.165721 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d54a7ba-fe1a-446d-9838-56ca7c124622 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:47.180271 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 88/183] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Mar 30 01:14:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:47.180271 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d975aee-ea5c-419d-865c-04aea62d1575 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:47.180271 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d975aee-ea5c-419d-865c-04aea62d1575 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:47.180271 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d975aee-ea5c-419d-865c-04aea62d1575 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:47.180271 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 89/184] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:14:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:14:47.180271 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d975aee-ea5c-419d-865c-04aea62d1575 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:47.243134 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 96/185] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:14:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 01:14:47.251757 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b34b59-38bb-4fbe-8273-bce3c47d6163 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:47.291340 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d975aee-ea5c-419d-865c-04aea62d1575 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:47.330533 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0169b3c-aaa2-448f-af31-cb75dc459585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:47.331506 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0169b3c-aaa2-448f-af31-cb75dc459585 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:47.331786 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0169b3c-aaa2-448f-af31-cb75dc459585 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:47.332056 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0169b3c-aaa2-448f-af31-cb75dc459585 None admin] PATH_INFO: `/v3/projects/4a955500342c498384e96caede5f019f` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:47.333882 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0169b3c-aaa2-448f-af31-cb75dc459585 None admin] RBAC: Authorizing `identity:get_project(project_id=4a955500342c498384e96caede5f019f)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:47.335376 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0169b3c-aaa2-448f-af31-cb75dc459585 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:47.337228 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 90/186] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Mar 30 01:14:47 2022] GET /identity/v3/projects/4a955500342c498384e96caede5f019f => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:47.338470 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd387611-21fb-4210-b862-d7ee5e7cbc00 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:47.338846 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd387611-21fb-4210-b862-d7ee5e7cbc00 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:47.339181 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd387611-21fb-4210-b862-d7ee5e7cbc00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:47.355822 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-cd387611-21fb-4210-b862-d7ee5e7cbc00 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:14:47.357008 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-cd387611-21fb-4210-b862-d7ee5e7cbc00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:14:47.361773 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b34b59-38bb-4fbe-8273-bce3c47d6163 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:47.396330 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80fe681-37fd-43ea-9666-2ea1d0c9fba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:47.397209 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80fe681-37fd-43ea-9666-2ea1d0c9fba9 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:47.397494 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80fe681-37fd-43ea-9666-2ea1d0c9fba9 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:47.397825 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80fe681-37fd-43ea-9666-2ea1d0c9fba9 None admin] PATH_INFO: `/v3/users/9670bc1cee3a445088a63fd86584967f` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:47.411846 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80fe681-37fd-43ea-9666-2ea1d0c9fba9 None admin] RBAC: Authorizing `identity:get_user(user_id=9670bc1cee3a445088a63fd86584967f)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:47.413343 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80fe681-37fd-43ea-9666-2ea1d0c9fba9 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:47.415255 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 97/187] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Mar 30 01:14:47 2022] GET /identity/v3/users/9670bc1cee3a445088a63fd86584967f => generated 283 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:47.420385 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80fe681-37fd-43ea-9666-2ea1d0c9fba9 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:47.422628 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 91/188] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:14:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 01:14:47.423495 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd387611-21fb-4210-b862-d7ee5e7cbc00 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:47.524294 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80fe681-37fd-43ea-9666-2ea1d0c9fba9 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:47.525373 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd387611-21fb-4210-b862-d7ee5e7cbc00 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:47.558208 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0197f83f-ef63-407d-8411-f6687ac1ebee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:47.558430 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268e6a02-5fca-43b4-aa3f-11e0afd4409b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:47.558897 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e6a02-5fca-43b4-aa3f-11e0afd4409b None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:47.559064 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0197f83f-ef63-407d-8411-f6687ac1ebee None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:47.559214 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e6a02-5fca-43b4-aa3f-11e0afd4409b None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:47.559315 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0197f83f-ef63-407d-8411-f6687ac1ebee None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:47.559477 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e6a02-5fca-43b4-aa3f-11e0afd4409b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:47.559564 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0197f83f-ef63-407d-8411-f6687ac1ebee None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:47.560262 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268e6a02-5fca-43b4-aa3f-11e0afd4409b None admin] RBAC: Adding query filter params (role.id=7185d0cfbcd44502b1613bcfe1b42f6f, scope.project.id=4a955500342c498384e96caede5f019f, user.id=6cf69a2898a141f6bb15a9b7af982ed8) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:14:47.560571 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268e6a02-5fca-43b4-aa3f-11e0afd4409b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:47.562006 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268e6a02-5fca-43b4-aa3f-11e0afd4409b None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:47.578747 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 92/189] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Mar 30 01:14:47 2022] GET /identity/v3/role_assignments?user.id=6cf69a2898a141f6bb15a9b7af982ed8&scope.project.id=4a955500342c498384e96caede5f019f&role.id=7185d0cfbcd44502b1613bcfe1b42f6f => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:47.578747 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268e6a02-5fca-43b4-aa3f-11e0afd4409b None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:47.579021 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0197f83f-ef63-407d-8411-f6687ac1ebee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:14:47.579021 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-0197f83f-ef63-407d-8411-f6687ac1ebee None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 30 01:14:47.579620 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 98/190] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Mar 30 01:14:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:14:47.580210 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0197f83f-ef63-407d-8411-f6687ac1ebee None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:47.712253 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0197f83f-ef63-407d-8411-f6687ac1ebee None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:47.719672 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268e6a02-5fca-43b4-aa3f-11e0afd4409b None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:47.749725 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f5dd19-7e82-4cc2-8b45-0a3610ecebfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:47.750546 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f5dd19-7e82-4cc2-8b45-0a3610ecebfd None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:47.750862 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f5dd19-7e82-4cc2-8b45-0a3610ecebfd None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:47.751146 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f5dd19-7e82-4cc2-8b45-0a3610ecebfd None admin] PATH_INFO: `/v3/domains/default` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:47.753808 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f5dd19-7e82-4cc2-8b45-0a3610ecebfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:47.755675 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f5dd19-7e82-4cc2-8b45-0a3610ecebfd None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:47.757388 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 99/191] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:14:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:47.758159 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f5dd19-7e82-4cc2-8b45-0a3610ecebfd None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:47.764238 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a919e5-76f6-4e6f-a62e-629a1cd39351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:47.764895 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a919e5-76f6-4e6f-a62e-629a1cd39351 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:47.765185 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a919e5-76f6-4e6f-a62e-629a1cd39351 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:47.765466 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a919e5-76f6-4e6f-a62e-629a1cd39351 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:47.839705 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a919e5-76f6-4e6f-a62e-629a1cd39351 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:47.841213 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a919e5-76f6-4e6f-a62e-629a1cd39351 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:47.870309 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f5dd19-7e82-4cc2-8b45-0a3610ecebfd None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:47.903176 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ff8604-6225-417d-acf8-1c75adc49bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:47.903842 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff8604-6225-417d-acf8-1c75adc49bd5 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:47.904129 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff8604-6225-417d-acf8-1c75adc49bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:47.904406 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff8604-6225-417d-acf8-1c75adc49bd5 None admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:47.905407 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ff8604-6225-417d-acf8-1c75adc49bd5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:14:47.905716 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ff8604-6225-417d-acf8-1c75adc49bd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:47.907526 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ff8604-6225-417d-acf8-1c75adc49bd5 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:47.915847 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 100/192] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Mar 30 01:14:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:47.916650 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ff8604-6225-417d-acf8-1c75adc49bd5 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:47.939662 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 93/193] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Mar 30 01:14:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 30 01:14:47.940515 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a919e5-76f6-4e6f-a62e-629a1cd39351 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:48.019679 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ff8604-6225-417d-acf8-1c75adc49bd5 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:48.047501 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a919e5-76f6-4e6f-a62e-629a1cd39351 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:48.053827 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39fffd5-081b-4a2a-ac5d-e1ce48d94cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:48.054534 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39fffd5-081b-4a2a-ac5d-e1ce48d94cf0 None admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:48.054854 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39fffd5-081b-4a2a-ac5d-e1ce48d94cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:48.055199 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39fffd5-081b-4a2a-ac5d-e1ce48d94cf0 None admin] PATH_INFO: `/v3/users` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:48.055911 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39fffd5-081b-4a2a-ac5d-e1ce48d94cf0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:48.057370 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39fffd5-081b-4a2a-ac5d-e1ce48d94cf0 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:48.079031 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 101/194] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Mar 30 01:14:47 2022] POST /identity/v3/users => generated 297 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:14:48.079657 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39fffd5-081b-4a2a-ac5d-e1ce48d94cf0 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:48.099635 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f38d45a-3db2-4aad-947e-923489f4a23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:48.100740 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38d45a-3db2-4aad-947e-923489f4a23f None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:48.101030 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38d45a-3db2-4aad-947e-923489f4a23f None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:48.101305 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38d45a-3db2-4aad-947e-923489f4a23f None admin] PATH_INFO: `/v3/users/9670bc1cee3a445088a63fd86584967f` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:48.102885 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f38d45a-3db2-4aad-947e-923489f4a23f None admin] RBAC: Authorizing `identity:get_user(user_id=9670bc1cee3a445088a63fd86584967f)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:48.104357 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f38d45a-3db2-4aad-947e-923489f4a23f None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:48.106185 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 94/195] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Mar 30 01:14:47 2022] GET /identity/v3/users/9670bc1cee3a445088a63fd86584967f => generated 283 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:48.112115 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f38d45a-3db2-4aad-947e-923489f4a23f None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:48.200503 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39fffd5-081b-4a2a-ac5d-e1ce48d94cf0 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:48.223196 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f38d45a-3db2-4aad-947e-923489f4a23f None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:48.238758 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6163b0-61b8-4d60-82c2-a099a6e44dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:48.240631 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6163b0-61b8-4d60-82c2-a099a6e44dc9 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:48.241121 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6163b0-61b8-4d60-82c2-a099a6e44dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:48.241645 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6163b0-61b8-4d60-82c2-a099a6e44dc9 None admin] PATH_INFO: `/v3/projects/9a11dd1e0b1549e8b39995a2cbec195f` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:48.243600 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6163b0-61b8-4d60-82c2-a099a6e44dc9 None admin] RBAC: Authorizing `identity:get_project(project_id=9a11dd1e0b1549e8b39995a2cbec195f)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:48.245349 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6163b0-61b8-4d60-82c2-a099a6e44dc9 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:48.247597 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 102/196] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Mar 30 01:14:48 2022] GET /identity/v3/projects/9a11dd1e0b1549e8b39995a2cbec195f => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:48.257590 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6163b0-61b8-4d60-82c2-a099a6e44dc9 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:48.270534 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed253368-d81a-4797-9eaf-752a7b604ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:48.271017 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed253368-d81a-4797-9eaf-752a7b604ec7 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:48.271299 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed253368-d81a-4797-9eaf-752a7b604ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:48.271573 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed253368-d81a-4797-9eaf-752a7b604ec7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:48.354338 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed253368-d81a-4797-9eaf-752a7b604ec7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:48.358132 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed253368-d81a-4797-9eaf-752a7b604ec7 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:48.392074 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6163b0-61b8-4d60-82c2-a099a6e44dc9 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:48.430947 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a8b73c-6a63-4006-a3d6-ee44fdd9af29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:48.431606 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8b73c-6a63-4006-a3d6-ee44fdd9af29 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:48.431886 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8b73c-6a63-4006-a3d6-ee44fdd9af29 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:48.432157 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8b73c-6a63-4006-a3d6-ee44fdd9af29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:48.432987 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a8b73c-6a63-4006-a3d6-ee44fdd9af29 None admin] RBAC: Adding query filter params (role.id=36909bbf31d04993bb2a9fe587b572dc, scope.project.id=9a11dd1e0b1549e8b39995a2cbec195f, user.id=9670bc1cee3a445088a63fd86584967f) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:14:48.433295 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a8b73c-6a63-4006-a3d6-ee44fdd9af29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:48.434789 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a8b73c-6a63-4006-a3d6-ee44fdd9af29 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:48.441534 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 103/197] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Mar 30 01:14:48 2022] GET /identity/v3/role_assignments?user.id=9670bc1cee3a445088a63fd86584967f&scope.project.id=9a11dd1e0b1549e8b39995a2cbec195f&role.id=36909bbf31d04993bb2a9fe587b572dc => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:48.480620 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 95/198] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Mar 30 01:14:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 30 01:14:48.486964 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a8b73c-6a63-4006-a3d6-ee44fdd9af29 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:48.606931 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a8b73c-6a63-4006-a3d6-ee44fdd9af29 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:48.650231 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7310253-9c95-420c-8aaf-0b1ff4d6731b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:48.651149 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7310253-9c95-420c-8aaf-0b1ff4d6731b None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:48.651441 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7310253-9c95-420c-8aaf-0b1ff4d6731b None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:48.651718 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7310253-9c95-420c-8aaf-0b1ff4d6731b None admin] PATH_INFO: `/v3/projects/9a11dd1e0b1549e8b39995a2cbec195f` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:48.652972 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7310253-9c95-420c-8aaf-0b1ff4d6731b None admin] RBAC: Authorizing `identity:get_project(project_id=9a11dd1e0b1549e8b39995a2cbec195f)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:48.654455 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7310253-9c95-420c-8aaf-0b1ff4d6731b None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:48.656635 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 104/199] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Mar 30 01:14:48 2022] GET /identity/v3/projects/9a11dd1e0b1549e8b39995a2cbec195f => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:48.663325 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed253368-d81a-4797-9eaf-752a7b604ec7 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:48.803903 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed253368-d81a-4797-9eaf-752a7b604ec7 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:48.846323 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906f7695-d33c-4229-a263-3a8be3ec5ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:48.847030 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f7695-d33c-4229-a263-3a8be3ec5ca2 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:48.847316 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f7695-d33c-4229-a263-3a8be3ec5ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:48.847595 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f7695-d33c-4229-a263-3a8be3ec5ca2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:48.849102 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906f7695-d33c-4229-a263-3a8be3ec5ca2 None admin] RBAC: Adding query filter params (role.id=7ab1dc76ea3e450689be4c2ab56097f4, scope.project.id=9a11dd1e0b1549e8b39995a2cbec195f, user.id=9670bc1cee3a445088a63fd86584967f) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:14:48.849552 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906f7695-d33c-4229-a263-3a8be3ec5ca2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:48.851134 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906f7695-d33c-4229-a263-3a8be3ec5ca2 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:48.857790 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 96/200] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Mar 30 01:14:48 2022] GET /identity/v3/role_assignments?user.id=9670bc1cee3a445088a63fd86584967f&scope.project.id=9a11dd1e0b1549e8b39995a2cbec195f&role.id=7ab1dc76ea3e450689be4c2ab56097f4 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:49.794668 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b1cc5-d2a8-464c-b251-642efbcc3aa9 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:49.795187 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b1cc5-d2a8-464c-b251-642efbcc3aa9 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:49.795259 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b1cc5-d2a8-464c-b251-642efbcc3aa9 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:49.797266 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 105/201] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:14:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:14:49.802851 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7dac5-2ebc-4d29-9847-b844dcd6063c None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:49.803267 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7dac5-2ebc-4d29-9847-b844dcd6063c None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:49.803434 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7dac5-2ebc-4d29-9847-b844dcd6063c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:49.827773 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-74e7dac5-2ebc-4d29-9847-b844dcd6063c None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:14:49.828978 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-74e7dac5-2ebc-4d29-9847-b844dcd6063c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:14:49.929444 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 97/202] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:14:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 01:14:49.967090 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8b1cc5-d2a8-464c-b251-642efbcc3aa9 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:50.087372 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8b1cc5-d2a8-464c-b251-642efbcc3aa9 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:50.131779 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da079feb-dfa8-498a-a47b-d0930e8d6097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:50.131779 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da079feb-dfa8-498a-a47b-d0930e8d6097 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:50.131779 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da079feb-dfa8-498a-a47b-d0930e8d6097 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:50.131779 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da079feb-dfa8-498a-a47b-d0930e8d6097 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:50.146256 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da079feb-dfa8-498a-a47b-d0930e8d6097 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:14:50.153348 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-da079feb-dfa8-498a-a47b-d0930e8d6097 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 30 01:14:50.155131 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 106/203] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Mar 30 01:14:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:14:50.161044 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e7dac5-2ebc-4d29-9847-b844dcd6063c None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:50.261792 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e7dac5-2ebc-4d29-9847-b844dcd6063c None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:50.298113 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012158e1-65ac-4205-9099-501be5547a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:50.298809 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012158e1-65ac-4205-9099-501be5547a4e None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:50.299090 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012158e1-65ac-4205-9099-501be5547a4e None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:50.299364 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012158e1-65ac-4205-9099-501be5547a4e None admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:50.300108 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012158e1-65ac-4205-9099-501be5547a4e None admin] RBAC: Adding query filter params (name=reader) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:14:50.300410 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012158e1-65ac-4205-9099-501be5547a4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:50.302323 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012158e1-65ac-4205-9099-501be5547a4e None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:50.313923 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 98/204] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Mar 30 01:14:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:50.320117 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da079feb-dfa8-498a-a47b-d0930e8d6097 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:50.465460 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da079feb-dfa8-498a-a47b-d0930e8d6097 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:50.512819 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46e421b-c35c-473d-a5ea-1f1bf60e3e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:50.513616 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e421b-c35c-473d-a5ea-1f1bf60e3e3b None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:50.513897 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e421b-c35c-473d-a5ea-1f1bf60e3e3b None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:50.514166 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e421b-c35c-473d-a5ea-1f1bf60e3e3b None admin] PATH_INFO: `/v3/users/48175e4bea784051b0ca867c0b1c30bf` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:50.515384 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46e421b-c35c-473d-a5ea-1f1bf60e3e3b None admin] RBAC: Authorizing `identity:get_user(user_id=48175e4bea784051b0ca867c0b1c30bf)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:50.516828 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46e421b-c35c-473d-a5ea-1f1bf60e3e3b None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:50.518438 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 107/205] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Mar 30 01:14:50 2022] GET /identity/v3/users/48175e4bea784051b0ca867c0b1c30bf => generated 289 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:50.524184 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012158e1-65ac-4205-9099-501be5547a4e None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:50.682307 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012158e1-65ac-4205-9099-501be5547a4e None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:50.732296 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12abdb29-2ba6-41dd-8a67-6504834df931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:50.732959 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12abdb29-2ba6-41dd-8a67-6504834df931 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:50.733241 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12abdb29-2ba6-41dd-8a67-6504834df931 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:50.733511 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12abdb29-2ba6-41dd-8a67-6504834df931 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:50.809047 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12abdb29-2ba6-41dd-8a67-6504834df931 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:50.810505 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12abdb29-2ba6-41dd-8a67-6504834df931 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:50.916614 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 99/206] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Mar 30 01:14:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 30 01:14:50.922087 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46e421b-c35c-473d-a5ea-1f1bf60e3e3b None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:51.024693 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46e421b-c35c-473d-a5ea-1f1bf60e3e3b None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:51.065801 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61b4efc-24a1-4043-9d87-8872ff17d21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:51.066592 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b4efc-24a1-4043-9d87-8872ff17d21b None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:51.066900 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b4efc-24a1-4043-9d87-8872ff17d21b None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:51.067850 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b4efc-24a1-4043-9d87-8872ff17d21b None admin] PATH_INFO: `/v3/projects/4a955500342c498384e96caede5f019f` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:51.069360 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61b4efc-24a1-4043-9d87-8872ff17d21b None admin] RBAC: Authorizing `identity:get_project(project_id=4a955500342c498384e96caede5f019f)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:51.070831 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61b4efc-24a1-4043-9d87-8872ff17d21b None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:51.072512 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 108/207] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Mar 30 01:14:50 2022] GET /identity/v3/projects/4a955500342c498384e96caede5f019f => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:51.078229 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12abdb29-2ba6-41dd-8a67-6504834df931 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:51.238312 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12abdb29-2ba6-41dd-8a67-6504834df931 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:51.282023 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0ff41e-aa00-4584-b8bc-2ffd2dfe5e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:51.282689 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0ff41e-aa00-4584-b8bc-2ffd2dfe5e0d None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:51.282992 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0ff41e-aa00-4584-b8bc-2ffd2dfe5e0d None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:51.283271 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0ff41e-aa00-4584-b8bc-2ffd2dfe5e0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:51.284101 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0ff41e-aa00-4584-b8bc-2ffd2dfe5e0d None admin] RBAC: Adding query filter params (role.id=1dffd8c286fa4de1b7a059d5c5da54f8, scope.project.id=4a955500342c498384e96caede5f019f, user.id=48175e4bea784051b0ca867c0b1c30bf) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:14:51.284410 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0ff41e-aa00-4584-b8bc-2ffd2dfe5e0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:51.286392 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0ff41e-aa00-4584-b8bc-2ffd2dfe5e0d None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:51.295049 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 100/208] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Mar 30 01:14:51 2022] GET /identity/v3/role_assignments?user.id=48175e4bea784051b0ca867c0b1c30bf&scope.project.id=4a955500342c498384e96caede5f019f&role.id=1dffd8c286fa4de1b7a059d5c5da54f8 => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:51.352413 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a9c04-7a19-41cd-8659-4816bc2b6335 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:51.352716 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a9c04-7a19-41cd-8659-4816bc2b6335 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:51.352896 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a9c04-7a19-41cd-8659-4816bc2b6335 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:51.354679 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 109/209] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:14:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:14:51.372736 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c072746-e704-49d2-b28c-57a82b5ce77f None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:51.373041 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c072746-e704-49d2-b28c-57a82b5ce77f None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:51.373294 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c072746-e704-49d2-b28c-57a82b5ce77f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:51.404018 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-0c072746-e704-49d2-b28c-57a82b5ce77f None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:14:51.405507 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-0c072746-e704-49d2-b28c-57a82b5ce77f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:14:51.432973 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7227113f-5afd-4b44-8a19-03c56624c6ca None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:51.433276 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7227113f-5afd-4b44-8a19-03c56624c6ca None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:51.433527 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7227113f-5afd-4b44-8a19-03c56624c6ca None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:51.435614 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 110/210] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:14:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 01:14:51.444731 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9adee-1021-492c-83a3-1ea6172a986f None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:51.445061 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9adee-1021-492c-83a3-1ea6172a986f None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:51.445302 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9adee-1021-492c-83a3-1ea6172a986f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:51.481857 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-58d9adee-1021-492c-83a3-1ea6172a986f None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:14:51.483105 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-58d9adee-1021-492c-83a3-1ea6172a986f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:14:51.525031 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 101/211] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:14:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 01:14:51.551197 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c072746-e704-49d2-b28c-57a82b5ce77f None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:51.604342 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 111/212] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:14:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 01:14:51.605982 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cee2ae-ff6e-4b4d-8ba6-37a3c1a56b42 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:51.606278 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cee2ae-ff6e-4b4d-8ba6-37a3c1a56b42 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:51.606552 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cee2ae-ff6e-4b4d-8ba6-37a3c1a56b42 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:51.609095 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 112/213] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:14:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:14:51.614136 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2ce37-9379-4ef4-87b3-7e6b4510304d None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:51.614420 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2ce37-9379-4ef4-87b3-7e6b4510304d None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:51.614692 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2ce37-9379-4ef4-87b3-7e6b4510304d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:51.632338 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-55f2ce37-9379-4ef4-87b3-7e6b4510304d None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:14:51.633513 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-55f2ce37-9379-4ef4-87b3-7e6b4510304d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:14:51.694089 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c072746-e704-49d2-b28c-57a82b5ce77f None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:51.714782 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 113/214] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:14:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 30 01:14:51.715873 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f2ce37-9379-4ef4-87b3-7e6b4510304d None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:51.739644 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ce7833-bf84-49b7-998a-697b85fb25d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:51.740473 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce7833-bf84-49b7-998a-697b85fb25d1 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:51.740756 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce7833-bf84-49b7-998a-697b85fb25d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:51.741040 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce7833-bf84-49b7-998a-697b85fb25d1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:51.751424 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ce7833-bf84-49b7-998a-697b85fb25d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:14:51.758298 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-a0ce7833-bf84-49b7-998a-697b85fb25d1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 30 01:14:51.764179 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 102/215] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Mar 30 01:14:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 01:14:51.764179 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ce7833-bf84-49b7-998a-697b85fb25d1 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:51.819738 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f2ce37-9379-4ef4-87b3-7e6b4510304d None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:51.854169 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95afb49-1b7b-4f63-9022-7133d9486e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:51.855052 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95afb49-1b7b-4f63-9022-7133d9486e4f None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:51.855278 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95afb49-1b7b-4f63-9022-7133d9486e4f None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:51.855553 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95afb49-1b7b-4f63-9022-7133d9486e4f None admin] PATH_INFO: `/v3/domains/default` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:51.856708 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95afb49-1b7b-4f63-9022-7133d9486e4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:51.858174 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95afb49-1b7b-4f63-9022-7133d9486e4f None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:51.859163 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ce7833-bf84-49b7-998a-697b85fb25d1 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:51.859815 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 114/216] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:14:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:51.860577 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95afb49-1b7b-4f63-9022-7133d9486e4f None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:51.892286 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb70db50-45c5-4932-87af-344a08b24e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:51.893071 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70db50-45c5-4932-87af-344a08b24e46 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:51.893352 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70db50-45c5-4932-87af-344a08b24e46 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:51.893627 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70db50-45c5-4932-87af-344a08b24e46 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:51.903918 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb70db50-45c5-4932-87af-344a08b24e46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:14:51.911222 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-bb70db50-45c5-4932-87af-344a08b24e46 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 30 01:14:51.912402 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 103/217] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Mar 30 01:14:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:14:51.917315 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f68ea74-0790-4c0d-8130-f4a1e1110070 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:51.917315 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f68ea74-0790-4c0d-8130-f4a1e1110070 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:51.917315 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f68ea74-0790-4c0d-8130-f4a1e1110070 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:51.917315 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 104/218] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:14:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:14:51.917315 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f68ea74-0790-4c0d-8130-f4a1e1110070 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:51.955319 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95afb49-1b7b-4f63-9022-7133d9486e4f None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:51.987157 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084f759e-2447-4a71-9d32-6e42af94c9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:51.987818 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f759e-2447-4a71-9d32-6e42af94c9f8 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:51.988097 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f759e-2447-4a71-9d32-6e42af94c9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:51.988370 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f759e-2447-4a71-9d32-6e42af94c9f8 None admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:51.991259 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084f759e-2447-4a71-9d32-6e42af94c9f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:14:51.991565 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084f759e-2447-4a71-9d32-6e42af94c9f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:51.992936 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084f759e-2447-4a71-9d32-6e42af94c9f8 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:52.000810 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 115/219] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Mar 30 01:14:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:52.001592 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084f759e-2447-4a71-9d32-6e42af94c9f8 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:52.014641 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f68ea74-0790-4c0d-8130-f4a1e1110070 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:52.048459 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620e92f2-c22f-4429-ae34-bb98a876b3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:52.049121 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e92f2-c22f-4429-ae34-bb98a876b3a5 None admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:52.049401 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e92f2-c22f-4429-ae34-bb98a876b3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:52.049673 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e92f2-c22f-4429-ae34-bb98a876b3a5 None admin] PATH_INFO: `/v3/users` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:52.050367 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620e92f2-c22f-4429-ae34-bb98a876b3a5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:52.052145 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620e92f2-c22f-4429-ae34-bb98a876b3a5 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:52.073422 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 105/220] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Mar 30 01:14:51 2022] POST /identity/v3/users => generated 297 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:14:52.073422 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b99de-aeb0-494a-a348-530d8ef380e5 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:52.073422 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b99de-aeb0-494a-a348-530d8ef380e5 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:52.073422 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b99de-aeb0-494a-a348-530d8ef380e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:52.093357 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-702b99de-aeb0-494a-a348-530d8ef380e5 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:14:52.094594 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-702b99de-aeb0-494a-a348-530d8ef380e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:14:52.106682 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084f759e-2447-4a71-9d32-6e42af94c9f8 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:52.146279 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9cae53-f900-4935-b254-42847a56c8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:52.147202 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9cae53-f900-4935-b254-42847a56c8e1 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:52.147488 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9cae53-f900-4935-b254-42847a56c8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:52.147765 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9cae53-f900-4935-b254-42847a56c8e1 None admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:52.148537 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9cae53-f900-4935-b254-42847a56c8e1 None admin] RBAC: Adding query filter params (name=member) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:14:52.148839 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9cae53-f900-4935-b254-42847a56c8e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:52.150254 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9cae53-f900-4935-b254-42847a56c8e1 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:52.159708 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 116/221] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Mar 30 01:14:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:52.165160 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9cae53-f900-4935-b254-42847a56c8e1 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:52.178883 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 106/222] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:14:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 01:14:52.178883 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b99de-aeb0-494a-a348-530d8ef380e5 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:52.272761 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9cae53-f900-4935-b254-42847a56c8e1 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:52.282561 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b99de-aeb0-494a-a348-530d8ef380e5 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:52.310412 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb8655a-ed92-4f14-801b-0e783ec68cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:52.311402 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb8655a-ed92-4f14-801b-0e783ec68cf6 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:52.311689 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb8655a-ed92-4f14-801b-0e783ec68cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:52.311967 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb8655a-ed92-4f14-801b-0e783ec68cf6 None admin] PATH_INFO: `/v3/users/9670bc1cee3a445088a63fd86584967f` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:52.314013 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb8655a-ed92-4f14-801b-0e783ec68cf6 None admin] RBAC: Authorizing `identity:get_user(user_id=9670bc1cee3a445088a63fd86584967f)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:52.315506 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb8655a-ed92-4f14-801b-0e783ec68cf6 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:52.316509 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c9360c-7026-48e6-bc40-01325b733bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:52.321653 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9360c-7026-48e6-bc40-01325b733bc7 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:52.321653 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9360c-7026-48e6-bc40-01325b733bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:52.321882 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 117/223] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Mar 30 01:14:52 2022] GET /identity/v3/users/9670bc1cee3a445088a63fd86584967f => generated 283 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:52.321965 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9360c-7026-48e6-bc40-01325b733bc7 None admin] PATH_INFO: `/v3/users/1aaf73fd3ed348f1a90c21541630af19` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:52.322066 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb8655a-ed92-4f14-801b-0e783ec68cf6 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:52.336735 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c9360c-7026-48e6-bc40-01325b733bc7 None admin] RBAC: Authorizing `identity:get_user(user_id=1aaf73fd3ed348f1a90c21541630af19)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:52.338205 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c9360c-7026-48e6-bc40-01325b733bc7 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:52.339989 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 107/224] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Mar 30 01:14:52 2022] GET /identity/v3/users/1aaf73fd3ed348f1a90c21541630af19 => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:52.340851 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c9360c-7026-48e6-bc40-01325b733bc7 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:52.429935 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb8655a-ed92-4f14-801b-0e783ec68cf6 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:52.447682 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c9360c-7026-48e6-bc40-01325b733bc7 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:52.464605 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4036c1-b271-4e03-9b6e-464d32129696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:52.465421 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4036c1-b271-4e03-9b6e-464d32129696 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:52.465706 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4036c1-b271-4e03-9b6e-464d32129696 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:52.465980 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4036c1-b271-4e03-9b6e-464d32129696 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:52.476367 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4036c1-b271-4e03-9b6e-464d32129696 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:14:52.481885 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6e776c-387e-49c9-9299-296fff5f8a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:52.482774 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e776c-387e-49c9-9299-296fff5f8a3d None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:52.483062 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e776c-387e-49c9-9299-296fff5f8a3d None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:52.483353 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e776c-387e-49c9-9299-296fff5f8a3d None admin] PATH_INFO: `/v3/projects/9a11dd1e0b1549e8b39995a2cbec195f` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:52.483969 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-6b4036c1-b271-4e03-9b6e-464d32129696 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 30 01:14:52.484651 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6e776c-387e-49c9-9299-296fff5f8a3d None admin] RBAC: Authorizing `identity:get_project(project_id=9a11dd1e0b1549e8b39995a2cbec195f)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:52.485214 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 118/225] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Mar 30 01:14:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:14:52.485991 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4036c1-b271-4e03-9b6e-464d32129696 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:52.486112 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6e776c-387e-49c9-9299-296fff5f8a3d None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:52.487827 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 108/226] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Mar 30 01:14:52 2022] GET /identity/v3/projects/9a11dd1e0b1549e8b39995a2cbec195f => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:52.494227 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6e776c-387e-49c9-9299-296fff5f8a3d None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:52.588784 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4036c1-b271-4e03-9b6e-464d32129696 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:52.595843 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6e776c-387e-49c9-9299-296fff5f8a3d None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:52.623269 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f9d1ed-6e5a-4a65-9d2c-36d04f41b1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:52.623927 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9d1ed-6e5a-4a65-9d2c-36d04f41b1c3 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:52.624209 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9d1ed-6e5a-4a65-9d2c-36d04f41b1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:52.624909 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9d1ed-6e5a-4a65-9d2c-36d04f41b1c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:52.630447 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bd3f4b-f22b-4672-bcdf-6be4f7ba2125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:52.631436 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd3f4b-f22b-4672-bcdf-6be4f7ba2125 None admin] REQUEST_METHOD: `PUT` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:52.631722 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd3f4b-f22b-4672-bcdf-6be4f7ba2125 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:52.631995 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd3f4b-f22b-4672-bcdf-6be4f7ba2125 None admin] PATH_INFO: `/v3/projects/9a11dd1e0b1549e8b39995a2cbec195f/users/9670bc1cee3a445088a63fd86584967f/roles/36909bbf31d04993bb2a9fe587b572dc` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:52.634035 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bd3f4b-f22b-4672-bcdf-6be4f7ba2125 None admin] RBAC: Authorizing `identity:create_grant(project_id=9a11dd1e0b1549e8b39995a2cbec195f, user_id=9670bc1cee3a445088a63fd86584967f, role_id=36909bbf31d04993bb2a9fe587b572dc)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:52.635519 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bd3f4b-f22b-4672-bcdf-6be4f7ba2125 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:52.651859 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 109/227] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Mar 30 01:14:52 2022] PUT /identity/v3/projects/9a11dd1e0b1549e8b39995a2cbec195f/users/9670bc1cee3a445088a63fd86584967f/roles/36909bbf31d04993bb2a9fe587b572dc => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:14:52.654545 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bd3f4b-f22b-4672-bcdf-6be4f7ba2125 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:52.698777 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f9d1ed-6e5a-4a65-9d2c-36d04f41b1c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:52.700327 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f9d1ed-6e5a-4a65-9d2c-36d04f41b1c3 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:52.761722 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bd3f4b-f22b-4672-bcdf-6be4f7ba2125 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:52.798113 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb9f97a-5026-43e5-85bf-81b9e7d8cdc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:52.798823 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb9f97a-5026-43e5-85bf-81b9e7d8cdc4 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:52.799167 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb9f97a-5026-43e5-85bf-81b9e7d8cdc4 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:52.799445 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb9f97a-5026-43e5-85bf-81b9e7d8cdc4 None admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:52.800259 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb9f97a-5026-43e5-85bf-81b9e7d8cdc4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:14:52.800570 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb9f97a-5026-43e5-85bf-81b9e7d8cdc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:52.802147 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb9f97a-5026-43e5-85bf-81b9e7d8cdc4 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:52.806327 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 119/228] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Mar 30 01:14:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 30 01:14:52.811721 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 110/229] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Mar 30 01:14:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:52.812171 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f9d1ed-6e5a-4a65-9d2c-36d04f41b1c3 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:52.823799 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb9f97a-5026-43e5-85bf-81b9e7d8cdc4 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:52.919146 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f9d1ed-6e5a-4a65-9d2c-36d04f41b1c3 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:52.945667 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb9f97a-5026-43e5-85bf-81b9e7d8cdc4 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:52.960665 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a62df-aa51-4928-a8a8-2bdb2ab9b4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:52.961697 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a62df-aa51-4928-a8a8-2bdb2ab9b4ad None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:52.961697 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a62df-aa51-4928-a8a8-2bdb2ab9b4ad None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:52.961978 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a62df-aa51-4928-a8a8-2bdb2ab9b4ad None admin] PATH_INFO: `/v3/projects/9a11dd1e0b1549e8b39995a2cbec195f` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:52.963594 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a62df-aa51-4928-a8a8-2bdb2ab9b4ad None admin] RBAC: Authorizing `identity:get_project(project_id=9a11dd1e0b1549e8b39995a2cbec195f)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:52.964859 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a62df-aa51-4928-a8a8-2bdb2ab9b4ad None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:52.966910 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 120/230] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Mar 30 01:14:52 2022] GET /identity/v3/projects/9a11dd1e0b1549e8b39995a2cbec195f => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:14:52.972713 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a62df-aa51-4928-a8a8-2bdb2ab9b4ad None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:52.989450 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b31ac37-98d5-43fb-a63a-11a1332451e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:52.990747 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b31ac37-98d5-43fb-a63a-11a1332451e4 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:52.991238 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b31ac37-98d5-43fb-a63a-11a1332451e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:52.991680 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b31ac37-98d5-43fb-a63a-11a1332451e4 None admin] PATH_INFO: `/v3/users/9670bc1cee3a445088a63fd86584967f` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:52.993123 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b31ac37-98d5-43fb-a63a-11a1332451e4 None admin] RBAC: Authorizing `identity:get_user(user_id=9670bc1cee3a445088a63fd86584967f)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:52.994786 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b31ac37-98d5-43fb-a63a-11a1332451e4 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:52.996743 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 111/231] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Mar 30 01:14:52 2022] GET /identity/v3/users/9670bc1cee3a445088a63fd86584967f => generated 283 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:53.002142 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b31ac37-98d5-43fb-a63a-11a1332451e4 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:53.077657 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a62df-aa51-4928-a8a8-2bdb2ab9b4ad None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:53.105273 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b31ac37-98d5-43fb-a63a-11a1332451e4 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:53.112767 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8652cd4d-9ce3-40d1-8db2-12afcf607161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:53.113474 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652cd4d-9ce3-40d1-8db2-12afcf607161 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:53.113708 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652cd4d-9ce3-40d1-8db2-12afcf607161 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:53.114500 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652cd4d-9ce3-40d1-8db2-12afcf607161 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:53.115368 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8652cd4d-9ce3-40d1-8db2-12afcf607161 None admin] RBAC: Adding query filter params (role.id=7185d0cfbcd44502b1613bcfe1b42f6f, scope.project.id=9a11dd1e0b1549e8b39995a2cbec195f, user.id=1aaf73fd3ed348f1a90c21541630af19) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:14:53.115680 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8652cd4d-9ce3-40d1-8db2-12afcf607161 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:53.117136 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8652cd4d-9ce3-40d1-8db2-12afcf607161 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:53.123219 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 121/232] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Mar 30 01:14:52 2022] GET /identity/v3/role_assignments?user.id=1aaf73fd3ed348f1a90c21541630af19&scope.project.id=9a11dd1e0b1549e8b39995a2cbec195f&role.id=7185d0cfbcd44502b1613bcfe1b42f6f => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:53.144819 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfcb3a8-1c38-423a-bdfa-377f8981d19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:53.146539 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfcb3a8-1c38-423a-bdfa-377f8981d19c None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:53.147038 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfcb3a8-1c38-423a-bdfa-377f8981d19c None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:53.147505 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfcb3a8-1c38-423a-bdfa-377f8981d19c None admin] PATH_INFO: `/v3/projects/9a11dd1e0b1549e8b39995a2cbec195f` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:53.149126 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfcb3a8-1c38-423a-bdfa-377f8981d19c None admin] RBAC: Authorizing `identity:get_project(project_id=9a11dd1e0b1549e8b39995a2cbec195f)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:53.150910 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfcb3a8-1c38-423a-bdfa-377f8981d19c None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:53.153327 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 112/233] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Mar 30 01:14:53 2022] GET /identity/v3/projects/9a11dd1e0b1549e8b39995a2cbec195f => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:14:53.159064 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8652cd4d-9ce3-40d1-8db2-12afcf607161 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:53.280178 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8652cd4d-9ce3-40d1-8db2-12afcf607161 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:53.316850 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e34ae9-7eae-4d75-8623-bd16e40c8a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:53.318228 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e34ae9-7eae-4d75-8623-bd16e40c8a93 None admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:53.318514 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e34ae9-7eae-4d75-8623-bd16e40c8a93 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:53.318831 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e34ae9-7eae-4d75-8623-bd16e40c8a93 None admin] PATH_INFO: `/v3/projects/9a11dd1e0b1549e8b39995a2cbec195f/users/9670bc1cee3a445088a63fd86584967f/roles/7ab1dc76ea3e450689be4c2ab56097f4` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:53.321201 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e34ae9-7eae-4d75-8623-bd16e40c8a93 None admin] RBAC: Authorizing `identity:create_grant(project_id=9a11dd1e0b1549e8b39995a2cbec195f, user_id=9670bc1cee3a445088a63fd86584967f, role_id=7ab1dc76ea3e450689be4c2ab56097f4)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:53.322800 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e34ae9-7eae-4d75-8623-bd16e40c8a93 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:53.347667 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 122/234] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Mar 30 01:14:53 2022] PUT /identity/v3/projects/9a11dd1e0b1549e8b39995a2cbec195f/users/9670bc1cee3a445088a63fd86584967f/roles/7ab1dc76ea3e450689be4c2ab56097f4 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:14:54.825892 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2994bc20-e32c-4b7a-b835-87c3ab5c1bda None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:54.826389 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2994bc20-e32c-4b7a-b835-87c3ab5c1bda None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:54.826461 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2994bc20-e32c-4b7a-b835-87c3ab5c1bda None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:54.828514 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 113/235] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:14:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:14:54.834071 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f705688-259c-46d0-bd54-241577667015 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:54.834903 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f705688-259c-46d0-bd54-241577667015 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:54.835376 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f705688-259c-46d0-bd54-241577667015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:54.857320 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-4f705688-259c-46d0-bd54-241577667015 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:14:54.858837 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-4f705688-259c-46d0-bd54-241577667015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:14:54.939253 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 123/236] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:14:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 01:14:54.986314 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2994bc20-e32c-4b7a-b835-87c3ab5c1bda None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:55.074840 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818c90b-fdc4-47b1-86f4-b5e98d38ad87 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:55.075417 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818c90b-fdc4-47b1-86f4-b5e98d38ad87 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:55.075696 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818c90b-fdc4-47b1-86f4-b5e98d38ad87 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:55.078613 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 124/237] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:14:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:14:55.084432 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467996b-0e90-451d-9472-6ab172c835ee None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:55.084723 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467996b-0e90-451d-9472-6ab172c835ee None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:55.085000 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467996b-0e90-451d-9472-6ab172c835ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:55.104637 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-a467996b-0e90-451d-9472-6ab172c835ee None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:14:55.105980 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-a467996b-0e90-451d-9472-6ab172c835ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:14:55.127576 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2994bc20-e32c-4b7a-b835-87c3ab5c1bda None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:55.198468 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451eee2d-7108-4891-8668-07a8c7f8d42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:55.199217 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451eee2d-7108-4891-8668-07a8c7f8d42d None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:55.199496 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451eee2d-7108-4891-8668-07a8c7f8d42d None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:55.199767 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451eee2d-7108-4891-8668-07a8c7f8d42d None admin] PATH_INFO: `/v3/domains/default` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:55.201142 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451eee2d-7108-4891-8668-07a8c7f8d42d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:55.205620 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451eee2d-7108-4891-8668-07a8c7f8d42d None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:55.205620 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 114/238] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:14:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:55.210083 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451eee2d-7108-4891-8668-07a8c7f8d42d None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:55.238199 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 125/239] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:14:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 30 01:14:55.286369 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a467996b-0e90-451d-9472-6ab172c835ee None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:55.322427 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451eee2d-7108-4891-8668-07a8c7f8d42d None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:55.356283 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49dbe39-0f9b-4bbb-ae46-9c3d8af4f47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:55.357379 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49dbe39-0f9b-4bbb-ae46-9c3d8af4f47a None admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:55.357379 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49dbe39-0f9b-4bbb-ae46-9c3d8af4f47a None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:55.357567 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49dbe39-0f9b-4bbb-ae46-9c3d8af4f47a None admin] PATH_INFO: `/v3/users` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:55.358200 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49dbe39-0f9b-4bbb-ae46-9c3d8af4f47a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:55.359677 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49dbe39-0f9b-4bbb-ae46-9c3d8af4f47a None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:55.388243 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 115/240] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Mar 30 01:14:55 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:14:55.481751 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a467996b-0e90-451d-9472-6ab172c835ee None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:55.531247 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f856f04a-92f6-4d78-a197-364a341a4a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:55.532440 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856f04a-92f6-4d78-a197-364a341a4a12 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:55.532924 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856f04a-92f6-4d78-a197-364a341a4a12 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:55.533394 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856f04a-92f6-4d78-a197-364a341a4a12 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:55.546884 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f856f04a-92f6-4d78-a197-364a341a4a12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:14:55.555036 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-f856f04a-92f6-4d78-a197-364a341a4a12 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 30 01:14:55.556981 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 126/241] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Mar 30 01:14:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:14:55.562761 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49dbe39-0f9b-4bbb-ae46-9c3d8af4f47a None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:55.646360 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb9673-66fc-4278-aafb-8203516eb977 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:55.647010 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb9673-66fc-4278-aafb-8203516eb977 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:55.647511 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb9673-66fc-4278-aafb-8203516eb977 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:55.649749 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 127/242] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:14:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:14:55.656099 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2370ce80-ead5-44d6-88c4-30b848eccc9d None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:55.656687 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2370ce80-ead5-44d6-88c4-30b848eccc9d None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:55.657154 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2370ce80-ead5-44d6-88c4-30b848eccc9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:55.684892 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-2370ce80-ead5-44d6-88c4-30b848eccc9d None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:14:55.686480 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-2370ce80-ead5-44d6-88c4-30b848eccc9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:14:55.725411 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49dbe39-0f9b-4bbb-ae46-9c3d8af4f47a None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:55.761694 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5ecd5b-8e8f-42ee-a0bf-fac9732c22fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:55.762781 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ecd5b-8e8f-42ee-a0bf-fac9732c22fe None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:55.763319 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ecd5b-8e8f-42ee-a0bf-fac9732c22fe None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:55.763786 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ecd5b-8e8f-42ee-a0bf-fac9732c22fe None admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:55.764723 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5ecd5b-8e8f-42ee-a0bf-fac9732c22fe None admin] RBAC: Adding query filter params (name=reader) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:14:55.765230 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5ecd5b-8e8f-42ee-a0bf-fac9732c22fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:55.766976 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5ecd5b-8e8f-42ee-a0bf-fac9732c22fe None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:55.777470 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 128/244] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:14:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 01:14:55.777793 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 116/244] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Mar 30 01:14:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:55.786149 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2370ce80-ead5-44d6-88c4-30b848eccc9d None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:55.803488 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5ecd5b-8e8f-42ee-a0bf-fac9732c22fe None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:55.888431 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2370ce80-ead5-44d6-88c4-30b848eccc9d None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:55.914522 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5ecd5b-8e8f-42ee-a0bf-fac9732c22fe None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:55.923824 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f10881-acda-49ce-80c8-672a47e2870d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:55.924974 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f10881-acda-49ce-80c8-672a47e2870d None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:55.925390 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f10881-acda-49ce-80c8-672a47e2870d None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:55.925813 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f10881-acda-49ce-80c8-672a47e2870d None admin] PATH_INFO: `/v3/users/4858a435a9f7459282b670ec7b676973` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:55.940161 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f10881-acda-49ce-80c8-672a47e2870d None admin] RBAC: Authorizing `identity:get_user(user_id=4858a435a9f7459282b670ec7b676973)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:55.942393 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f10881-acda-49ce-80c8-672a47e2870d None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:55.944359 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 129/245] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Mar 30 01:14:55 2022] GET /identity/v3/users/4858a435a9f7459282b670ec7b676973 => generated 297 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:55.950381 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f10881-acda-49ce-80c8-672a47e2870d None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:55.956734 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a98e8-1a39-49ed-9cba-888661e29060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:55.957671 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a98e8-1a39-49ed-9cba-888661e29060 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:55.958050 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a98e8-1a39-49ed-9cba-888661e29060 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:55.958433 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a98e8-1a39-49ed-9cba-888661e29060 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:55.971871 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371a98e8-1a39-49ed-9cba-888661e29060 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:14:55.981660 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-371a98e8-1a39-49ed-9cba-888661e29060 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 30 01:14:55.986779 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 117/246] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Mar 30 01:14:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 01:14:55.995915 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a98e8-1a39-49ed-9cba-888661e29060 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:56.068792 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f10881-acda-49ce-80c8-672a47e2870d None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:56.115450 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a98e8-1a39-49ed-9cba-888661e29060 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:56.116414 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e75535b-4238-4e17-8a73-352601a58e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:56.117473 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e75535b-4238-4e17-8a73-352601a58e7a None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:56.117944 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e75535b-4238-4e17-8a73-352601a58e7a None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:56.119131 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e75535b-4238-4e17-8a73-352601a58e7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:56.157663 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7125752d-ead9-4fc0-8564-ab77c61cd1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:56.159170 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125752d-ead9-4fc0-8564-ab77c61cd1ae None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:56.159170 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125752d-ead9-4fc0-8564-ab77c61cd1ae None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:56.159170 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125752d-ead9-4fc0-8564-ab77c61cd1ae None admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:56.159725 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7125752d-ead9-4fc0-8564-ab77c61cd1ae None admin] RBAC: Adding query filter params (name=admin) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:14:56.160042 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7125752d-ead9-4fc0-8564-ab77c61cd1ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:56.161727 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7125752d-ead9-4fc0-8564-ab77c61cd1ae None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:56.173101 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 118/247] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Mar 30 01:14:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:14:56.174471 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee0164-150a-41b8-88cf-ea01ce1745f3 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:56.174808 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee0164-150a-41b8-88cf-ea01ce1745f3 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:56.175092 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee0164-150a-41b8-88cf-ea01ce1745f3 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:56.177305 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 119/248] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:14:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:14:56.183620 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315fbb68-6acb-4a34-a8ec-0fd368c8235a None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:56.183858 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315fbb68-6acb-4a34-a8ec-0fd368c8235a None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:56.184141 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315fbb68-6acb-4a34-a8ec-0fd368c8235a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:56.204598 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-315fbb68-6acb-4a34-a8ec-0fd368c8235a None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:14:56.205776 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-315fbb68-6acb-4a34-a8ec-0fd368c8235a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:14:56.212579 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e75535b-4238-4e17-8a73-352601a58e7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:56.214318 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e75535b-4238-4e17-8a73-352601a58e7a None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:56.277735 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 120/249] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:14:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 30 01:14:56.278962 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315fbb68-6acb-4a34-a8ec-0fd368c8235a None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:56.328610 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 130/250] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Mar 30 01:14:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 30 01:14:56.329233 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e75535b-4238-4e17-8a73-352601a58e7a None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:56.399862 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315fbb68-6acb-4a34-a8ec-0fd368c8235a None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:56.441638 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e75535b-4238-4e17-8a73-352601a58e7a None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:56.442981 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b130ea3-9f97-4c3d-ac1d-28454ff26758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:56.444183 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b130ea3-9f97-4c3d-ac1d-28454ff26758 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:56.444602 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b130ea3-9f97-4c3d-ac1d-28454ff26758 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:56.445778 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b130ea3-9f97-4c3d-ac1d-28454ff26758 None admin] PATH_INFO: `/v3/users/9670bc1cee3a445088a63fd86584967f` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:56.447210 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b130ea3-9f97-4c3d-ac1d-28454ff26758 None admin] RBAC: Authorizing `identity:get_user(user_id=9670bc1cee3a445088a63fd86584967f)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:56.448783 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b130ea3-9f97-4c3d-ac1d-28454ff26758 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:56.455053 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 121/251] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Mar 30 01:14:56 2022] GET /identity/v3/users/9670bc1cee3a445088a63fd86584967f => generated 283 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:56.456081 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b130ea3-9f97-4c3d-ac1d-28454ff26758 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:56.500715 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d23beb-76a7-4975-9194-28bd48dc2c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:56.501519 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d23beb-76a7-4975-9194-28bd48dc2c0f None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:56.501802 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d23beb-76a7-4975-9194-28bd48dc2c0f None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:56.502076 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d23beb-76a7-4975-9194-28bd48dc2c0f None admin] PATH_INFO: `/v3/roles/member` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:56.527027 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d23beb-76a7-4975-9194-28bd48dc2c0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:14:56.542161 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-59d23beb-76a7-4975-9194-28bd48dc2c0f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 30 01:14:56.547685 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 131/252] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Mar 30 01:14:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:14:56.548493 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d23beb-76a7-4975-9194-28bd48dc2c0f None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:56.657790 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b130ea3-9f97-4c3d-ac1d-28454ff26758 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:56.694743 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a13c388-6596-4506-aa72-09ebc6b38eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:56.695607 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a13c388-6596-4506-aa72-09ebc6b38eae None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:56.695883 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a13c388-6596-4506-aa72-09ebc6b38eae None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:56.696153 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a13c388-6596-4506-aa72-09ebc6b38eae None admin] PATH_INFO: `/v3/projects/9a11dd1e0b1549e8b39995a2cbec195f` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:56.697332 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a13c388-6596-4506-aa72-09ebc6b38eae None admin] RBAC: Authorizing `identity:get_project(project_id=9a11dd1e0b1549e8b39995a2cbec195f)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:56.698795 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a13c388-6596-4506-aa72-09ebc6b38eae None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:56.700607 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 122/253] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Mar 30 01:14:56 2022] GET /identity/v3/projects/9a11dd1e0b1549e8b39995a2cbec195f => generated 302 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:56.701444 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a13c388-6596-4506-aa72-09ebc6b38eae None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:56.717595 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d23beb-76a7-4975-9194-28bd48dc2c0f None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:56.751793 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca9fd7-b1ab-4db7-b527-5a98c89fb1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:56.752443 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca9fd7-b1ab-4db7-b527-5a98c89fb1d2 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:56.752729 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca9fd7-b1ab-4db7-b527-5a98c89fb1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:56.753007 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca9fd7-b1ab-4db7-b527-5a98c89fb1d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:56.800529 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a13c388-6596-4506-aa72-09ebc6b38eae None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:56.822724 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adca9fd7-b1ab-4db7-b527-5a98c89fb1d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:56.824195 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adca9fd7-b1ab-4db7-b527-5a98c89fb1d2 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:56.835633 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f24363-4e79-4655-bdab-c8edfef5feb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:56.836327 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f24363-4e79-4655-bdab-c8edfef5feb4 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:56.836604 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f24363-4e79-4655-bdab-c8edfef5feb4 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:56.836874 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f24363-4e79-4655-bdab-c8edfef5feb4 None admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:56.837623 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f24363-4e79-4655-bdab-c8edfef5feb4 None admin] RBAC: Adding query filter params (name=member) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:14:56.837925 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f24363-4e79-4655-bdab-c8edfef5feb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:56.839323 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f24363-4e79-4655-bdab-c8edfef5feb4 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:56.847667 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 123/254] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Mar 30 01:14:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:56.848942 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033c352-1119-4108-8518-ed1cf818fe97 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:56.849264 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033c352-1119-4108-8518-ed1cf818fe97 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:56.849541 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033c352-1119-4108-8518-ed1cf818fe97 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:56.855205 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 124/255] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:14:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:14:56.856013 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e033c352-1119-4108-8518-ed1cf818fe97 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:56.925454 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 132/256] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Mar 30 01:14:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 30 01:14:56.926069 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca9fd7-b1ab-4db7-b527-5a98c89fb1d2 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:56.962924 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e033c352-1119-4108-8518-ed1cf818fe97 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:56.998163 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faeaa0c-4c7f-4dce-8dae-a013e5635482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:56.998842 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faeaa0c-4c7f-4dce-8dae-a013e5635482 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:56.999126 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faeaa0c-4c7f-4dce-8dae-a013e5635482 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:56.999393 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faeaa0c-4c7f-4dce-8dae-a013e5635482 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:57.000214 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faeaa0c-4c7f-4dce-8dae-a013e5635482 None admin] RBAC: Adding query filter params (role.id=1dffd8c286fa4de1b7a059d5c5da54f8, scope.project.id=9a11dd1e0b1549e8b39995a2cbec195f, user.id=4858a435a9f7459282b670ec7b676973) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:14:57.000517 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faeaa0c-4c7f-4dce-8dae-a013e5635482 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:57.001942 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faeaa0c-4c7f-4dce-8dae-a013e5635482 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:57.008468 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 125/257] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Mar 30 01:14:56 2022] GET /identity/v3/role_assignments?user.id=4858a435a9f7459282b670ec7b676973&scope.project.id=9a11dd1e0b1549e8b39995a2cbec195f&role.id=1dffd8c286fa4de1b7a059d5c5da54f8 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:57.009577 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38649864-5167-4265-9cdd-d22039a993c6 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:57.009867 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38649864-5167-4265-9cdd-d22039a993c6 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:57.010282 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38649864-5167-4265-9cdd-d22039a993c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:57.027344 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-38649864-5167-4265-9cdd-d22039a993c6 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:14:57.028529 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-38649864-5167-4265-9cdd-d22039a993c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:14:57.052124 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca9fd7-b1ab-4db7-b527-5a98c89fb1d2 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:57.096264 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c8a222-ed33-4a60-be2c-5765ccf3eba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:57.097194 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8a222-ed33-4a60-be2c-5765ccf3eba7 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:57.097476 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8a222-ed33-4a60-be2c-5765ccf3eba7 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:57.097800 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8a222-ed33-4a60-be2c-5765ccf3eba7 None admin] PATH_INFO: `/v3/users/1aaf73fd3ed348f1a90c21541630af19` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:57.099206 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c8a222-ed33-4a60-be2c-5765ccf3eba7 None admin] RBAC: Authorizing `identity:get_user(user_id=1aaf73fd3ed348f1a90c21541630af19)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:57.100113 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 126/258] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:14:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 01:14:57.100969 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c8a222-ed33-4a60-be2c-5765ccf3eba7 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:57.103058 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 133/259] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Mar 30 01:14:56 2022] GET /identity/v3/users/1aaf73fd3ed348f1a90c21541630af19 => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:57.103965 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38649864-5167-4265-9cdd-d22039a993c6 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:57.108474 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c8a222-ed33-4a60-be2c-5765ccf3eba7 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:57.217533 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c8a222-ed33-4a60-be2c-5765ccf3eba7 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:57.228852 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38649864-5167-4265-9cdd-d22039a993c6 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:57.255888 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847c445e-5af4-4839-8f64-ab2042422a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:57.256861 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847c445e-5af4-4839-8f64-ab2042422a76 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:57.257143 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847c445e-5af4-4839-8f64-ab2042422a76 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:57.257415 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847c445e-5af4-4839-8f64-ab2042422a76 None admin] PATH_INFO: `/v3/projects/9a11dd1e0b1549e8b39995a2cbec195f` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:57.258849 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847c445e-5af4-4839-8f64-ab2042422a76 None admin] RBAC: Authorizing `identity:get_project(project_id=9a11dd1e0b1549e8b39995a2cbec195f)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:57.260375 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847c445e-5af4-4839-8f64-ab2042422a76 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:57.262512 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 134/260] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Mar 30 01:14:57 2022] GET /identity/v3/projects/9a11dd1e0b1549e8b39995a2cbec195f => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:57.263374 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847c445e-5af4-4839-8f64-ab2042422a76 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:57.268591 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4154fbdc-3fa5-419e-a6fa-824498e808bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:57.269474 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4154fbdc-3fa5-419e-a6fa-824498e808bc None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:57.269756 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4154fbdc-3fa5-419e-a6fa-824498e808bc None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:57.270131 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4154fbdc-3fa5-419e-a6fa-824498e808bc None admin] PATH_INFO: `/v3/projects/9a11dd1e0b1549e8b39995a2cbec195f` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:57.271568 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4154fbdc-3fa5-419e-a6fa-824498e808bc None admin] RBAC: Authorizing `identity:get_project(project_id=9a11dd1e0b1549e8b39995a2cbec195f)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:57.273050 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4154fbdc-3fa5-419e-a6fa-824498e808bc None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:57.274954 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 127/261] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Mar 30 01:14:57 2022] GET /identity/v3/projects/9a11dd1e0b1549e8b39995a2cbec195f => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:57.279601 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4154fbdc-3fa5-419e-a6fa-824498e808bc None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:57.373008 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847c445e-5af4-4839-8f64-ab2042422a76 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:57.384111 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4154fbdc-3fa5-419e-a6fa-824498e808bc None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:57.409733 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8050a2-2ca6-48c4-855d-c0f2c2ff2bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:57.410551 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8050a2-2ca6-48c4-855d-c0f2c2ff2bb0 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:57.411392 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8050a2-2ca6-48c4-855d-c0f2c2ff2bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:57.411668 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8050a2-2ca6-48c4-855d-c0f2c2ff2bb0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:57.420583 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4238734e-e3b4-455c-a74d-4cc48ae727c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:57.421471 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238734e-e3b4-455c-a74d-4cc48ae727c6 None admin] REQUEST_METHOD: `PUT` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:57.421747 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238734e-e3b4-455c-a74d-4cc48ae727c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:57.422019 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238734e-e3b4-455c-a74d-4cc48ae727c6 None admin] PATH_INFO: `/v3/projects/9a11dd1e0b1549e8b39995a2cbec195f/users/1aaf73fd3ed348f1a90c21541630af19/roles/7185d0cfbcd44502b1613bcfe1b42f6f` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:57.422430 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8050a2-2ca6-48c4-855d-c0f2c2ff2bb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:14:57.423997 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4238734e-e3b4-455c-a74d-4cc48ae727c6 None admin] RBAC: Authorizing `identity:create_grant(project_id=9a11dd1e0b1549e8b39995a2cbec195f, user_id=1aaf73fd3ed348f1a90c21541630af19, role_id=7185d0cfbcd44502b1613bcfe1b42f6f)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:57.425442 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4238734e-e3b4-455c-a74d-4cc48ae727c6 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:57.430238 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-2d8050a2-2ca6-48c4-855d-c0f2c2ff2bb0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 30 01:14:57.431859 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 135/262] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Mar 30 01:14:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:14:57.432708 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8050a2-2ca6-48c4-855d-c0f2c2ff2bb0 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:57.454924 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 128/263] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Mar 30 01:14:57 2022] PUT /identity/v3/projects/9a11dd1e0b1549e8b39995a2cbec195f/users/1aaf73fd3ed348f1a90c21541630af19/roles/7185d0cfbcd44502b1613bcfe1b42f6f => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:14:57.456006 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4238734e-e3b4-455c-a74d-4cc48ae727c6 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:57.619418 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8050a2-2ca6-48c4-855d-c0f2c2ff2bb0 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:57.653682 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4238734e-e3b4-455c-a74d-4cc48ae727c6 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:57.682071 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c363c32-8fb9-42c9-9e4e-cc1828c4ff8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:57.682760 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c363c32-8fb9-42c9-9e4e-cc1828c4ff8e None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:57.683044 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c363c32-8fb9-42c9-9e4e-cc1828c4ff8e None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:57.683368 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c363c32-8fb9-42c9-9e4e-cc1828c4ff8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:57.684217 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c363c32-8fb9-42c9-9e4e-cc1828c4ff8e None admin] RBAC: Adding query filter params (role.id=36909bbf31d04993bb2a9fe587b572dc, scope.project.id=9a11dd1e0b1549e8b39995a2cbec195f, user.id=9670bc1cee3a445088a63fd86584967f) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:14:57.684524 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c363c32-8fb9-42c9-9e4e-cc1828c4ff8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:57.686010 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c363c32-8fb9-42c9-9e4e-cc1828c4ff8e None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:57.697840 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 136/264] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Mar 30 01:14:57 2022] GET /identity/v3/role_assignments?user.id=9670bc1cee3a445088a63fd86584967f&scope.project.id=9a11dd1e0b1549e8b39995a2cbec195f&role.id=36909bbf31d04993bb2a9fe587b572dc => generated 608 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:57.714975 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2b8535-fba4-4785-940d-f640d1211ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:57.715885 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b8535-fba4-4785-940d-f640d1211ca7 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:57.716326 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b8535-fba4-4785-940d-f640d1211ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:57.716756 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b8535-fba4-4785-940d-f640d1211ca7 None admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:57.717677 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2b8535-fba4-4785-940d-f640d1211ca7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:14:57.718163 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2b8535-fba4-4785-940d-f640d1211ca7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:57.719767 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2b8535-fba4-4785-940d-f640d1211ca7 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:57.735174 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 129/265] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Mar 30 01:14:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:57.741719 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c363c32-8fb9-42c9-9e4e-cc1828c4ff8e None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:57.873522 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c363c32-8fb9-42c9-9e4e-cc1828c4ff8e None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:57.915256 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383838fc-4000-4568-b8c8-a2a47c156350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:57.916147 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383838fc-4000-4568-b8c8-a2a47c156350 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:57.916424 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383838fc-4000-4568-b8c8-a2a47c156350 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:57.916700 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383838fc-4000-4568-b8c8-a2a47c156350 None admin] PATH_INFO: `/v3/users/9670bc1cee3a445088a63fd86584967f` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:57.922397 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383838fc-4000-4568-b8c8-a2a47c156350 None admin] RBAC: Authorizing `identity:get_user(user_id=9670bc1cee3a445088a63fd86584967f)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:57.923918 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383838fc-4000-4568-b8c8-a2a47c156350 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:57.925641 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 137/266] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Mar 30 01:14:57 2022] GET /identity/v3/users/9670bc1cee3a445088a63fd86584967f => generated 283 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:57.932243 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2b8535-fba4-4785-940d-f640d1211ca7 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:58.082799 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2b8535-fba4-4785-940d-f640d1211ca7 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:58.130012 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fadc029-e97a-4df1-ad75-796adbf6b830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:58.130722 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fadc029-e97a-4df1-ad75-796adbf6b830 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:58.131009 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fadc029-e97a-4df1-ad75-796adbf6b830 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:58.131285 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fadc029-e97a-4df1-ad75-796adbf6b830 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:58.215625 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fadc029-e97a-4df1-ad75-796adbf6b830 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:58.217087 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fadc029-e97a-4df1-ad75-796adbf6b830 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:58.322751 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 130/267] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Mar 30 01:14:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 30 01:14:58.331806 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383838fc-4000-4568-b8c8-a2a47c156350 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:58.468026 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383838fc-4000-4568-b8c8-a2a47c156350 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:58.508379 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aa9d5b-d4ed-4d12-84d8-b78a115e7330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:58.509258 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa9d5b-d4ed-4d12-84d8-b78a115e7330 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:58.509540 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa9d5b-d4ed-4d12-84d8-b78a115e7330 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:58.509816 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa9d5b-d4ed-4d12-84d8-b78a115e7330 None admin] PATH_INFO: `/v3/projects/9a11dd1e0b1549e8b39995a2cbec195f` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:58.511048 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aa9d5b-d4ed-4d12-84d8-b78a115e7330 None admin] RBAC: Authorizing `identity:get_project(project_id=9a11dd1e0b1549e8b39995a2cbec195f)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:58.512509 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aa9d5b-d4ed-4d12-84d8-b78a115e7330 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:58.514508 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 138/268] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Mar 30 01:14:58 2022] GET /identity/v3/projects/9a11dd1e0b1549e8b39995a2cbec195f => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:58.520961 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fadc029-e97a-4df1-ad75-796adbf6b830 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:58.641532 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fadc029-e97a-4df1-ad75-796adbf6b830 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:58.654645 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea3651-44f8-4e3c-b032-9a08af64bc47 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:58.654645 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea3651-44f8-4e3c-b032-9a08af64bc47 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:58.654645 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea3651-44f8-4e3c-b032-9a08af64bc47 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:58.654645 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 139/269] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:14:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 01:14:58.660006 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66534ba6-ff75-428a-b162-879d8f707def None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:58.660299 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66534ba6-ff75-428a-b162-879d8f707def None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:58.661104 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66534ba6-ff75-428a-b162-879d8f707def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:58.694990 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-66534ba6-ff75-428a-b162-879d8f707def None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:14:58.696198 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-66534ba6-ff75-428a-b162-879d8f707def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:14:58.708783 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529d1c15-611f-49df-abd8-1453358022ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:58.709452 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d1c15-611f-49df-abd8-1453358022ff None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:58.709733 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d1c15-611f-49df-abd8-1453358022ff None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:58.710008 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d1c15-611f-49df-abd8-1453358022ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:58.710873 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529d1c15-611f-49df-abd8-1453358022ff None admin] RBAC: Adding query filter params (role.id=7ab1dc76ea3e450689be4c2ab56097f4, scope.project.id=9a11dd1e0b1549e8b39995a2cbec195f, user.id=9670bc1cee3a445088a63fd86584967f) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:14:58.711184 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529d1c15-611f-49df-abd8-1453358022ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:58.712634 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529d1c15-611f-49df-abd8-1453358022ff None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:58.723998 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 131/270] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Mar 30 01:14:58 2022] GET /identity/v3/role_assignments?user.id=9670bc1cee3a445088a63fd86584967f&scope.project.id=9a11dd1e0b1549e8b39995a2cbec195f&role.id=7ab1dc76ea3e450689be4c2ab56097f4 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:58.779106 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94dc512-e9d2-4acb-b4f3-93da178b8342 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:58.779771 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94dc512-e9d2-4acb-b4f3-93da178b8342 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:58.780504 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94dc512-e9d2-4acb-b4f3-93da178b8342 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:58.782791 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 132/271] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:14:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 01:14:58.789409 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32201b20-8fcc-41e1-805b-15abcd058584 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:58.790028 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32201b20-8fcc-41e1-805b-15abcd058584 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:58.790529 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32201b20-8fcc-41e1-805b-15abcd058584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:58.810636 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 140/272] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:14:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 01:14:58.816541 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-32201b20-8fcc-41e1-805b-15abcd058584 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:14:58.818640 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-32201b20-8fcc-41e1-805b-15abcd058584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:14:58.856124 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66534ba6-ff75-428a-b162-879d8f707def None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:58.940201 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 133/273] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:14:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 30 01:14:58.965392 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32201b20-8fcc-41e1-805b-15abcd058584 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:59.000714 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66534ba6-ff75-428a-b162-879d8f707def None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:59.042815 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a57fcb9-a2ba-4199-80b7-2497ef7dbeb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:59.043622 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a57fcb9-a2ba-4199-80b7-2497ef7dbeb0 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:59.043901 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a57fcb9-a2ba-4199-80b7-2497ef7dbeb0 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:59.044176 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a57fcb9-a2ba-4199-80b7-2497ef7dbeb0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:59.045616 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a57fcb9-a2ba-4199-80b7-2497ef7dbeb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:59.047880 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a57fcb9-a2ba-4199-80b7-2497ef7dbeb0 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:59.049843 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 141/274] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:14:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:14:59.056732 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a57fcb9-a2ba-4199-80b7-2497ef7dbeb0 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:59.086669 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32201b20-8fcc-41e1-805b-15abcd058584 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:59.172127 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a57fcb9-a2ba-4199-80b7-2497ef7dbeb0 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:59.211168 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d592a349-3a86-4060-b216-a689a66036f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:59.212225 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592a349-3a86-4060-b216-a689a66036f7 None admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:59.212711 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592a349-3a86-4060-b216-a689a66036f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:59.213167 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592a349-3a86-4060-b216-a689a66036f7 None admin] PATH_INFO: `/v3/users` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:59.214085 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d592a349-3a86-4060-b216-a689a66036f7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:59.215824 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d592a349-3a86-4060-b216-a689a66036f7 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:59.247012 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 142/275] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Mar 30 01:14:59 2022] POST /identity/v3/users => generated 293 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 01:14:59.255595 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d847381e-c7b7-4ec4-9d27-bc3884108b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:59.256339 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d847381e-c7b7-4ec4-9d27-bc3884108b25 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:59.256625 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d847381e-c7b7-4ec4-9d27-bc3884108b25 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:59.256898 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d847381e-c7b7-4ec4-9d27-bc3884108b25 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:59.273581 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d847381e-c7b7-4ec4-9d27-bc3884108b25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:14:59.281119 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-d847381e-c7b7-4ec4-9d27-bc3884108b25 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 30 01:14:59.282397 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 134/276] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Mar 30 01:14:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 01:14:59.288662 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d592a349-3a86-4060-b216-a689a66036f7 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:59.398739 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d592a349-3a86-4060-b216-a689a66036f7 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:59.435264 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f9a64d-02ba-4347-b494-67de9882d040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:59.436203 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9a64d-02ba-4347-b494-67de9882d040 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:59.436624 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9a64d-02ba-4347-b494-67de9882d040 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:59.437094 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9a64d-02ba-4347-b494-67de9882d040 None admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:59.437974 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f9a64d-02ba-4347-b494-67de9882d040 None admin] RBAC: Adding query filter params (name=member) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:14:59.438469 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f9a64d-02ba-4347-b494-67de9882d040 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:59.440212 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f9a64d-02ba-4347-b494-67de9882d040 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:59.449672 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 143/277] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Mar 30 01:14:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:59.456335 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d847381e-c7b7-4ec4-9d27-bc3884108b25 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:59.560046 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d847381e-c7b7-4ec4-9d27-bc3884108b25 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:59.597849 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c0eafa-b00f-4b67-a5e1-2358c4ec80e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:59.599292 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0eafa-b00f-4b67-a5e1-2358c4ec80e7 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:59.599565 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0eafa-b00f-4b67-a5e1-2358c4ec80e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:59.599834 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0eafa-b00f-4b67-a5e1-2358c4ec80e7 None admin] PATH_INFO: `/v3/users/65d642d74c21424d8f89491c13f2cf06` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:59.615979 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c0eafa-b00f-4b67-a5e1-2358c4ec80e7 None admin] RBAC: Authorizing `identity:get_user(user_id=65d642d74c21424d8f89491c13f2cf06)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:59.617480 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c0eafa-b00f-4b67-a5e1-2358c4ec80e7 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:59.619854 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 135/278] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Mar 30 01:14:59 2022] GET /identity/v3/users/65d642d74c21424d8f89491c13f2cf06 => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:14:59.625169 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f9a64d-02ba-4347-b494-67de9882d040 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:14:59.740617 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f9a64d-02ba-4347-b494-67de9882d040 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:14:59.783445 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156402ef-9e35-466c-9e00-8347c844898e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:14:59.784097 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156402ef-9e35-466c-9e00-8347c844898e None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:14:59.784380 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156402ef-9e35-466c-9e00-8347c844898e None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:14:59.784655 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156402ef-9e35-466c-9e00-8347c844898e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:14:59.785485 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156402ef-9e35-466c-9e00-8347c844898e None admin] RBAC: Adding query filter params (role.id=7185d0cfbcd44502b1613bcfe1b42f6f, user.id=65d642d74c21424d8f89491c13f2cf06, scope.system=all) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:14:59.786342 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156402ef-9e35-466c-9e00-8347c844898e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:14:59.787873 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156402ef-9e35-466c-9e00-8347c844898e None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:14:59.794652 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 144/279] 10.222.0.30 () {56 vars in 1308 bytes} [Wed Mar 30 01:14:59 2022] GET /identity/v3/role_assignments?user.id=65d642d74c21424d8f89491c13f2cf06&scope.system=all&role.id=7185d0cfbcd44502b1613bcfe1b42f6f => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:00.267432 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41315554-903b-4a89-b53b-8180f19fabc6 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:00.267942 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41315554-903b-4a89-b53b-8180f19fabc6 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:00.268016 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41315554-903b-4a89-b53b-8180f19fabc6 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:00.270350 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 136/280] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:15:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:15:00.275723 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521881d-e1c6-4470-b92a-9381ce482fd1 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:00.276144 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521881d-e1c6-4470-b92a-9381ce482fd1 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:00.276316 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521881d-e1c6-4470-b92a-9381ce482fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:00.294308 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-9521881d-e1c6-4470-b92a-9381ce482fd1 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:15:00.299959 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-9521881d-e1c6-4470-b92a-9381ce482fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:15:00.369656 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 145/281] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:15:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 01:15:00.404632 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41315554-903b-4a89-b53b-8180f19fabc6 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:00.520777 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41315554-903b-4a89-b53b-8180f19fabc6 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:00.550022 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aad848-0cf1-4e55-b435-f68731d3428c None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:00.550344 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aad848-0cf1-4e55-b435-f68731d3428c None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:00.550598 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aad848-0cf1-4e55-b435-f68731d3428c None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:00.553738 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 146/282] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:15:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:15:00.558281 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d428d1-d793-4a20-a311-d3910909ffb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:00.558867 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac70b3e5-6f5f-4552-bfda-1866da8394e2 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:00.559150 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac70b3e5-6f5f-4552-bfda-1866da8394e2 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:00.559253 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d428d1-d793-4a20-a311-d3910909ffb0 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:00.559424 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac70b3e5-6f5f-4552-bfda-1866da8394e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:00.559519 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d428d1-d793-4a20-a311-d3910909ffb0 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:00.559681 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d428d1-d793-4a20-a311-d3910909ffb0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:00.570507 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d428d1-d793-4a20-a311-d3910909ffb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:15:00.577440 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-58d428d1-d793-4a20-a311-d3910909ffb0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 30 01:15:00.579014 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 137/283] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Mar 30 01:15:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:00.589750 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-ac70b3e5-6f5f-4552-bfda-1866da8394e2 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:15:00.590956 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-ac70b3e5-6f5f-4552-bfda-1866da8394e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:15:00.591656 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d428d1-d793-4a20-a311-d3910909ffb0 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:00.706355 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d428d1-d793-4a20-a311-d3910909ffb0 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:00.740446 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 147/284] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:15:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 01:15:00.766190 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f77c88f-1920-4035-a687-524c2400eaf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:00.766892 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f77c88f-1920-4035-a687-524c2400eaf1 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:00.767178 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f77c88f-1920-4035-a687-524c2400eaf1 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:00.767456 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f77c88f-1920-4035-a687-524c2400eaf1 None admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:00.768215 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f77c88f-1920-4035-a687-524c2400eaf1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:00.768520 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f77c88f-1920-4035-a687-524c2400eaf1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:00.770403 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f77c88f-1920-4035-a687-524c2400eaf1 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:00.787836 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac70b3e5-6f5f-4552-bfda-1866da8394e2 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:00.788637 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 138/285] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Mar 30 01:15:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:00.802263 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f77c88f-1920-4035-a687-524c2400eaf1 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:00.900012 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac70b3e5-6f5f-4552-bfda-1866da8394e2 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:00.948748 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c86d476-0fed-4207-a67d-d52fd7fc08cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:00.949974 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86d476-0fed-4207-a67d-d52fd7fc08cc None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:00.950448 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86d476-0fed-4207-a67d-d52fd7fc08cc None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:00.950939 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86d476-0fed-4207-a67d-d52fd7fc08cc None admin] PATH_INFO: `/v3/users/4858a435a9f7459282b670ec7b676973` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:00.955400 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c86d476-0fed-4207-a67d-d52fd7fc08cc None admin] RBAC: Authorizing `identity:get_user(user_id=4858a435a9f7459282b670ec7b676973)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:00.957096 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c86d476-0fed-4207-a67d-d52fd7fc08cc None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:00.960580 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 148/286] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Mar 30 01:15:00 2022] GET /identity/v3/users/4858a435a9f7459282b670ec7b676973 => generated 297 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:00.965134 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c86d476-0fed-4207-a67d-d52fd7fc08cc None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:00.975775 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f77c88f-1920-4035-a687-524c2400eaf1 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:01.023942 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ee4b2-a455-4883-855c-fd082019cff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:01.024739 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ee4b2-a455-4883-855c-fd082019cff4 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:01.025023 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ee4b2-a455-4883-855c-fd082019cff4 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:01.025302 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ee4b2-a455-4883-855c-fd082019cff4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:01.043741 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009ee4b2-a455-4883-855c-fd082019cff4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:15:01.050574 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-009ee4b2-a455-4883-855c-fd082019cff4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 30 01:15:01.060225 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 139/287] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Mar 30 01:15:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:01.065620 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ee4b2-a455-4883-855c-fd082019cff4 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:01.072245 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c86d476-0fed-4207-a67d-d52fd7fc08cc None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:01.110722 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7518274-4c8b-49d4-bf22-6f89b81392b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:01.110722 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7518274-4c8b-49d4-bf22-6f89b81392b0 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:01.110722 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7518274-4c8b-49d4-bf22-6f89b81392b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:01.111513 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7518274-4c8b-49d4-bf22-6f89b81392b0 None admin] PATH_INFO: `/v3/projects/9a11dd1e0b1549e8b39995a2cbec195f` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:01.113359 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7518274-4c8b-49d4-bf22-6f89b81392b0 None admin] RBAC: Authorizing `identity:get_project(project_id=9a11dd1e0b1549e8b39995a2cbec195f)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:01.115907 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7518274-4c8b-49d4-bf22-6f89b81392b0 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:01.119383 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 149/288] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Mar 30 01:15:00 2022] GET /identity/v3/projects/9a11dd1e0b1549e8b39995a2cbec195f => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:15:01.126119 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7518274-4c8b-49d4-bf22-6f89b81392b0 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:01.227967 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ee4b2-a455-4883-855c-fd082019cff4 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:01.261595 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161e1107-b961-4a96-98be-7cfec4f40f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:01.262602 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161e1107-b961-4a96-98be-7cfec4f40f53 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:01.263141 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161e1107-b961-4a96-98be-7cfec4f40f53 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:01.263608 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161e1107-b961-4a96-98be-7cfec4f40f53 None admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:01.264560 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161e1107-b961-4a96-98be-7cfec4f40f53 None admin] RBAC: Adding query filter params (name=member) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:01.265095 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161e1107-b961-4a96-98be-7cfec4f40f53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:01.266737 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161e1107-b961-4a96-98be-7cfec4f40f53 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:01.275987 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 140/289] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Mar 30 01:15:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:01.282294 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161e1107-b961-4a96-98be-7cfec4f40f53 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:01.306008 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7518274-4c8b-49d4-bf22-6f89b81392b0 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:01.356779 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eda8695-12f4-4454-9470-f614059d5ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:01.357676 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda8695-12f4-4454-9470-f614059d5ab6 None admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:01.357955 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda8695-12f4-4454-9470-f614059d5ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:01.358227 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda8695-12f4-4454-9470-f614059d5ab6 None admin] PATH_INFO: `/v3/projects/9a11dd1e0b1549e8b39995a2cbec195f/users/4858a435a9f7459282b670ec7b676973/roles/1dffd8c286fa4de1b7a059d5c5da54f8` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:01.364568 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eda8695-12f4-4454-9470-f614059d5ab6 None admin] RBAC: Authorizing `identity:create_grant(project_id=9a11dd1e0b1549e8b39995a2cbec195f, user_id=4858a435a9f7459282b670ec7b676973, role_id=1dffd8c286fa4de1b7a059d5c5da54f8)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:01.366027 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eda8695-12f4-4454-9470-f614059d5ab6 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:01.386764 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161e1107-b961-4a96-98be-7cfec4f40f53 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:01.400190 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 150/290] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Mar 30 01:15:01 2022] PUT /identity/v3/projects/9a11dd1e0b1549e8b39995a2cbec195f/users/4858a435a9f7459282b670ec7b676973/roles/1dffd8c286fa4de1b7a059d5c5da54f8 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:15:01.425408 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601296df-dff5-433a-8b46-c208feaf1218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:01.427328 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601296df-dff5-433a-8b46-c208feaf1218 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:01.427821 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601296df-dff5-433a-8b46-c208feaf1218 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:01.428314 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601296df-dff5-433a-8b46-c208feaf1218 None admin] PATH_INFO: `/v3/users/1aaf73fd3ed348f1a90c21541630af19` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:01.430000 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601296df-dff5-433a-8b46-c208feaf1218 None admin] RBAC: Authorizing `identity:get_user(user_id=1aaf73fd3ed348f1a90c21541630af19)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:01.431856 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601296df-dff5-433a-8b46-c208feaf1218 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:01.434328 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 141/291] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Mar 30 01:15:01 2022] GET /identity/v3/users/1aaf73fd3ed348f1a90c21541630af19 => generated 297 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:15:01.440293 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eda8695-12f4-4454-9470-f614059d5ab6 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:01.564172 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eda8695-12f4-4454-9470-f614059d5ab6 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:01.610722 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31e10df-19a8-4248-92ea-3df83bbc12ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:01.611841 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31e10df-19a8-4248-92ea-3df83bbc12ec None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:01.612400 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31e10df-19a8-4248-92ea-3df83bbc12ec None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:01.612867 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31e10df-19a8-4248-92ea-3df83bbc12ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:01.707757 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31e10df-19a8-4248-92ea-3df83bbc12ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:01.709250 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31e10df-19a8-4248-92ea-3df83bbc12ec None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:01.815682 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 151/292] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Mar 30 01:15:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 30 01:15:01.823942 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601296df-dff5-433a-8b46-c208feaf1218 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:01.990064 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601296df-dff5-433a-8b46-c208feaf1218 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:02.043401 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f48c94-585b-4a1c-b112-d5be963bdf47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:02.044277 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f48c94-585b-4a1c-b112-d5be963bdf47 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:02.044563 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f48c94-585b-4a1c-b112-d5be963bdf47 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:02.044846 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f48c94-585b-4a1c-b112-d5be963bdf47 None admin] PATH_INFO: `/v3/projects/9a11dd1e0b1549e8b39995a2cbec195f` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:02.046060 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f48c94-585b-4a1c-b112-d5be963bdf47 None admin] RBAC: Authorizing `identity:get_project(project_id=9a11dd1e0b1549e8b39995a2cbec195f)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:02.047517 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f48c94-585b-4a1c-b112-d5be963bdf47 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:02.049523 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 142/293] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Mar 30 01:15:01 2022] GET /identity/v3/projects/9a11dd1e0b1549e8b39995a2cbec195f => generated 302 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:02.055717 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31e10df-19a8-4248-92ea-3df83bbc12ec None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:02.170994 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31e10df-19a8-4248-92ea-3df83bbc12ec None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:02.204803 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f227293-70d5-4ef6-aac4-523c683a96be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:02.205457 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f227293-70d5-4ef6-aac4-523c683a96be None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:02.205735 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f227293-70d5-4ef6-aac4-523c683a96be None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:02.206007 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f227293-70d5-4ef6-aac4-523c683a96be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:02.206853 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f227293-70d5-4ef6-aac4-523c683a96be None admin] RBAC: Adding query filter params (role.id=7185d0cfbcd44502b1613bcfe1b42f6f, scope.project.id=9a11dd1e0b1549e8b39995a2cbec195f, user.id=1aaf73fd3ed348f1a90c21541630af19) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:02.207153 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f227293-70d5-4ef6-aac4-523c683a96be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:02.209142 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f227293-70d5-4ef6-aac4-523c683a96be None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:02.215301 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 152/294] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Mar 30 01:15:02 2022] GET /identity/v3/role_assignments?user.id=1aaf73fd3ed348f1a90c21541630af19&scope.project.id=9a11dd1e0b1549e8b39995a2cbec195f&role.id=7185d0cfbcd44502b1613bcfe1b42f6f => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:02.271740 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587bdabd-0a97-42f8-b009-316967464786 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:02.272050 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587bdabd-0a97-42f8-b009-316967464786 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:02.272298 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587bdabd-0a97-42f8-b009-316967464786 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:02.274538 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 143/295] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:15:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:15:02.280348 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4aed8-c5a7-45b2-be18-80d77ed57508 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:02.280706 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4aed8-c5a7-45b2-be18-80d77ed57508 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:02.280984 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4aed8-c5a7-45b2-be18-80d77ed57508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:02.299050 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-e5a4aed8-c5a7-45b2-be18-80d77ed57508 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:15:02.300233 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-e5a4aed8-c5a7-45b2-be18-80d77ed57508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:15:02.378896 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 153/296] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:15:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 01:15:02.397894 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587bdabd-0a97-42f8-b009-316967464786 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:02.495964 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8f29b-77cb-413a-be65-78db007842f2 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:02.496176 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8f29b-77cb-413a-be65-78db007842f2 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:02.496423 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8f29b-77cb-413a-be65-78db007842f2 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:02.499692 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 154/297] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:15:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 01:15:02.503731 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea5813-cad3-44dd-aa17-45d708f5b732 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:02.504013 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea5813-cad3-44dd-aa17-45d708f5b732 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:02.504838 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea5813-cad3-44dd-aa17-45d708f5b732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:02.522477 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-02ea5813-cad3-44dd-aa17-45d708f5b732 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:15:02.523707 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-02ea5813-cad3-44dd-aa17-45d708f5b732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:15:02.534467 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587bdabd-0a97-42f8-b009-316967464786 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:02.579198 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b88ec-4057-49a8-9c86-520d1117c9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:02.580185 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b88ec-4057-49a8-9c86-520d1117c9f1 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:02.580639 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b88ec-4057-49a8-9c86-520d1117c9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:02.580921 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b88ec-4057-49a8-9c86-520d1117c9f1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:02.582881 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388b88ec-4057-49a8-9c86-520d1117c9f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:02.584857 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388b88ec-4057-49a8-9c86-520d1117c9f1 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:02.587552 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 144/298] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:15:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:02.593703 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b88ec-4057-49a8-9c86-520d1117c9f1 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:02.597120 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 155/299] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:15:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 30 01:15:02.622220 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea5813-cad3-44dd-aa17-45d708f5b732 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:02.729244 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b88ec-4057-49a8-9c86-520d1117c9f1 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:02.734925 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea5813-cad3-44dd-aa17-45d708f5b732 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:02.776091 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809bfd8-0681-4c97-924b-480d7bbf35bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:02.776693 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809bfd8-0681-4c97-924b-480d7bbf35bf None admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:02.776983 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809bfd8-0681-4c97-924b-480d7bbf35bf None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:02.777250 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809bfd8-0681-4c97-924b-480d7bbf35bf None admin] PATH_INFO: `/v3/groups` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:02.777937 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1809bfd8-0681-4c97-924b-480d7bbf35bf None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:02.779108 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b6f7c-87d9-41da-8dda-9f17a40d9b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:02.779418 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1809bfd8-0681-4c97-924b-480d7bbf35bf None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:02.780573 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b6f7c-87d9-41da-8dda-9f17a40d9b5e None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:02.781093 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b6f7c-87d9-41da-8dda-9f17a40d9b5e None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:02.781600 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b6f7c-87d9-41da-8dda-9f17a40d9b5e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:02.795625 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358b6f7c-87d9-41da-8dda-9f17a40d9b5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:15:02.802812 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 145/300] 10.222.0.30 () {60 vars in 1134 bytes} [Wed Mar 30 01:15:02 2022] POST /identity/v3/groups => generated 229 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:15:02.809858 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-358b6f7c-87d9-41da-8dda-9f17a40d9b5e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 30 01:15:02.811517 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 156/301] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Mar 30 01:15:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 01:15:02.818132 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809bfd8-0681-4c97-924b-480d7bbf35bf None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:02.853470 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a96737-c944-4ca6-9603-695a41c81e67 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:02.853762 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a96737-c944-4ca6-9603-695a41c81e67 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:02.854218 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a96737-c944-4ca6-9603-695a41c81e67 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:02.856593 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 157/302] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:15:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 01:15:02.861874 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe3d23-fc3b-4da1-aceb-568d9a8a9809 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:02.862494 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe3d23-fc3b-4da1-aceb-568d9a8a9809 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:02.862966 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe3d23-fc3b-4da1-aceb-568d9a8a9809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:02.884422 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-6abe3d23-fc3b-4da1-aceb-568d9a8a9809 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:15:02.886479 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-6abe3d23-fc3b-4da1-aceb-568d9a8a9809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:15:02.937273 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809bfd8-0681-4c97-924b-480d7bbf35bf None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:02.975195 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0747efa6-2f6b-4536-b9e3-9d54b9642b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:02.976162 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0747efa6-2f6b-4536-b9e3-9d54b9642b88 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:02.976636 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0747efa6-2f6b-4536-b9e3-9d54b9642b88 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:02.977054 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0747efa6-2f6b-4536-b9e3-9d54b9642b88 None admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:02.978008 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0747efa6-2f6b-4536-b9e3-9d54b9642b88 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:02.978468 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0747efa6-2f6b-4536-b9e3-9d54b9642b88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:02.980343 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0747efa6-2f6b-4536-b9e3-9d54b9642b88 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:02.984879 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 158/303] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:15:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 30 01:15:02.994236 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 146/304] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Mar 30 01:15:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:15:02.999517 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abe3d23-fc3b-4da1-aceb-568d9a8a9809 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:03.010961 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0747efa6-2f6b-4536-b9e3-9d54b9642b88 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:03.115366 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abe3d23-fc3b-4da1-aceb-568d9a8a9809 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:03.124378 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0747efa6-2f6b-4536-b9e3-9d54b9642b88 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:03.149155 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05942939-f08e-4d29-8ee6-ea4b17f04198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:03.150033 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05942939-f08e-4d29-8ee6-ea4b17f04198 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:03.150317 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05942939-f08e-4d29-8ee6-ea4b17f04198 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:03.150595 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05942939-f08e-4d29-8ee6-ea4b17f04198 None admin] PATH_INFO: `/v3/users/5083f6dc1ba44ef891186eb88c774d39` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:03.164977 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05942939-f08e-4d29-8ee6-ea4b17f04198 None admin] RBAC: Authorizing `identity:get_user(user_id=5083f6dc1ba44ef891186eb88c774d39)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:03.166652 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05942939-f08e-4d29-8ee6-ea4b17f04198 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:03.167711 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a08e1e-c248-48da-9f97-6c8c12e7078c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:03.168582 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 159/305] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Mar 30 01:15:02 2022] GET /identity/v3/users/5083f6dc1ba44ef891186eb88c774d39 => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:03.168688 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a08e1e-c248-48da-9f97-6c8c12e7078c None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:03.168762 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a08e1e-c248-48da-9f97-6c8c12e7078c None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:03.169038 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a08e1e-c248-48da-9f97-6c8c12e7078c None admin] PATH_INFO: `/v3/roles/member` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:03.173897 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05942939-f08e-4d29-8ee6-ea4b17f04198 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:03.183603 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a08e1e-c248-48da-9f97-6c8c12e7078c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:15:03.193093 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-a6a08e1e-c248-48da-9f97-6c8c12e7078c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 30 01:15:03.195037 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 147/306] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Mar 30 01:15:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 01:15:03.201089 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a08e1e-c248-48da-9f97-6c8c12e7078c None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:03.304264 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05942939-f08e-4d29-8ee6-ea4b17f04198 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:03.311848 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a08e1e-c248-48da-9f97-6c8c12e7078c None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:03.346021 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeacfeb5-25e5-4d28-b946-5151b5686663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:03.346866 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeacfeb5-25e5-4d28-b946-5151b5686663 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:03.347264 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeacfeb5-25e5-4d28-b946-5151b5686663 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:03.347644 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeacfeb5-25e5-4d28-b946-5151b5686663 None admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:03.347822 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653a724e-c5d7-4423-9ad9-d7076a0e28a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:03.349216 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a724e-c5d7-4423-9ad9-d7076a0e28a5 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:03.349330 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeacfeb5-25e5-4d28-b946-5151b5686663 None admin] RBAC: Adding query filter params (name=member) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:03.349732 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeacfeb5-25e5-4d28-b946-5151b5686663 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:03.349850 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a724e-c5d7-4423-9ad9-d7076a0e28a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:03.350246 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a724e-c5d7-4423-9ad9-d7076a0e28a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:03.351272 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653a724e-c5d7-4423-9ad9-d7076a0e28a5 None admin] RBAC: Adding query filter params (role.id=1dffd8c286fa4de1b7a059d5c5da54f8, user.id=5083f6dc1ba44ef891186eb88c774d39, scope.system=all) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:03.351505 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeacfeb5-25e5-4d28-b946-5151b5686663 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:03.351917 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653a724e-c5d7-4423-9ad9-d7076a0e28a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:03.354029 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653a724e-c5d7-4423-9ad9-d7076a0e28a5 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:03.359871 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 160/307] 10.222.0.30 () {56 vars in 1308 bytes} [Wed Mar 30 01:15:03 2022] GET /identity/v3/role_assignments?user.id=5083f6dc1ba44ef891186eb88c774d39&scope.system=all&role.id=1dffd8c286fa4de1b7a059d5c5da54f8 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:15:03.366812 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 148/308] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Mar 30 01:15:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:03.372719 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeacfeb5-25e5-4d28-b946-5151b5686663 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:03.484137 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeacfeb5-25e5-4d28-b946-5151b5686663 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:03.521893 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7914c782-34de-46c5-9cdf-a68fa37d2b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:03.523187 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914c782-34de-46c5-9cdf-a68fa37d2b57 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:03.523695 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914c782-34de-46c5-9cdf-a68fa37d2b57 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:03.524190 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914c782-34de-46c5-9cdf-a68fa37d2b57 None admin] PATH_INFO: `/v3/users/65d642d74c21424d8f89491c13f2cf06` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:03.525739 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7914c782-34de-46c5-9cdf-a68fa37d2b57 None admin] RBAC: Authorizing `identity:get_user(user_id=65d642d74c21424d8f89491c13f2cf06)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:03.527488 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7914c782-34de-46c5-9cdf-a68fa37d2b57 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:03.529751 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 149/309] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Mar 30 01:15:03 2022] GET /identity/v3/users/65d642d74c21424d8f89491c13f2cf06 => generated 293 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:15:03.536386 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653a724e-c5d7-4423-9ad9-d7076a0e28a5 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:03.648038 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653a724e-c5d7-4423-9ad9-d7076a0e28a5 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:03.689420 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e011a1b-7693-4ccd-959d-291330e266ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:03.690658 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e011a1b-7693-4ccd-959d-291330e266ca None admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:03.691173 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e011a1b-7693-4ccd-959d-291330e266ca None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:03.691692 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e011a1b-7693-4ccd-959d-291330e266ca None admin] PATH_INFO: `/v3/system/users/65d642d74c21424d8f89491c13f2cf06/roles/7185d0cfbcd44502b1613bcfe1b42f6f` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:03.693774 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e011a1b-7693-4ccd-959d-291330e266ca None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=65d642d74c21424d8f89491c13f2cf06, role_id=7185d0cfbcd44502b1613bcfe1b42f6f)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:03.695438 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e011a1b-7693-4ccd-959d-291330e266ca None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:03.711459 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 161/310] 10.222.0.30 () {58 vars in 1334 bytes} [Wed Mar 30 01:15:03 2022] PUT /identity/v3/system/users/65d642d74c21424d8f89491c13f2cf06/roles/7185d0cfbcd44502b1613bcfe1b42f6f => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:15:04.188723 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d29aa4-ca09-4aac-8816-761ff35dd62c None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:04.189098 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d29aa4-ca09-4aac-8816-761ff35dd62c None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:04.189279 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d29aa4-ca09-4aac-8816-761ff35dd62c None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:04.191254 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 150/311] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:15:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:15:04.196881 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb8615-e1fc-437b-ad36-2bdafc630365 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:04.197177 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb8615-e1fc-437b-ad36-2bdafc630365 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:04.197464 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb8615-e1fc-437b-ad36-2bdafc630365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:04.330540 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-13fb8615-e1fc-437b-ad36-2bdafc630365 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:15:04.331773 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-13fb8615-e1fc-437b-ad36-2bdafc630365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:15:04.404183 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 162/312] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:15:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 01:15:04.428103 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d29aa4-ca09-4aac-8816-761ff35dd62c None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:04.537979 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d29aa4-ca09-4aac-8816-761ff35dd62c None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:04.574982 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cbd32e-5564-49af-8e9b-4201179aeda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:04.576054 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cbd32e-5564-49af-8e9b-4201179aeda1 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:04.576479 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cbd32e-5564-49af-8e9b-4201179aeda1 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:04.576895 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cbd32e-5564-49af-8e9b-4201179aeda1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:04.590037 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cbd32e-5564-49af-8e9b-4201179aeda1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:15:04.597335 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-98cbd32e-5564-49af-8e9b-4201179aeda1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 30 01:15:04.599781 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 151/313] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Mar 30 01:15:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:04.605651 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fb8615-e1fc-437b-ad36-2bdafc630365 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:04.718155 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fb8615-e1fc-437b-ad36-2bdafc630365 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:04.758725 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e267bafe-8360-4f8c-888f-b9f35219dd1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:04.758725 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e267bafe-8360-4f8c-888f-b9f35219dd1f None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:04.758725 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e267bafe-8360-4f8c-888f-b9f35219dd1f None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:04.758725 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e267bafe-8360-4f8c-888f-b9f35219dd1f None admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:04.759120 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e267bafe-8360-4f8c-888f-b9f35219dd1f None admin] RBAC: Adding query filter params (name=reader) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:04.759120 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e267bafe-8360-4f8c-888f-b9f35219dd1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:04.759120 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e267bafe-8360-4f8c-888f-b9f35219dd1f None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:04.771037 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 163/314] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Mar 30 01:15:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:04.773498 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cbd32e-5564-49af-8e9b-4201179aeda1 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:04.878261 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cbd32e-5564-49af-8e9b-4201179aeda1 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:04.918440 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982265fb-967e-4a20-bfc2-54e11ba0f2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:04.919356 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982265fb-967e-4a20-bfc2-54e11ba0f2e2 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:04.919637 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982265fb-967e-4a20-bfc2-54e11ba0f2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:04.919916 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982265fb-967e-4a20-bfc2-54e11ba0f2e2 None admin] PATH_INFO: `/v3/users/4858a435a9f7459282b670ec7b676973` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:04.921281 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982265fb-967e-4a20-bfc2-54e11ba0f2e2 None admin] RBAC: Authorizing `identity:get_user(user_id=4858a435a9f7459282b670ec7b676973)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:04.922841 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982265fb-967e-4a20-bfc2-54e11ba0f2e2 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:04.924982 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 152/315] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Mar 30 01:15:04 2022] GET /identity/v3/users/4858a435a9f7459282b670ec7b676973 => generated 297 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:04.931150 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e267bafe-8360-4f8c-888f-b9f35219dd1f None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:05.038778 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e267bafe-8360-4f8c-888f-b9f35219dd1f None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:05.071441 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441b78c5-b987-4b90-9029-e1fbc0d81648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:05.072087 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b78c5-b987-4b90-9029-e1fbc0d81648 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:05.072365 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b78c5-b987-4b90-9029-e1fbc0d81648 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:05.072635 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b78c5-b987-4b90-9029-e1fbc0d81648 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:05.140576 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441b78c5-b987-4b90-9029-e1fbc0d81648 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:05.141936 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441b78c5-b987-4b90-9029-e1fbc0d81648 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:05.240721 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 164/316] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Mar 30 01:15:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 30 01:15:05.246061 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982265fb-967e-4a20-bfc2-54e11ba0f2e2 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:05.344877 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f199443d-bc94-4eb9-bd75-dab5fa88e7ac None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:05.345195 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f199443d-bc94-4eb9-bd75-dab5fa88e7ac None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:05.345424 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f199443d-bc94-4eb9-bd75-dab5fa88e7ac None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:05.347459 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 165/317] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:15:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 01:15:05.352861 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea3192-6762-45f0-871f-442d38148de2 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:05.353424 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea3192-6762-45f0-871f-442d38148de2 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:05.353919 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea3192-6762-45f0-871f-442d38148de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:05.355020 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982265fb-967e-4a20-bfc2-54e11ba0f2e2 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:05.371492 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-7bea3192-6762-45f0-871f-442d38148de2 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:15:05.373012 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-7bea3192-6762-45f0-871f-442d38148de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:15:05.400984 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e675423-5f9c-4f88-b5e7-c5d017066783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:05.402072 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e675423-5f9c-4f88-b5e7-c5d017066783 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:05.402361 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e675423-5f9c-4f88-b5e7-c5d017066783 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:05.402641 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e675423-5f9c-4f88-b5e7-c5d017066783 None admin] PATH_INFO: `/v3/projects/9a11dd1e0b1549e8b39995a2cbec195f` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:05.404152 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e675423-5f9c-4f88-b5e7-c5d017066783 None admin] RBAC: Authorizing `identity:get_project(project_id=9a11dd1e0b1549e8b39995a2cbec195f)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:05.406950 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e675423-5f9c-4f88-b5e7-c5d017066783 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:05.409054 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 153/318] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Mar 30 01:15:05 2022] GET /identity/v3/projects/9a11dd1e0b1549e8b39995a2cbec195f => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:05.415794 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e675423-5f9c-4f88-b5e7-c5d017066783 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:05.450809 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 166/319] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:15:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 30 01:15:05.468958 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea3192-6762-45f0-871f-442d38148de2 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:05.540951 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e675423-5f9c-4f88-b5e7-c5d017066783 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:05.575320 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f0300-548c-4f44-adf5-a9a00ee5bb9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:05.576309 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f0300-548c-4f44-adf5-a9a00ee5bb9c None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:05.576803 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f0300-548c-4f44-adf5-a9a00ee5bb9c None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:05.577281 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f0300-548c-4f44-adf5-a9a00ee5bb9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:05.578302 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655f0300-548c-4f44-adf5-a9a00ee5bb9c None admin] RBAC: Adding query filter params (role.id=1dffd8c286fa4de1b7a059d5c5da54f8, scope.project.id=9a11dd1e0b1549e8b39995a2cbec195f, user.id=4858a435a9f7459282b670ec7b676973) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:05.578838 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655f0300-548c-4f44-adf5-a9a00ee5bb9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:05.580641 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655f0300-548c-4f44-adf5-a9a00ee5bb9c None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:05.584426 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea3192-6762-45f0-871f-442d38148de2 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:05.587504 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 154/320] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Mar 30 01:15:05 2022] GET /identity/v3/role_assignments?user.id=4858a435a9f7459282b670ec7b676973&scope.project.id=9a11dd1e0b1549e8b39995a2cbec195f&role.id=1dffd8c286fa4de1b7a059d5c5da54f8 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:05.626849 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9581b0-e637-47d8-8051-5fd939386e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:05.627669 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9581b0-e637-47d8-8051-5fd939386e77 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:05.627950 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9581b0-e637-47d8-8051-5fd939386e77 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:05.628224 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9581b0-e637-47d8-8051-5fd939386e77 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:05.630059 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9581b0-e637-47d8-8051-5fd939386e77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:05.631652 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9581b0-e637-47d8-8051-5fd939386e77 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:05.633693 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 167/321] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:15:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:05.640126 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f0300-548c-4f44-adf5-a9a00ee5bb9c None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:05.757161 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f0300-548c-4f44-adf5-a9a00ee5bb9c None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:05.794766 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d7658a-7692-4ca5-babf-ad18c64ab747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:05.795503 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d7658a-7692-4ca5-babf-ad18c64ab747 None admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:05.795790 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d7658a-7692-4ca5-babf-ad18c64ab747 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:05.796070 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d7658a-7692-4ca5-babf-ad18c64ab747 None admin] PATH_INFO: `/v3/groups` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:05.796778 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d7658a-7692-4ca5-babf-ad18c64ab747 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:05.798204 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d7658a-7692-4ca5-babf-ad18c64ab747 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:05.814505 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 155/322] 10.222.0.30 () {60 vars in 1134 bytes} [Wed Mar 30 01:15:05 2022] POST /identity/v3/groups => generated 226 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 01:15:05.868500 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa895eb-c6f2-4431-ba8f-a54799633c3e None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:05.868809 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa895eb-c6f2-4431-ba8f-a54799633c3e None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:05.869068 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa895eb-c6f2-4431-ba8f-a54799633c3e None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:05.871103 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 168/323] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:15:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 01:15:05.876862 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc1037-a0fa-42fe-8540-955be5ce6e44 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:05.877164 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc1037-a0fa-42fe-8540-955be5ce6e44 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:05.877434 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc1037-a0fa-42fe-8540-955be5ce6e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:05.897161 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-44bc1037-a0fa-42fe-8540-955be5ce6e44 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:15:05.898471 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-44bc1037-a0fa-42fe-8540-955be5ce6e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:15:05.974757 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 156/324] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:15:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 01:15:05.995830 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa895eb-c6f2-4431-ba8f-a54799633c3e None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:06.100879 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa895eb-c6f2-4431-ba8f-a54799633c3e None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:06.114270 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2726139-067f-4ebd-8fc8-50b5e15f63e2 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:06.114922 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2726139-067f-4ebd-8fc8-50b5e15f63e2 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:06.115425 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2726139-067f-4ebd-8fc8-50b5e15f63e2 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:06.117257 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 157/325] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:15:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 01:15:06.122574 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769dbd50-9b9f-4540-b71d-3ce7a79a5091 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:06.123191 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769dbd50-9b9f-4540-b71d-3ce7a79a5091 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:06.123482 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769dbd50-9b9f-4540-b71d-3ce7a79a5091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:06.143258 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd0e99d-9564-4aab-87eb-58d42d0ee851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:06.143456 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-769dbd50-9b9f-4540-b71d-3ce7a79a5091 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:15:06.144110 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd0e99d-9564-4aab-87eb-58d42d0ee851 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:06.144393 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd0e99d-9564-4aab-87eb-58d42d0ee851 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:06.144490 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-769dbd50-9b9f-4540-b71d-3ce7a79a5091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:15:06.144670 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd0e99d-9564-4aab-87eb-58d42d0ee851 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:06.161812 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd0e99d-9564-4aab-87eb-58d42d0ee851 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:15:06.169360 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-8dd0e99d-9564-4aab-87eb-58d42d0ee851 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 30 01:15:06.170775 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 169/326] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Mar 30 01:15:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 01:15:06.176247 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd0e99d-9564-4aab-87eb-58d42d0ee851 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:06.230665 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 158/327] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:15:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 01:15:06.255186 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769dbd50-9b9f-4540-b71d-3ce7a79a5091 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:06.299459 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd0e99d-9564-4aab-87eb-58d42d0ee851 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:06.344750 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429ab55e-eb59-47a1-81c9-19e3ce8a093f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:06.345597 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ab55e-eb59-47a1-81c9-19e3ce8a093f None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:06.345889 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ab55e-eb59-47a1-81c9-19e3ce8a093f None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:06.346996 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ab55e-eb59-47a1-81c9-19e3ce8a093f None admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:06.347817 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429ab55e-eb59-47a1-81c9-19e3ce8a093f None admin] RBAC: Adding query filter params (name=reader) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:06.348747 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429ab55e-eb59-47a1-81c9-19e3ce8a093f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:06.350138 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429ab55e-eb59-47a1-81c9-19e3ce8a093f None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:06.360656 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 170/328] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Mar 30 01:15:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:15:06.366247 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429ab55e-eb59-47a1-81c9-19e3ce8a093f None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:06.385021 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769dbd50-9b9f-4540-b71d-3ce7a79a5091 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:06.428290 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a1d221-6e4f-4d12-826f-268b135a979c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:06.429149 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a1d221-6e4f-4d12-826f-268b135a979c None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:06.429435 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a1d221-6e4f-4d12-826f-268b135a979c None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:06.429716 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a1d221-6e4f-4d12-826f-268b135a979c None admin] PATH_INFO: `/v3/roles/member` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:06.444903 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a1d221-6e4f-4d12-826f-268b135a979c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:15:06.455450 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-09a1d221-6e4f-4d12-826f-268b135a979c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 30 01:15:06.456693 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 159/329] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Mar 30 01:15:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 01:15:06.469086 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a1d221-6e4f-4d12-826f-268b135a979c None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:06.497664 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429ab55e-eb59-47a1-81c9-19e3ce8a093f None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:06.539584 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037e779d-65b4-4c5a-9fb0-4820a4a57ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:06.540562 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e779d-65b4-4c5a-9fb0-4820a4a57ba9 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:06.543207 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e779d-65b4-4c5a-9fb0-4820a4a57ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:06.543371 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e779d-65b4-4c5a-9fb0-4820a4a57ba9 None admin] PATH_INFO: `/v3/users/5083f6dc1ba44ef891186eb88c774d39` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:06.544728 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037e779d-65b4-4c5a-9fb0-4820a4a57ba9 None admin] RBAC: Authorizing `identity:get_user(user_id=5083f6dc1ba44ef891186eb88c774d39)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:06.546259 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037e779d-65b4-4c5a-9fb0-4820a4a57ba9 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:06.548364 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 171/330] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Mar 30 01:15:06 2022] GET /identity/v3/users/5083f6dc1ba44ef891186eb88c774d39 => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:15:06.554629 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037e779d-65b4-4c5a-9fb0-4820a4a57ba9 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:06.606834 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a1d221-6e4f-4d12-826f-268b135a979c None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:06.658323 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21f35ad-d92e-4d84-84b0-b30487a3fd49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:06.659290 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f35ad-d92e-4d84-84b0-b30487a3fd49 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:06.659715 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f35ad-d92e-4d84-84b0-b30487a3fd49 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:06.660131 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f35ad-d92e-4d84-84b0-b30487a3fd49 None admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:06.661584 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21f35ad-d92e-4d84-84b0-b30487a3fd49 None admin] RBAC: Adding query filter params (name=member) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:06.662046 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21f35ad-d92e-4d84-84b0-b30487a3fd49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:06.663610 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21f35ad-d92e-4d84-84b0-b30487a3fd49 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:06.674557 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 160/331] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Mar 30 01:15:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:06.680488 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037e779d-65b4-4c5a-9fb0-4820a4a57ba9 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:06.680939 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21f35ad-d92e-4d84-84b0-b30487a3fd49 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:06.719135 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76871e38-47df-43d6-b084-6e01385e3377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:06.720276 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76871e38-47df-43d6-b084-6e01385e3377 None admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:06.720705 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76871e38-47df-43d6-b084-6e01385e3377 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:06.721122 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76871e38-47df-43d6-b084-6e01385e3377 None admin] PATH_INFO: `/v3/system/users/5083f6dc1ba44ef891186eb88c774d39/roles/1dffd8c286fa4de1b7a059d5c5da54f8` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:06.723770 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76871e38-47df-43d6-b084-6e01385e3377 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=5083f6dc1ba44ef891186eb88c774d39, role_id=1dffd8c286fa4de1b7a059d5c5da54f8)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:06.725531 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76871e38-47df-43d6-b084-6e01385e3377 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:06.736820 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 172/332] 10.222.0.30 () {58 vars in 1334 bytes} [Wed Mar 30 01:15:06 2022] PUT /identity/v3/system/users/5083f6dc1ba44ef891186eb88c774d39/roles/1dffd8c286fa4de1b7a059d5c5da54f8 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:15:06.809405 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21f35ad-d92e-4d84-84b0-b30487a3fd49 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:06.866261 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a639ed-7ff8-46cd-bb5e-d68c8b34c0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:06.867229 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a639ed-7ff8-46cd-bb5e-d68c8b34c0d7 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:06.867522 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a639ed-7ff8-46cd-bb5e-d68c8b34c0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:06.867801 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a639ed-7ff8-46cd-bb5e-d68c8b34c0d7 None admin] PATH_INFO: `/v3/users/65d642d74c21424d8f89491c13f2cf06` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:06.869038 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a639ed-7ff8-46cd-bb5e-d68c8b34c0d7 None admin] RBAC: Authorizing `identity:get_user(user_id=65d642d74c21424d8f89491c13f2cf06)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:06.870731 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a639ed-7ff8-46cd-bb5e-d68c8b34c0d7 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:06.872723 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 161/333] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Mar 30 01:15:06 2022] GET /identity/v3/users/65d642d74c21424d8f89491c13f2cf06 => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:15:06.878397 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76871e38-47df-43d6-b084-6e01385e3377 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:06.985861 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76871e38-47df-43d6-b084-6e01385e3377 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:07.035230 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf793f7-fade-4a8f-8aeb-e4ffe661c80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:07.036279 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf793f7-fade-4a8f-8aeb-e4ffe661c80a None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:07.036613 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf793f7-fade-4a8f-8aeb-e4ffe661c80a None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:07.036896 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf793f7-fade-4a8f-8aeb-e4ffe661c80a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:07.037805 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf793f7-fade-4a8f-8aeb-e4ffe661c80a None admin] RBAC: Adding query filter params (role.id=7185d0cfbcd44502b1613bcfe1b42f6f, user.id=65d642d74c21424d8f89491c13f2cf06, scope.system=all) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:07.038118 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf793f7-fade-4a8f-8aeb-e4ffe661c80a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:07.039740 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf793f7-fade-4a8f-8aeb-e4ffe661c80a None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:07.060889 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 173/334] 10.222.0.30 () {56 vars in 1308 bytes} [Wed Mar 30 01:15:06 2022] GET /identity/v3/role_assignments?user.id=65d642d74c21424d8f89491c13f2cf06&scope.system=all&role.id=7185d0cfbcd44502b1613bcfe1b42f6f => generated 510 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:08.526639 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf102932-cf8c-482d-a8be-2d78333aa30a None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:08.527704 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf102932-cf8c-482d-a8be-2d78333aa30a None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:08.528196 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf102932-cf8c-482d-a8be-2d78333aa30a None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:08.530659 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 162/335] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:15:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:15:08.537254 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed147e-2c74-4750-b45a-26aa39c116b8 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:08.538246 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed147e-2c74-4750-b45a-26aa39c116b8 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:08.538772 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed147e-2c74-4750-b45a-26aa39c116b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:08.560400 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-afed147e-2c74-4750-b45a-26aa39c116b8 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:15:08.561969 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-afed147e-2c74-4750-b45a-26aa39c116b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:15:08.664849 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 174/336] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:15:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 01:15:08.701057 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf102932-cf8c-482d-a8be-2d78333aa30a None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:08.819345 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf102932-cf8c-482d-a8be-2d78333aa30a None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:08.864812 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607726e5-4e84-4041-94b6-884498b6e93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:08.865991 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607726e5-4e84-4041-94b6-884498b6e93a None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:08.866486 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607726e5-4e84-4041-94b6-884498b6e93a None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:08.867037 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607726e5-4e84-4041-94b6-884498b6e93a None admin] PATH_INFO: `/v3/roles/member` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:08.879901 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607726e5-4e84-4041-94b6-884498b6e93a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:15:08.887449 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-607726e5-4e84-4041-94b6-884498b6e93a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 30 01:15:08.889212 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 163/337] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Mar 30 01:15:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:08.895708 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afed147e-2c74-4750-b45a-26aa39c116b8 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:09.004886 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afed147e-2c74-4750-b45a-26aa39c116b8 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:09.044383 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3565bdb-70ca-4299-a659-ea1d6ff785b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:09.045439 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3565bdb-70ca-4299-a659-ea1d6ff785b1 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:09.045943 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3565bdb-70ca-4299-a659-ea1d6ff785b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:09.046426 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3565bdb-70ca-4299-a659-ea1d6ff785b1 None admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:09.047404 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3565bdb-70ca-4299-a659-ea1d6ff785b1 None admin] RBAC: Adding query filter params (name=member) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:09.047919 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3565bdb-70ca-4299-a659-ea1d6ff785b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:09.049521 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3565bdb-70ca-4299-a659-ea1d6ff785b1 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:09.062355 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 175/338] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Mar 30 01:15:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:09.068999 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607726e5-4e84-4041-94b6-884498b6e93a None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:09.181230 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607726e5-4e84-4041-94b6-884498b6e93a None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:09.220408 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0dc8a9-1a3f-4660-a23b-e814795df8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:09.221448 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0dc8a9-1a3f-4660-a23b-e814795df8e6 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:09.221948 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0dc8a9-1a3f-4660-a23b-e814795df8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:09.222430 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0dc8a9-1a3f-4660-a23b-e814795df8e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:09.234150 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13892260-c421-452f-9610-9090bfc1999e None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:09.234821 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13892260-c421-452f-9610-9090bfc1999e None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:09.235310 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13892260-c421-452f-9610-9090bfc1999e None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:09.238675 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 176/339] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:15:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 01:15:09.248255 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0b064-c60b-43b7-8664-beb8e379bb1d None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:09.248861 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0b064-c60b-43b7-8664-beb8e379bb1d None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:09.249335 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0b064-c60b-43b7-8664-beb8e379bb1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:09.276720 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-57e0b064-c60b-43b7-8664-beb8e379bb1d None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:15:09.281973 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-57e0b064-c60b-43b7-8664-beb8e379bb1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:15:09.384523 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0dc8a9-1a3f-4660-a23b-e814795df8e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:09.386524 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0dc8a9-1a3f-4660-a23b-e814795df8e6 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:09.424010 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 177/340] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:15:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 01:15:09.466454 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e0b064-c60b-43b7-8664-beb8e379bb1d None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:09.551964 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 164/341] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Mar 30 01:15:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 30 01:15:09.558740 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0dc8a9-1a3f-4660-a23b-e814795df8e6 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:09.661297 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e0b064-c60b-43b7-8664-beb8e379bb1d None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:09.716886 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008cc141-65ad-4fe4-b0c2-f6bf36554965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:09.717623 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008cc141-65ad-4fe4-b0c2-f6bf36554965 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:09.717902 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008cc141-65ad-4fe4-b0c2-f6bf36554965 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:09.718173 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008cc141-65ad-4fe4-b0c2-f6bf36554965 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:09.740552 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008cc141-65ad-4fe4-b0c2-f6bf36554965 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:15:09.750558 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-008cc141-65ad-4fe4-b0c2-f6bf36554965 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 30 01:15:09.759246 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 178/342] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Mar 30 01:15:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 01:15:09.771352 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008cc141-65ad-4fe4-b0c2-f6bf36554965 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:09.790500 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0dc8a9-1a3f-4660-a23b-e814795df8e6 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:09.867596 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c351f18d-ce8c-451d-b39e-783dbb7c4884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:09.868495 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351f18d-ce8c-451d-b39e-783dbb7c4884 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:09.868776 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351f18d-ce8c-451d-b39e-783dbb7c4884 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:09.869049 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351f18d-ce8c-451d-b39e-783dbb7c4884 None admin] PATH_INFO: `/v3/projects/4a955500342c498384e96caede5f019f` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:09.870466 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c351f18d-ce8c-451d-b39e-783dbb7c4884 None admin] RBAC: Authorizing `identity:get_project(project_id=4a955500342c498384e96caede5f019f)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:09.871996 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c351f18d-ce8c-451d-b39e-783dbb7c4884 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:09.874344 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 165/343] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Mar 30 01:15:09 2022] GET /identity/v3/projects/4a955500342c498384e96caede5f019f => generated 298 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:09.883910 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c351f18d-ce8c-451d-b39e-783dbb7c4884 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:09.903557 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008cc141-65ad-4fe4-b0c2-f6bf36554965 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:09.945592 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2776b453-c4f3-4508-b7b4-aaf54e1a5138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:09.946535 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2776b453-c4f3-4508-b7b4-aaf54e1a5138 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:09.947022 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2776b453-c4f3-4508-b7b4-aaf54e1a5138 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:09.947453 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2776b453-c4f3-4508-b7b4-aaf54e1a5138 None admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:09.948362 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2776b453-c4f3-4508-b7b4-aaf54e1a5138 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:09.948974 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2776b453-c4f3-4508-b7b4-aaf54e1a5138 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:09.951517 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2776b453-c4f3-4508-b7b4-aaf54e1a5138 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:09.977589 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 179/344] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Mar 30 01:15:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:15:09.985493 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2776b453-c4f3-4508-b7b4-aaf54e1a5138 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:10.113100 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c351f18d-ce8c-451d-b39e-783dbb7c4884 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:10.181585 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2776b453-c4f3-4508-b7b4-aaf54e1a5138 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:10.203435 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f652a7da-6c7b-43e8-b470-0228b25e5157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:10.204572 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652a7da-6c7b-43e8-b470-0228b25e5157 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:10.205018 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652a7da-6c7b-43e8-b470-0228b25e5157 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:10.205443 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652a7da-6c7b-43e8-b470-0228b25e5157 None admin] PATH_INFO: `/v3/groups/f4e5616e2d87414ca17512f840cc2a59` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:10.219374 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f652a7da-6c7b-43e8-b470-0228b25e5157 None admin] RBAC: Authorizing `identity:get_group(group_id=f4e5616e2d87414ca17512f840cc2a59)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:10.221073 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f652a7da-6c7b-43e8-b470-0228b25e5157 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:10.223499 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 166/345] 10.222.0.30 () {56 vars in 1180 bytes} [Wed Mar 30 01:15:09 2022] GET /identity/v3/groups/f4e5616e2d87414ca17512f840cc2a59 => generated 226 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:15:10.234919 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f652a7da-6c7b-43e8-b470-0228b25e5157 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:10.236250 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5370763b-cb13-4dd0-a0d9-88ac8b4dc315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:10.237041 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5370763b-cb13-4dd0-a0d9-88ac8b4dc315 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:10.237423 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5370763b-cb13-4dd0-a0d9-88ac8b4dc315 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:10.237800 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5370763b-cb13-4dd0-a0d9-88ac8b4dc315 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:10.366906 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5370763b-cb13-4dd0-a0d9-88ac8b4dc315 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:10.368753 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5370763b-cb13-4dd0-a0d9-88ac8b4dc315 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:10.445769 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f652a7da-6c7b-43e8-b470-0228b25e5157 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:10.481349 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 180/346] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Mar 30 01:15:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 30 01:15:10.483026 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24602d36-05fb-4daf-a104-954d59ba0593 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:10.483451 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24602d36-05fb-4daf-a104-954d59ba0593 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:10.483955 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24602d36-05fb-4daf-a104-954d59ba0593 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:10.486388 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 181/347] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:15:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:15:10.487531 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a96af6-1c39-4523-8828-b3110134aab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:10.487835 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ad804-78f5-4030-8957-3b08126752ee None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:10.488191 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a96af6-1c39-4523-8828-b3110134aab2 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:10.489031 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ad804-78f5-4030-8957-3b08126752ee None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:10.489139 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a96af6-1c39-4523-8828-b3110134aab2 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:10.489503 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a96af6-1c39-4523-8828-b3110134aab2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:10.489698 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ad804-78f5-4030-8957-3b08126752ee None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:10.490555 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a96af6-1c39-4523-8828-b3110134aab2 None admin] RBAC: Adding query filter params (group.id=f4e5616e2d87414ca17512f840cc2a59, role.id=7185d0cfbcd44502b1613bcfe1b42f6f, scope.project.id=4a955500342c498384e96caede5f019f) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:10.491820 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 182/348] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:15:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:15:10.492682 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5ad804-78f5-4030-8957-3b08126752ee None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:10.495063 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a96af6-1c39-4523-8828-b3110134aab2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:10.496788 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a96af6-1c39-4523-8828-b3110134aab2 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:10.504589 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 167/349] 10.222.0.30 () {56 vars in 1376 bytes} [Wed Mar 30 01:15:10 2022] GET /identity/v3/role_assignments?group.id=f4e5616e2d87414ca17512f840cc2a59&scope.project.id=4a955500342c498384e96caede5f019f&role.id=7185d0cfbcd44502b1613bcfe1b42f6f => generated 260 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:15:10.506135 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc4ad2-71fa-407b-95b6-068a9dafff5b None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:10.506610 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc4ad2-71fa-407b-95b6-068a9dafff5b None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:10.507095 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc4ad2-71fa-407b-95b6-068a9dafff5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:10.529012 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-43dc4ad2-71fa-407b-95b6-068a9dafff5b None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:15:10.530457 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-43dc4ad2-71fa-407b-95b6-068a9dafff5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:15:10.607440 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 168/350] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:15:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 01:15:10.608712 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d990641f-52d4-4225-b251-2f81cd2a5e6f None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:10.608999 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d990641f-52d4-4225-b251-2f81cd2a5e6f None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:10.609276 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d990641f-52d4-4225-b251-2f81cd2a5e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:10.652419 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-d990641f-52d4-4225-b251-2f81cd2a5e6f None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:15:10.652419 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-d990641f-52d4-4225-b251-2f81cd2a5e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:15:10.655437 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5ad804-78f5-4030-8957-3b08126752ee None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:10.704847 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b8970f-0941-47d9-b0de-8f80050f33ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:10.705493 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b8970f-0941-47d9-b0de-8f80050f33ad None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:10.705493 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b8970f-0941-47d9-b0de-8f80050f33ad None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:10.705653 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b8970f-0941-47d9-b0de-8f80050f33ad None admin] PATH_INFO: `/v3/projects/4a955500342c498384e96caede5f019f` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:10.706856 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b8970f-0941-47d9-b0de-8f80050f33ad None admin] RBAC: Authorizing `identity:get_project(project_id=4a955500342c498384e96caede5f019f)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:10.709863 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b8970f-0941-47d9-b0de-8f80050f33ad None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:10.712394 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 183/351] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Mar 30 01:15:10 2022] GET /identity/v3/projects/4a955500342c498384e96caede5f019f => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:10.713459 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b8970f-0941-47d9-b0de-8f80050f33ad None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:10.746597 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 169/352] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:15:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 01:15:10.747776 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d990641f-52d4-4225-b251-2f81cd2a5e6f None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:10.855829 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b8970f-0941-47d9-b0de-8f80050f33ad None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:10.877099 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d990641f-52d4-4225-b251-2f81cd2a5e6f None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:10.892218 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff964d0-8263-4503-9681-6da888ce61c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:10.893307 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff964d0-8263-4503-9681-6da888ce61c1 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:10.893734 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff964d0-8263-4503-9681-6da888ce61c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:10.894130 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff964d0-8263-4503-9681-6da888ce61c1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:10.907065 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff964d0-8263-4503-9681-6da888ce61c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:15:10.917325 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26421068-d83b-4dcf-9b2c-1f7ed1857a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:10.917501 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-aff964d0-8263-4503-9681-6da888ce61c1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 30 01:15:10.918527 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26421068-d83b-4dcf-9b2c-1f7ed1857a2c None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:10.919795 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26421068-d83b-4dcf-9b2c-1f7ed1857a2c None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:10.920267 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26421068-d83b-4dcf-9b2c-1f7ed1857a2c None admin] PATH_INFO: `/v3/groups/f4e5616e2d87414ca17512f840cc2a59` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:10.922768 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 184/353] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Mar 30 01:15:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:10.924093 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff964d0-8263-4503-9681-6da888ce61c1 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:10.925450 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26421068-d83b-4dcf-9b2c-1f7ed1857a2c None admin] RBAC: Authorizing `identity:get_group(group_id=f4e5616e2d87414ca17512f840cc2a59)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:10.927769 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26421068-d83b-4dcf-9b2c-1f7ed1857a2c None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:10.931111 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 170/354] 10.222.0.30 () {56 vars in 1180 bytes} [Wed Mar 30 01:15:10 2022] GET /identity/v3/groups/f4e5616e2d87414ca17512f840cc2a59 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:10.932268 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26421068-d83b-4dcf-9b2c-1f7ed1857a2c None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:11.047445 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff964d0-8263-4503-9681-6da888ce61c1 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:11.090135 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26421068-d83b-4dcf-9b2c-1f7ed1857a2c None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:11.101852 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38358d71-4ab3-42d6-ba81-121bbbfdd43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:11.103015 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38358d71-4ab3-42d6-ba81-121bbbfdd43d None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:11.103473 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38358d71-4ab3-42d6-ba81-121bbbfdd43d None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:11.103917 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38358d71-4ab3-42d6-ba81-121bbbfdd43d None admin] PATH_INFO: `/v3/roles/member` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:11.123037 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38358d71-4ab3-42d6-ba81-121bbbfdd43d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:15:11.130329 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-38358d71-4ab3-42d6-ba81-121bbbfdd43d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 30 01:15:11.136933 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 185/355] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Mar 30 01:15:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:11.139332 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38358d71-4ab3-42d6-ba81-121bbbfdd43d None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:11.158547 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ca907-0502-4ddc-8532-72d5db361b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:11.159521 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ca907-0502-4ddc-8532-72d5db361b60 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:11.160007 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ca907-0502-4ddc-8532-72d5db361b60 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:11.160575 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ca907-0502-4ddc-8532-72d5db361b60 None admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:11.161510 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088ca907-0502-4ddc-8532-72d5db361b60 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:11.161987 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088ca907-0502-4ddc-8532-72d5db361b60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:11.163560 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088ca907-0502-4ddc-8532-72d5db361b60 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:11.179334 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 171/356] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Mar 30 01:15:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:11.183177 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ca907-0502-4ddc-8532-72d5db361b60 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:11.295168 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38358d71-4ab3-42d6-ba81-121bbbfdd43d None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:11.321978 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ca907-0502-4ddc-8532-72d5db361b60 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:11.336453 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be45c153-c355-4fe2-b9ba-0abafd398185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:11.337342 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be45c153-c355-4fe2-b9ba-0abafd398185 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:11.337776 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be45c153-c355-4fe2-b9ba-0abafd398185 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:11.338186 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be45c153-c355-4fe2-b9ba-0abafd398185 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:11.339178 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be45c153-c355-4fe2-b9ba-0abafd398185 None admin] RBAC: Adding query filter params (group.id=f4e5616e2d87414ca17512f840cc2a59, role.id=7ab1dc76ea3e450689be4c2ab56097f4, scope.project.id=4a955500342c498384e96caede5f019f) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:11.339692 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be45c153-c355-4fe2-b9ba-0abafd398185 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:11.341325 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be45c153-c355-4fe2-b9ba-0abafd398185 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:11.348321 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 186/357] 10.222.0.30 () {56 vars in 1376 bytes} [Wed Mar 30 01:15:11 2022] GET /identity/v3/role_assignments?group.id=f4e5616e2d87414ca17512f840cc2a59&scope.project.id=4a955500342c498384e96caede5f019f&role.id=7ab1dc76ea3e450689be4c2ab56097f4 => generated 260 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:11.349413 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be45c153-c355-4fe2-b9ba-0abafd398185 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:11.357417 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fadee7f-22e7-4f86-a19d-d110cba158d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:11.358361 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fadee7f-22e7-4f86-a19d-d110cba158d0 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:11.358953 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fadee7f-22e7-4f86-a19d-d110cba158d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:11.359535 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fadee7f-22e7-4f86-a19d-d110cba158d0 None admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:11.360531 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fadee7f-22e7-4f86-a19d-d110cba158d0 None admin] RBAC: Adding query filter params (name=member) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:11.361050 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fadee7f-22e7-4f86-a19d-d110cba158d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:11.362666 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fadee7f-22e7-4f86-a19d-d110cba158d0 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:11.373198 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 172/358] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Mar 30 01:15:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:11.374901 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e53db-5371-4cf0-b348-c3ef1b494146 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:11.375404 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e53db-5371-4cf0-b348-c3ef1b494146 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:11.375876 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e53db-5371-4cf0-b348-c3ef1b494146 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:11.378071 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 173/359] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:15:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:15:11.379357 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13e53db-5371-4cf0-b348-c3ef1b494146 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:11.477295 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be45c153-c355-4fe2-b9ba-0abafd398185 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:11.487831 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13e53db-5371-4cf0-b348-c3ef1b494146 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:11.517528 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a749e6-01e8-4269-bbda-7fe4b66b2e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:11.518690 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a749e6-01e8-4269-bbda-7fe4b66b2e94 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:11.519169 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a749e6-01e8-4269-bbda-7fe4b66b2e94 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:11.519667 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a749e6-01e8-4269-bbda-7fe4b66b2e94 None admin] PATH_INFO: `/v3/users/5083f6dc1ba44ef891186eb88c774d39` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:11.521723 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a749e6-01e8-4269-bbda-7fe4b66b2e94 None admin] RBAC: Authorizing `identity:get_user(user_id=5083f6dc1ba44ef891186eb88c774d39)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:11.523642 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a749e6-01e8-4269-bbda-7fe4b66b2e94 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:11.525694 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 187/360] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Mar 30 01:15:11 2022] GET /identity/v3/users/5083f6dc1ba44ef891186eb88c774d39 => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:11.525845 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341597a1-1029-4ecf-b5a6-3e752491076c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:11.526604 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341597a1-1029-4ecf-b5a6-3e752491076c None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:11.527012 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341597a1-1029-4ecf-b5a6-3e752491076c None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:11.527382 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341597a1-1029-4ecf-b5a6-3e752491076c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:11.527787 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f2920-f913-4969-90a5-0a8260e2b58e None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:11.528214 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f2920-f913-4969-90a5-0a8260e2b58e None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:11.528647 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f2920-f913-4969-90a5-0a8260e2b58e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:11.556032 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-573f2920-f913-4969-90a5-0a8260e2b58e None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:15:11.558122 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-573f2920-f913-4969-90a5-0a8260e2b58e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:15:11.617505 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341597a1-1029-4ecf-b5a6-3e752491076c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:11.621966 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341597a1-1029-4ecf-b5a6-3e752491076c None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:11.647972 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 188/361] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:15:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 01:15:11.649785 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beeb5f9-d078-4bee-b378-05bd5aa9a1a6 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:11.650243 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beeb5f9-d078-4bee-b378-05bd5aa9a1a6 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:11.650694 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beeb5f9-d078-4bee-b378-05bd5aa9a1a6 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:11.652634 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 189/362] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:15:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:15:11.653563 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beeb5f9-d078-4bee-b378-05bd5aa9a1a6 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:11.740872 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 174/363] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Mar 30 01:15:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 30 01:15:11.742177 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ecae6b-67d5-46bc-88cb-5ce12c436374 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:11.748040 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ecae6b-67d5-46bc-88cb-5ce12c436374 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:11.748539 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ecae6b-67d5-46bc-88cb-5ce12c436374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:11.766027 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-62ecae6b-67d5-46bc-88cb-5ce12c436374 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:15:11.767506 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-62ecae6b-67d5-46bc-88cb-5ce12c436374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:15:11.779607 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beeb5f9-d078-4bee-b378-05bd5aa9a1a6 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:11.819619 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1688888d-da7c-4130-816b-57b98e982dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:11.820645 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688888d-da7c-4130-816b-57b98e982dbe None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:11.821143 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688888d-da7c-4130-816b-57b98e982dbe None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:11.821605 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688888d-da7c-4130-816b-57b98e982dbe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:11.822618 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1688888d-da7c-4130-816b-57b98e982dbe None admin] RBAC: Adding query filter params (role.id=1dffd8c286fa4de1b7a059d5c5da54f8, user.id=5083f6dc1ba44ef891186eb88c774d39, scope.system=all) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:11.823146 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1688888d-da7c-4130-816b-57b98e982dbe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:11.826106 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1688888d-da7c-4130-816b-57b98e982dbe None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:11.841491 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 190/364] 10.222.0.30 () {56 vars in 1308 bytes} [Wed Mar 30 01:15:11 2022] GET /identity/v3/role_assignments?user.id=5083f6dc1ba44ef891186eb88c774d39&scope.system=all&role.id=1dffd8c286fa4de1b7a059d5c5da54f8 => generated 510 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:11.842814 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1688888d-da7c-4130-816b-57b98e982dbe None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:11.858579 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 175/365] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:15:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 01:15:11.860155 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ecae6b-67d5-46bc-88cb-5ce12c436374 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:12.001175 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ecae6b-67d5-46bc-88cb-5ce12c436374 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:12.043286 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd05bb-5f30-4604-9641-3e4c865fff21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:12.045135 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd05bb-5f30-4604-9641-3e4c865fff21 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:12.045626 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd05bb-5f30-4604-9641-3e4c865fff21 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:12.046113 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd05bb-5f30-4604-9641-3e4c865fff21 None admin] PATH_INFO: `/v3/projects/9a11dd1e0b1549e8b39995a2cbec195f` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:12.047630 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbd05bb-5f30-4604-9641-3e4c865fff21 None admin] RBAC: Authorizing `identity:get_project(project_id=9a11dd1e0b1549e8b39995a2cbec195f)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:12.049322 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbd05bb-5f30-4604-9641-3e4c865fff21 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:12.052505 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 176/366] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Mar 30 01:15:11 2022] GET /identity/v3/projects/9a11dd1e0b1549e8b39995a2cbec195f => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:12.053619 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd05bb-5f30-4604-9641-3e4c865fff21 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:12.091195 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1688888d-da7c-4130-816b-57b98e982dbe None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:12.132523 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990df66b-d9a8-4624-a1e2-7d5c194fb5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:12.133343 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990df66b-d9a8-4624-a1e2-7d5c194fb5f5 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:12.133625 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990df66b-d9a8-4624-a1e2-7d5c194fb5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:12.133899 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990df66b-d9a8-4624-a1e2-7d5c194fb5f5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:12.145199 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990df66b-d9a8-4624-a1e2-7d5c194fb5f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:15:12.154565 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-990df66b-d9a8-4624-a1e2-7d5c194fb5f5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 30 01:15:12.156644 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 191/367] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Mar 30 01:15:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:12.157668 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990df66b-d9a8-4624-a1e2-7d5c194fb5f5 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:12.177039 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd05bb-5f30-4604-9641-3e4c865fff21 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:12.220885 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e359e-21c6-4237-8522-99a887094ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:12.222187 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e359e-21c6-4237-8522-99a887094ace None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:12.223320 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e359e-21c6-4237-8522-99a887094ace None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:12.224088 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e359e-21c6-4237-8522-99a887094ace None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:12.238275 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8e359e-21c6-4237-8522-99a887094ace None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:15:12.247566 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-dd8e359e-21c6-4237-8522-99a887094ace None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 30 01:15:12.249248 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 177/368] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Mar 30 01:15:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:12.250612 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e359e-21c6-4237-8522-99a887094ace None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:12.279444 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990df66b-d9a8-4624-a1e2-7d5c194fb5f5 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:12.329000 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93c0e68-cc98-4455-bae7-3845f2b35323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:12.329866 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c0e68-cc98-4455-bae7-3845f2b35323 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:12.330364 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c0e68-cc98-4455-bae7-3845f2b35323 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:12.330847 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c0e68-cc98-4455-bae7-3845f2b35323 None admin] PATH_INFO: `/v3/groups/f4e5616e2d87414ca17512f840cc2a59` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:12.332334 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93c0e68-cc98-4455-bae7-3845f2b35323 None admin] RBAC: Authorizing `identity:get_group(group_id=f4e5616e2d87414ca17512f840cc2a59)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:12.333937 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93c0e68-cc98-4455-bae7-3845f2b35323 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:12.338184 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 192/369] 10.222.0.30 () {56 vars in 1180 bytes} [Wed Mar 30 01:15:12 2022] GET /identity/v3/groups/f4e5616e2d87414ca17512f840cc2a59 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:12.339212 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93c0e68-cc98-4455-bae7-3845f2b35323 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:12.370225 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e359e-21c6-4237-8522-99a887094ace None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:12.406779 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e407fb-2e32-4de3-8b2e-77255b1fc9fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:12.407459 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e407fb-2e32-4de3-8b2e-77255b1fc9fc None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:12.407745 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e407fb-2e32-4de3-8b2e-77255b1fc9fc None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:12.408025 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e407fb-2e32-4de3-8b2e-77255b1fc9fc None admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:12.408774 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e407fb-2e32-4de3-8b2e-77255b1fc9fc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:12.409083 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e407fb-2e32-4de3-8b2e-77255b1fc9fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:12.413679 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e407fb-2e32-4de3-8b2e-77255b1fc9fc None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:12.421852 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 178/370] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Mar 30 01:15:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:12.423146 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e407fb-2e32-4de3-8b2e-77255b1fc9fc None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:12.451111 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93c0e68-cc98-4455-bae7-3845f2b35323 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:12.501673 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc72f27-f8e3-4a7f-aaf0-b4256e3d6ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:12.502396 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc72f27-f8e3-4a7f-aaf0-b4256e3d6ee5 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:12.502683 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc72f27-f8e3-4a7f-aaf0-b4256e3d6ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:12.503150 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc72f27-f8e3-4a7f-aaf0-b4256e3d6ee5 None admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:12.504051 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc72f27-f8e3-4a7f-aaf0-b4256e3d6ee5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:12.506982 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc72f27-f8e3-4a7f-aaf0-b4256e3d6ee5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:12.506982 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc72f27-f8e3-4a7f-aaf0-b4256e3d6ee5 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:12.518505 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 193/371] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Mar 30 01:15:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:12.519396 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc72f27-f8e3-4a7f-aaf0-b4256e3d6ee5 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:12.558391 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e407fb-2e32-4de3-8b2e-77255b1fc9fc None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:12.603416 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e235b6a-d1cc-4084-886e-fa7779480796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:12.604750 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e235b6a-d1cc-4084-886e-fa7779480796 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:12.605246 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e235b6a-d1cc-4084-886e-fa7779480796 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:12.605684 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e235b6a-d1cc-4084-886e-fa7779480796 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:12.607074 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e235b6a-d1cc-4084-886e-fa7779480796 None admin] RBAC: Adding query filter params (group.id=f4e5616e2d87414ca17512f840cc2a59, role.id=7185d0cfbcd44502b1613bcfe1b42f6f, scope.project.id=9a11dd1e0b1549e8b39995a2cbec195f) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:12.607849 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e235b6a-d1cc-4084-886e-fa7779480796 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:12.609905 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e235b6a-d1cc-4084-886e-fa7779480796 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:12.617673 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 179/372] 10.222.0.30 () {56 vars in 1376 bytes} [Wed Mar 30 01:15:12 2022] GET /identity/v3/role_assignments?group.id=f4e5616e2d87414ca17512f840cc2a59&scope.project.id=9a11dd1e0b1549e8b39995a2cbec195f&role.id=7185d0cfbcd44502b1613bcfe1b42f6f => generated 260 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:12.623771 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e235b6a-d1cc-4084-886e-fa7779480796 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:12.653907 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc72f27-f8e3-4a7f-aaf0-b4256e3d6ee5 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:12.722534 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e29e89d-545a-450c-acc1-5e9c005b3ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:12.723373 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29e89d-545a-450c-acc1-5e9c005b3ee9 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:12.723656 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29e89d-545a-450c-acc1-5e9c005b3ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:12.723933 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29e89d-545a-450c-acc1-5e9c005b3ee9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:12.842471 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e235b6a-d1cc-4084-886e-fa7779480796 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:12.866426 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e29e89d-545a-450c-acc1-5e9c005b3ee9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:12.868765 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e29e89d-545a-450c-acc1-5e9c005b3ee9 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:12.887753 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebdaa2e-1128-404b-a2e2-95de31938bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:12.888407 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebdaa2e-1128-404b-a2e2-95de31938bba None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:12.888692 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebdaa2e-1128-404b-a2e2-95de31938bba None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:12.888969 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebdaa2e-1128-404b-a2e2-95de31938bba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:12.961142 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebdaa2e-1128-404b-a2e2-95de31938bba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:12.962603 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebdaa2e-1128-404b-a2e2-95de31938bba None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:12.975601 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 194/373] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Mar 30 01:15:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 30 01:15:12.981213 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e29e89d-545a-450c-acc1-5e9c005b3ee9 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:13.066171 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 180/374] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Mar 30 01:15:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 30 01:15:13.072198 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebdaa2e-1128-404b-a2e2-95de31938bba None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:13.087182 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e29e89d-545a-450c-acc1-5e9c005b3ee9 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:13.131581 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a06d906-73ba-4cb1-92d0-ee3568e27ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:13.132445 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a06d906-73ba-4cb1-92d0-ee3568e27ba4 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:13.132727 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a06d906-73ba-4cb1-92d0-ee3568e27ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:13.132997 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a06d906-73ba-4cb1-92d0-ee3568e27ba4 None admin] PATH_INFO: `/v3/projects/9a11dd1e0b1549e8b39995a2cbec195f` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:13.134259 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a06d906-73ba-4cb1-92d0-ee3568e27ba4 None admin] RBAC: Authorizing `identity:get_project(project_id=9a11dd1e0b1549e8b39995a2cbec195f)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:13.135739 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a06d906-73ba-4cb1-92d0-ee3568e27ba4 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:13.137730 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 195/375] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Mar 30 01:15:12 2022] GET /identity/v3/projects/9a11dd1e0b1549e8b39995a2cbec195f => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:13.142989 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a06d906-73ba-4cb1-92d0-ee3568e27ba4 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:13.185348 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebdaa2e-1128-404b-a2e2-95de31938bba None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:13.240022 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b72a7bd-1bf6-4ba6-86b2-4d42b23f9a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:13.240902 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b72a7bd-1bf6-4ba6-86b2-4d42b23f9a92 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:13.241185 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b72a7bd-1bf6-4ba6-86b2-4d42b23f9a92 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:13.241461 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b72a7bd-1bf6-4ba6-86b2-4d42b23f9a92 None admin] PATH_INFO: `/v3/projects/8e7672bb827a4f4ea1fedd14bfb4311b` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:13.247497 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b72a7bd-1bf6-4ba6-86b2-4d42b23f9a92 None admin] RBAC: Authorizing `identity:get_project(project_id=8e7672bb827a4f4ea1fedd14bfb4311b)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:13.248962 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b72a7bd-1bf6-4ba6-86b2-4d42b23f9a92 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:13.251048 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 181/376] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Mar 30 01:15:13 2022] GET /identity/v3/projects/8e7672bb827a4f4ea1fedd14bfb4311b => generated 344 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:15:13.256335 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b72a7bd-1bf6-4ba6-86b2-4d42b23f9a92 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:13.262276 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a06d906-73ba-4cb1-92d0-ee3568e27ba4 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:13.305331 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e794b71a-bec1-4a15-afcd-30607110afe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:13.306206 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e794b71a-bec1-4a15-afcd-30607110afe8 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:13.306485 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e794b71a-bec1-4a15-afcd-30607110afe8 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:13.306779 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e794b71a-bec1-4a15-afcd-30607110afe8 None admin] PATH_INFO: `/v3/groups/f4e5616e2d87414ca17512f840cc2a59` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:13.311009 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e794b71a-bec1-4a15-afcd-30607110afe8 None admin] RBAC: Authorizing `identity:get_group(group_id=f4e5616e2d87414ca17512f840cc2a59)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:13.312488 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e794b71a-bec1-4a15-afcd-30607110afe8 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:13.314486 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 196/377] 10.222.0.30 () {56 vars in 1180 bytes} [Wed Mar 30 01:15:13 2022] GET /identity/v3/groups/f4e5616e2d87414ca17512f840cc2a59 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:15:13.320245 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e794b71a-bec1-4a15-afcd-30607110afe8 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:13.370458 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b72a7bd-1bf6-4ba6-86b2-4d42b23f9a92 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:13.414002 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7afc83-c169-41fc-abf9-15d42e33a3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:13.414878 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7afc83-c169-41fc-abf9-15d42e33a3fc None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:13.415166 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7afc83-c169-41fc-abf9-15d42e33a3fc None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:13.415445 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7afc83-c169-41fc-abf9-15d42e33a3fc None admin] PATH_INFO: `/v3/groups/1c13717fabab49609f633047e3f1a4eb` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:13.427493 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7afc83-c169-41fc-abf9-15d42e33a3fc None admin] RBAC: Authorizing `identity:get_group(group_id=1c13717fabab49609f633047e3f1a4eb)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:13.429011 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7afc83-c169-41fc-abf9-15d42e33a3fc None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:13.431166 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 182/378] 10.222.0.30 () {56 vars in 1180 bytes} [Wed Mar 30 01:15:13 2022] GET /identity/v3/groups/1c13717fabab49609f633047e3f1a4eb => generated 229 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:15:13.436735 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7afc83-c169-41fc-abf9-15d42e33a3fc None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:13.475572 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e794b71a-bec1-4a15-afcd-30607110afe8 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:13.548742 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7afc83-c169-41fc-abf9-15d42e33a3fc None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:13.555132 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf41602-6a7b-4e32-8a4b-e959e63db729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:13.555807 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf41602-6a7b-4e32-8a4b-e959e63db729 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:13.556093 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf41602-6a7b-4e32-8a4b-e959e63db729 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:13.556374 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf41602-6a7b-4e32-8a4b-e959e63db729 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:13.557213 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf41602-6a7b-4e32-8a4b-e959e63db729 None admin] RBAC: Adding query filter params (group.id=f4e5616e2d87414ca17512f840cc2a59, role.id=7ab1dc76ea3e450689be4c2ab56097f4, scope.project.id=9a11dd1e0b1549e8b39995a2cbec195f) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:13.557527 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf41602-6a7b-4e32-8a4b-e959e63db729 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:13.558998 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf41602-6a7b-4e32-8a4b-e959e63db729 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:13.565223 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 197/379] 10.222.0.30 () {56 vars in 1376 bytes} [Wed Mar 30 01:15:13 2022] GET /identity/v3/role_assignments?group.id=f4e5616e2d87414ca17512f840cc2a59&scope.project.id=9a11dd1e0b1549e8b39995a2cbec195f&role.id=7ab1dc76ea3e450689be4c2ab56097f4 => generated 260 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:13.588462 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f6d441-4dff-4eec-84bd-1d826c2197bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:13.589149 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f6d441-4dff-4eec-84bd-1d826c2197bd None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:13.589434 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f6d441-4dff-4eec-84bd-1d826c2197bd None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:13.589715 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f6d441-4dff-4eec-84bd-1d826c2197bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:13.590625 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f6d441-4dff-4eec-84bd-1d826c2197bd None admin] RBAC: Adding query filter params (group.id=1c13717fabab49609f633047e3f1a4eb, role.id=36909bbf31d04993bb2a9fe587b572dc, scope.project.id=8e7672bb827a4f4ea1fedd14bfb4311b) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:13.590980 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f6d441-4dff-4eec-84bd-1d826c2197bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:13.592510 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f6d441-4dff-4eec-84bd-1d826c2197bd None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:13.599487 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 183/380] 10.222.0.30 () {56 vars in 1376 bytes} [Wed Mar 30 01:15:13 2022] GET /identity/v3/role_assignments?group.id=1c13717fabab49609f633047e3f1a4eb&scope.project.id=8e7672bb827a4f4ea1fedd14bfb4311b&role.id=36909bbf31d04993bb2a9fe587b572dc => generated 260 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:15:13.775101 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf9ec38-3a93-4124-bb30-46680300a814 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:13.775522 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf9ec38-3a93-4124-bb30-46680300a814 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:13.775914 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf9ec38-3a93-4124-bb30-46680300a814 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:13.778058 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 198/381] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:15:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:15:13.784114 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6671c1-fae9-422e-9568-da7d3e7cc7d2 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:13.784560 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6671c1-fae9-422e-9568-da7d3e7cc7d2 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:13.784864 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6671c1-fae9-422e-9568-da7d3e7cc7d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:13.803424 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-9a6671c1-fae9-422e-9568-da7d3e7cc7d2 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:15:13.804649 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-9a6671c1-fae9-422e-9568-da7d3e7cc7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:15:13.880570 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 184/382] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:15:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 01:15:13.903696 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf9ec38-3a93-4124-bb30-46680300a814 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:14.015248 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf9ec38-3a93-4124-bb30-46680300a814 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:14.052307 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d2c6a-69e6-4e61-831c-a454e9c49e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:14.053490 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d2c6a-69e6-4e61-831c-a454e9c49e3d None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:14.053973 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d2c6a-69e6-4e61-831c-a454e9c49e3d None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:14.054459 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d2c6a-69e6-4e61-831c-a454e9c49e3d None admin] PATH_INFO: `/v3/roles/member` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:14.065214 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509d2c6a-69e6-4e61-831c-a454e9c49e3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:15:14.072672 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-509d2c6a-69e6-4e61-831c-a454e9c49e3d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 30 01:15:14.074452 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 199/383] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Mar 30 01:15:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:14.079990 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6671c1-fae9-422e-9568-da7d3e7cc7d2 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:14.196359 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6671c1-fae9-422e-9568-da7d3e7cc7d2 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:14.235854 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3e833-8311-433b-94c6-e9066f794a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:14.236870 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3e833-8311-433b-94c6-e9066f794a50 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:14.237362 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3e833-8311-433b-94c6-e9066f794a50 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:14.237831 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3e833-8311-433b-94c6-e9066f794a50 None admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:14.239661 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f3e833-8311-433b-94c6-e9066f794a50 None admin] RBAC: Adding query filter params (name=member) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:14.240183 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f3e833-8311-433b-94c6-e9066f794a50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:14.241738 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f3e833-8311-433b-94c6-e9066f794a50 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:14.255230 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 185/384] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Mar 30 01:15:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:14.258271 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d2c6a-69e6-4e61-831c-a454e9c49e3d None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:14.311630 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c6beb-f485-4e3c-91c9-e20732bc573a None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:14.312244 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c6beb-f485-4e3c-91c9-e20732bc573a None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:14.312754 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c6beb-f485-4e3c-91c9-e20732bc573a None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:14.314784 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 186/385] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:15:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 01:15:14.319943 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c8647-0d6a-497b-9ad9-6dbb83ccc4de None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:14.320469 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c8647-0d6a-497b-9ad9-6dbb83ccc4de None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:14.320960 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c8647-0d6a-497b-9ad9-6dbb83ccc4de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:14.339313 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-8b1c8647-0d6a-497b-9ad9-6dbb83ccc4de None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:15:14.340864 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-8b1c8647-0d6a-497b-9ad9-6dbb83ccc4de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:15:14.409004 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d2c6a-69e6-4e61-831c-a454e9c49e3d None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:14.417399 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 187/386] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:15:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 01:15:14.442679 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1c8647-0d6a-497b-9ad9-6dbb83ccc4de None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:14.483450 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d6955e-8c97-4b81-9509-b594e6d3783d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:14.484310 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6955e-8c97-4b81-9509-b594e6d3783d None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:14.484591 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6955e-8c97-4b81-9509-b594e6d3783d None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:14.484864 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6955e-8c97-4b81-9509-b594e6d3783d None admin] PATH_INFO: `/v3/groups/f4e5616e2d87414ca17512f840cc2a59` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:14.486042 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d6955e-8c97-4b81-9509-b594e6d3783d None admin] RBAC: Authorizing `identity:get_group(group_id=f4e5616e2d87414ca17512f840cc2a59)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:14.487529 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d6955e-8c97-4b81-9509-b594e6d3783d None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:14.489518 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 200/387] 10.222.0.30 () {56 vars in 1180 bytes} [Wed Mar 30 01:15:14 2022] GET /identity/v3/groups/f4e5616e2d87414ca17512f840cc2a59 => generated 226 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:14.516793 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d6955e-8c97-4b81-9509-b594e6d3783d None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:14.561812 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1c8647-0d6a-497b-9ad9-6dbb83ccc4de None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:14.605328 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d00b3d-a34c-4449-8fe8-856010c1fc48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:14.606430 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d00b3d-a34c-4449-8fe8-856010c1fc48 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:14.606952 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d00b3d-a34c-4449-8fe8-856010c1fc48 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:14.607385 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d00b3d-a34c-4449-8fe8-856010c1fc48 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:14.632054 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d00b3d-a34c-4449-8fe8-856010c1fc48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:15:14.639463 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-e4d00b3d-a34c-4449-8fe8-856010c1fc48 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 30 01:15:14.642170 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 188/388] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Mar 30 01:15:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 01:15:14.651488 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d00b3d-a34c-4449-8fe8-856010c1fc48 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:14.707669 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d6955e-8c97-4b81-9509-b594e6d3783d None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:14.777518 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07175319-a68a-4ce5-8d07-064eae9f18aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:14.778629 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07175319-a68a-4ce5-8d07-064eae9f18aa None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:14.779100 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07175319-a68a-4ce5-8d07-064eae9f18aa None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:14.779513 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07175319-a68a-4ce5-8d07-064eae9f18aa None admin] PATH_INFO: `/v3/projects/4a955500342c498384e96caede5f019f` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:14.782415 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07175319-a68a-4ce5-8d07-064eae9f18aa None admin] RBAC: Authorizing `identity:get_project(project_id=4a955500342c498384e96caede5f019f)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:14.784041 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07175319-a68a-4ce5-8d07-064eae9f18aa None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:14.789142 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 201/389] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Mar 30 01:15:14 2022] GET /identity/v3/projects/4a955500342c498384e96caede5f019f => generated 298 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:14.792740 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07175319-a68a-4ce5-8d07-064eae9f18aa None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:14.842499 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d00b3d-a34c-4449-8fe8-856010c1fc48 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:14.905379 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6649df-c86b-43c0-81f0-5ddce8c0eeba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:14.906045 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6649df-c86b-43c0-81f0-5ddce8c0eeba None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:14.906320 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6649df-c86b-43c0-81f0-5ddce8c0eeba None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:14.906592 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6649df-c86b-43c0-81f0-5ddce8c0eeba None admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:14.907365 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6649df-c86b-43c0-81f0-5ddce8c0eeba None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:14.907668 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6649df-c86b-43c0-81f0-5ddce8c0eeba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:14.909031 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6649df-c86b-43c0-81f0-5ddce8c0eeba None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:14.928616 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 189/390] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Mar 30 01:15:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:14.934340 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6649df-c86b-43c0-81f0-5ddce8c0eeba None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:14.947852 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07175319-a68a-4ce5-8d07-064eae9f18aa None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:15.032863 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015b9191-dcc6-466c-be28-3b4d5a39f8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:15.034132 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b9191-dcc6-466c-be28-3b4d5a39f8e4 None admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:15.034610 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b9191-dcc6-466c-be28-3b4d5a39f8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:15.035138 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b9191-dcc6-466c-be28-3b4d5a39f8e4 None admin] PATH_INFO: `/v3/projects/4a955500342c498384e96caede5f019f/groups/f4e5616e2d87414ca17512f840cc2a59/roles/7185d0cfbcd44502b1613bcfe1b42f6f` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:15.040426 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015b9191-dcc6-466c-be28-3b4d5a39f8e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=4a955500342c498384e96caede5f019f, group_id=f4e5616e2d87414ca17512f840cc2a59, role_id=7185d0cfbcd44502b1613bcfe1b42f6f)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:15.042120 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015b9191-dcc6-466c-be28-3b4d5a39f8e4 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:15.051733 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6649df-c86b-43c0-81f0-5ddce8c0eeba None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:15.082683 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 202/391] 10.222.0.30 () {58 vars in 1442 bytes} [Wed Mar 30 01:15:14 2022] PUT /identity/v3/projects/4a955500342c498384e96caede5f019f/groups/f4e5616e2d87414ca17512f840cc2a59/roles/7185d0cfbcd44502b1613bcfe1b42f6f => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:15:15.088024 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592751f2-da6a-4374-9760-80cd0f08b694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:15.088932 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592751f2-da6a-4374-9760-80cd0f08b694 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:15.089214 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592751f2-da6a-4374-9760-80cd0f08b694 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:15.089488 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592751f2-da6a-4374-9760-80cd0f08b694 None admin] PATH_INFO: `/v3/groups/f4e5616e2d87414ca17512f840cc2a59` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:15.091140 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592751f2-da6a-4374-9760-80cd0f08b694 None admin] RBAC: Authorizing `identity:get_group(group_id=f4e5616e2d87414ca17512f840cc2a59)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:15.092841 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592751f2-da6a-4374-9760-80cd0f08b694 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:15.094568 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 190/392] 10.222.0.30 () {56 vars in 1180 bytes} [Wed Mar 30 01:15:14 2022] GET /identity/v3/groups/f4e5616e2d87414ca17512f840cc2a59 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:15:15.101366 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015b9191-dcc6-466c-be28-3b4d5a39f8e4 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:15.221385 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015b9191-dcc6-466c-be28-3b4d5a39f8e4 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:15.264274 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e468b1-f627-4aa8-ba8c-29ff87433b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:15.265519 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e468b1-f627-4aa8-ba8c-29ff87433b61 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:15.266000 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e468b1-f627-4aa8-ba8c-29ff87433b61 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:15.266444 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e468b1-f627-4aa8-ba8c-29ff87433b61 None admin] PATH_INFO: `/v3/projects/4a955500342c498384e96caede5f019f` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:15.269324 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e468b1-f627-4aa8-ba8c-29ff87433b61 None admin] RBAC: Authorizing `identity:get_project(project_id=4a955500342c498384e96caede5f019f)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:15.271152 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e468b1-f627-4aa8-ba8c-29ff87433b61 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:15.273284 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 203/393] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Mar 30 01:15:15 2022] GET /identity/v3/projects/4a955500342c498384e96caede5f019f => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:15.279277 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592751f2-da6a-4374-9760-80cd0f08b694 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:15.405677 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592751f2-da6a-4374-9760-80cd0f08b694 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:15.446188 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298dd3e3-a6b6-4d86-a480-a6d0ca4690e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:15.447099 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298dd3e3-a6b6-4d86-a480-a6d0ca4690e0 None admin] REQUEST_METHOD: `PUT` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:15.447384 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298dd3e3-a6b6-4d86-a480-a6d0ca4690e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:15.447661 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298dd3e3-a6b6-4d86-a480-a6d0ca4690e0 None admin] PATH_INFO: `/v3/projects/4a955500342c498384e96caede5f019f/groups/f4e5616e2d87414ca17512f840cc2a59/roles/7ab1dc76ea3e450689be4c2ab56097f4` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:15.450988 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298dd3e3-a6b6-4d86-a480-a6d0ca4690e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=4a955500342c498384e96caede5f019f, group_id=f4e5616e2d87414ca17512f840cc2a59, role_id=7ab1dc76ea3e450689be4c2ab56097f4)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:15.452428 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298dd3e3-a6b6-4d86-a480-a6d0ca4690e0 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:15.481096 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 191/394] 10.222.0.30 () {58 vars in 1442 bytes} [Wed Mar 30 01:15:15 2022] PUT /identity/v3/projects/4a955500342c498384e96caede5f019f/groups/f4e5616e2d87414ca17512f840cc2a59/roles/7ab1dc76ea3e450689be4c2ab56097f4 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:15:15.796920 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90563c46-151e-4365-90c2-277b8da0aea2 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:15.797306 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90563c46-151e-4365-90c2-277b8da0aea2 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:15.797482 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90563c46-151e-4365-90c2-277b8da0aea2 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:15.799538 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 204/395] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:15:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:15:15.804810 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c544e-f055-4883-9b4c-b958d4f6992b None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:15.805111 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c544e-f055-4883-9b4c-b958d4f6992b None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:15.805389 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c544e-f055-4883-9b4c-b958d4f6992b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:15.826596 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-336c544e-f055-4883-9b4c-b958d4f6992b None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:15:15.827859 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-336c544e-f055-4883-9b4c-b958d4f6992b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:15:15.910798 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 192/396] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:15:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 01:15:15.935720 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90563c46-151e-4365-90c2-277b8da0aea2 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:16.045712 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90563c46-151e-4365-90c2-277b8da0aea2 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:16.087116 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9500518f-751f-4072-93b8-e33ecfd4ed22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:16.088321 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9500518f-751f-4072-93b8-e33ecfd4ed22 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:16.088800 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9500518f-751f-4072-93b8-e33ecfd4ed22 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:16.089317 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9500518f-751f-4072-93b8-e33ecfd4ed22 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:16.101328 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9500518f-751f-4072-93b8-e33ecfd4ed22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:15:16.108845 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-9500518f-751f-4072-93b8-e33ecfd4ed22 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 30 01:15:16.110650 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 205/397] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Mar 30 01:15:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:16.116739 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c544e-f055-4883-9b4c-b958d4f6992b None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:16.232125 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c544e-f055-4883-9b4c-b958d4f6992b None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:16.272385 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eae9003-a001-44ed-904d-b2f52a91c6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:16.273544 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae9003-a001-44ed-904d-b2f52a91c6f7 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:16.274105 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae9003-a001-44ed-904d-b2f52a91c6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:16.274589 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae9003-a001-44ed-904d-b2f52a91c6f7 None admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:16.275558 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eae9003-a001-44ed-904d-b2f52a91c6f7 None admin] RBAC: Adding query filter params (name=member) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:16.276136 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eae9003-a001-44ed-904d-b2f52a91c6f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:16.277697 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eae9003-a001-44ed-904d-b2f52a91c6f7 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:16.287690 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 193/398] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Mar 30 01:15:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:16.293742 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9500518f-751f-4072-93b8-e33ecfd4ed22 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:16.405933 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9500518f-751f-4072-93b8-e33ecfd4ed22 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:16.442358 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa23a9-56f2-414b-a150-fa31684116a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:16.443592 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa23a9-56f2-414b-a150-fa31684116a0 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:16.444096 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa23a9-56f2-414b-a150-fa31684116a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:16.444575 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa23a9-56f2-414b-a150-fa31684116a0 None admin] PATH_INFO: `/v3/groups/f4e5616e2d87414ca17512f840cc2a59` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:16.445981 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aa23a9-56f2-414b-a150-fa31684116a0 None admin] RBAC: Authorizing `identity:get_group(group_id=f4e5616e2d87414ca17512f840cc2a59)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:16.447639 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aa23a9-56f2-414b-a150-fa31684116a0 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:16.449748 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 206/399] 10.222.0.30 () {56 vars in 1180 bytes} [Wed Mar 30 01:15:16 2022] GET /identity/v3/groups/f4e5616e2d87414ca17512f840cc2a59 => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:16.455492 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eae9003-a001-44ed-904d-b2f52a91c6f7 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:16.576477 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eae9003-a001-44ed-904d-b2f52a91c6f7 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:16.626924 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13b432-7684-4308-aadf-b909fd3cde35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:16.628060 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13b432-7684-4308-aadf-b909fd3cde35 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:16.628566 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13b432-7684-4308-aadf-b909fd3cde35 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:16.629696 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13b432-7684-4308-aadf-b909fd3cde35 None admin] PATH_INFO: `/v3/projects/9a11dd1e0b1549e8b39995a2cbec195f` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:16.635516 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f13b432-7684-4308-aadf-b909fd3cde35 None admin] RBAC: Authorizing `identity:get_project(project_id=9a11dd1e0b1549e8b39995a2cbec195f)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:16.637290 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f13b432-7684-4308-aadf-b909fd3cde35 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:16.639617 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 194/400] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Mar 30 01:15:16 2022] GET /identity/v3/projects/9a11dd1e0b1549e8b39995a2cbec195f => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:16.645551 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa23a9-56f2-414b-a150-fa31684116a0 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:16.672618 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9513e8-dfe2-40f9-b4be-b18c9d4b6d8d None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:16.673218 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9513e8-dfe2-40f9-b4be-b18c9d4b6d8d None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:16.673695 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9513e8-dfe2-40f9-b4be-b18c9d4b6d8d None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:16.676015 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 195/401] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:15:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 01:15:16.687073 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0473290f-63ea-4b9b-87e6-c39d1dff640e None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:16.687738 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0473290f-63ea-4b9b-87e6-c39d1dff640e None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:16.688213 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0473290f-63ea-4b9b-87e6-c39d1dff640e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:16.714218 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-0473290f-63ea-4b9b-87e6-c39d1dff640e None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:15:16.716287 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-0473290f-63ea-4b9b-87e6-c39d1dff640e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:15:16.808334 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa23a9-56f2-414b-a150-fa31684116a0 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:16.849273 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 196/402] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:15:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 30 01:15:16.851123 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea329af8-1a3c-47d7-b9d1-0680514db2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:16.852019 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea329af8-1a3c-47d7-b9d1-0680514db2a0 None admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:16.852302 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea329af8-1a3c-47d7-b9d1-0680514db2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:16.852574 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea329af8-1a3c-47d7-b9d1-0680514db2a0 None admin] PATH_INFO: `/v3/projects/9a11dd1e0b1549e8b39995a2cbec195f/groups/f4e5616e2d87414ca17512f840cc2a59/roles/7185d0cfbcd44502b1613bcfe1b42f6f` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:16.867554 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea329af8-1a3c-47d7-b9d1-0680514db2a0 None admin] RBAC: Authorizing `identity:create_grant(project_id=9a11dd1e0b1549e8b39995a2cbec195f, group_id=f4e5616e2d87414ca17512f840cc2a59, role_id=7185d0cfbcd44502b1613bcfe1b42f6f)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:16.869017 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea329af8-1a3c-47d7-b9d1-0680514db2a0 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:16.873593 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0473290f-63ea-4b9b-87e6-c39d1dff640e None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:16.893083 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 207/403] 10.222.0.30 () {58 vars in 1442 bytes} [Wed Mar 30 01:15:16 2022] PUT /identity/v3/projects/9a11dd1e0b1549e8b39995a2cbec195f/groups/f4e5616e2d87414ca17512f840cc2a59/roles/7185d0cfbcd44502b1613bcfe1b42f6f => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:15:17.026313 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0473290f-63ea-4b9b-87e6-c39d1dff640e None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:17.101029 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb3f4f7-3134-458c-a4c7-9fdfca5a0dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:17.101847 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb3f4f7-3134-458c-a4c7-9fdfca5a0dd6 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:17.102126 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb3f4f7-3134-458c-a4c7-9fdfca5a0dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:17.102397 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb3f4f7-3134-458c-a4c7-9fdfca5a0dd6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:17.114585 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb3f4f7-3134-458c-a4c7-9fdfca5a0dd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:15:17.121894 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-9cb3f4f7-3134-458c-a4c7-9fdfca5a0dd6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 30 01:15:17.126824 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 197/404] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Mar 30 01:15:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 01:15:17.131858 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea329af8-1a3c-47d7-b9d1-0680514db2a0 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:17.138386 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5df73-3b6a-4c94-a19f-3e6362e6ce3e None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:17.139001 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5df73-3b6a-4c94-a19f-3e6362e6ce3e None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:17.139479 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5df73-3b6a-4c94-a19f-3e6362e6ce3e None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:17.141794 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 198/405] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:15:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 01:15:17.153190 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aba66a-0691-4e8c-b33c-63cb1484fd7e None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:17.153763 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aba66a-0691-4e8c-b33c-63cb1484fd7e None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:17.154235 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aba66a-0691-4e8c-b33c-63cb1484fd7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:17.182608 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-40aba66a-0691-4e8c-b33c-63cb1484fd7e None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:15:17.183865 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-40aba66a-0691-4e8c-b33c-63cb1484fd7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:15:17.256918 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 199/406] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:15:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 30 01:15:17.280290 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aba66a-0691-4e8c-b33c-63cb1484fd7e None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:17.318993 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea329af8-1a3c-47d7-b9d1-0680514db2a0 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:17.376708 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca89fc23-f092-4bcb-b6e9-8060594e21b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:17.377382 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89fc23-f092-4bcb-b6e9-8060594e21b6 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:17.377669 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89fc23-f092-4bcb-b6e9-8060594e21b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:17.377942 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89fc23-f092-4bcb-b6e9-8060594e21b6 None admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:17.378714 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca89fc23-f092-4bcb-b6e9-8060594e21b6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:17.379287 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca89fc23-f092-4bcb-b6e9-8060594e21b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:17.380975 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca89fc23-f092-4bcb-b6e9-8060594e21b6 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:17.397840 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 208/407] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Mar 30 01:15:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:17.403720 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca89fc23-f092-4bcb-b6e9-8060594e21b6 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:17.422579 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aba66a-0691-4e8c-b33c-63cb1484fd7e None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:17.460690 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6e657a-ca0c-436a-b1d4-0263680fe851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:17.461483 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e657a-ca0c-436a-b1d4-0263680fe851 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:17.461762 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e657a-ca0c-436a-b1d4-0263680fe851 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:17.462037 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e657a-ca0c-436a-b1d4-0263680fe851 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:17.493689 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6e657a-ca0c-436a-b1d4-0263680fe851 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:15:17.501919 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-7b6e657a-ca0c-436a-b1d4-0263680fe851 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 30 01:15:17.504445 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 200/408] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Mar 30 01:15:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 01:15:17.511572 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6e657a-ca0c-436a-b1d4-0263680fe851 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:17.531405 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca89fc23-f092-4bcb-b6e9-8060594e21b6 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:17.564955 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dcb4cd-8bcd-43b7-bfc2-6b389e7e1ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:17.566153 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dcb4cd-8bcd-43b7-bfc2-6b389e7e1ac8 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:17.567158 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dcb4cd-8bcd-43b7-bfc2-6b389e7e1ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:17.567626 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dcb4cd-8bcd-43b7-bfc2-6b389e7e1ac8 None admin] PATH_INFO: `/v3/groups/f4e5616e2d87414ca17512f840cc2a59` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:17.568993 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dcb4cd-8bcd-43b7-bfc2-6b389e7e1ac8 None admin] RBAC: Authorizing `identity:get_group(group_id=f4e5616e2d87414ca17512f840cc2a59)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:17.570641 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dcb4cd-8bcd-43b7-bfc2-6b389e7e1ac8 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:17.572476 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 209/409] 10.222.0.30 () {56 vars in 1180 bytes} [Wed Mar 30 01:15:17 2022] GET /identity/v3/groups/f4e5616e2d87414ca17512f840cc2a59 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:15:17.578070 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dcb4cd-8bcd-43b7-bfc2-6b389e7e1ac8 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:17.678894 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dcb4cd-8bcd-43b7-bfc2-6b389e7e1ac8 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:17.712784 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc92beae-687b-4058-a8a3-7a351a06c096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:17.713980 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92beae-687b-4058-a8a3-7a351a06c096 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:17.714454 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92beae-687b-4058-a8a3-7a351a06c096 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:17.714948 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92beae-687b-4058-a8a3-7a351a06c096 None admin] PATH_INFO: `/v3/projects/9a11dd1e0b1549e8b39995a2cbec195f` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:17.716316 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc92beae-687b-4058-a8a3-7a351a06c096 None admin] RBAC: Authorizing `identity:get_project(project_id=9a11dd1e0b1549e8b39995a2cbec195f)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:17.717952 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc92beae-687b-4058-a8a3-7a351a06c096 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:17.719934 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 210/410] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Mar 30 01:15:17 2022] GET /identity/v3/projects/9a11dd1e0b1549e8b39995a2cbec195f => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:15:17.726346 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc92beae-687b-4058-a8a3-7a351a06c096 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:17.741449 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6e657a-ca0c-436a-b1d4-0263680fe851 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:17.820007 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029686f3-c218-4dcd-a6d0-72b915b09ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:17.820683 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029686f3-c218-4dcd-a6d0-72b915b09ce1 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:17.820951 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029686f3-c218-4dcd-a6d0-72b915b09ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:17.821227 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029686f3-c218-4dcd-a6d0-72b915b09ce1 None admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:17.822041 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029686f3-c218-4dcd-a6d0-72b915b09ce1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:17.822347 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029686f3-c218-4dcd-a6d0-72b915b09ce1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:17.823795 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029686f3-c218-4dcd-a6d0-72b915b09ce1 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:17.826428 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc92beae-687b-4058-a8a3-7a351a06c096 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:17.845169 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 201/411] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Mar 30 01:15:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:15:17.851254 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029686f3-c218-4dcd-a6d0-72b915b09ce1 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:17.861492 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baf57ff-a026-4223-830b-43494d5e3e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:17.862671 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baf57ff-a026-4223-830b-43494d5e3e92 None admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:17.863795 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baf57ff-a026-4223-830b-43494d5e3e92 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:17.864262 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baf57ff-a026-4223-830b-43494d5e3e92 None admin] PATH_INFO: `/v3/projects/9a11dd1e0b1549e8b39995a2cbec195f/groups/f4e5616e2d87414ca17512f840cc2a59/roles/7ab1dc76ea3e450689be4c2ab56097f4` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:17.866767 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baf57ff-a026-4223-830b-43494d5e3e92 None admin] RBAC: Authorizing `identity:create_grant(project_id=9a11dd1e0b1549e8b39995a2cbec195f, group_id=f4e5616e2d87414ca17512f840cc2a59, role_id=7ab1dc76ea3e450689be4c2ab56097f4)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:17.868440 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baf57ff-a026-4223-830b-43494d5e3e92 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:17.886861 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 211/412] 10.222.0.30 () {58 vars in 1442 bytes} [Wed Mar 30 01:15:17 2022] PUT /identity/v3/projects/9a11dd1e0b1549e8b39995a2cbec195f/groups/f4e5616e2d87414ca17512f840cc2a59/roles/7ab1dc76ea3e450689be4c2ab56097f4 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:15:18.031321 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029686f3-c218-4dcd-a6d0-72b915b09ce1 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:18.077021 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6f12f8-47ad-4621-bcbd-f340c5774ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:18.077801 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f12f8-47ad-4621-bcbd-f340c5774ff5 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:18.078080 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f12f8-47ad-4621-bcbd-f340c5774ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:18.078352 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f12f8-47ad-4621-bcbd-f340c5774ff5 None admin] PATH_INFO: `/v3/groups/1c13717fabab49609f633047e3f1a4eb` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:18.079588 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6f12f8-47ad-4621-bcbd-f340c5774ff5 None admin] RBAC: Authorizing `identity:get_group(group_id=1c13717fabab49609f633047e3f1a4eb)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:18.081016 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6f12f8-47ad-4621-bcbd-f340c5774ff5 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:18.083735 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 202/413] 10.222.0.30 () {56 vars in 1180 bytes} [Wed Mar 30 01:15:17 2022] GET /identity/v3/groups/1c13717fabab49609f633047e3f1a4eb => generated 229 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:18.089357 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baf57ff-a026-4223-830b-43494d5e3e92 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:18.194222 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baf57ff-a026-4223-830b-43494d5e3e92 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:18.230803 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95692f4-b747-4b25-8b79-6e0c826afcda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:18.232008 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95692f4-b747-4b25-8b79-6e0c826afcda None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:18.232481 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95692f4-b747-4b25-8b79-6e0c826afcda None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:18.232969 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95692f4-b747-4b25-8b79-6e0c826afcda None admin] PATH_INFO: `/v3/projects/8e7672bb827a4f4ea1fedd14bfb4311b` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:18.234418 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95692f4-b747-4b25-8b79-6e0c826afcda None admin] RBAC: Authorizing `identity:get_project(project_id=8e7672bb827a4f4ea1fedd14bfb4311b)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:18.236102 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95692f4-b747-4b25-8b79-6e0c826afcda None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:18.242721 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 212/414] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Mar 30 01:15:18 2022] GET /identity/v3/projects/8e7672bb827a4f4ea1fedd14bfb4311b => generated 344 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:18.244224 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6f12f8-47ad-4621-bcbd-f340c5774ff5 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:18.371197 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6f12f8-47ad-4621-bcbd-f340c5774ff5 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:18.416688 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691f7145-9f59-4cee-a6d3-cc72951d2706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:18.417960 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f7145-9f59-4cee-a6d3-cc72951d2706 None admin] REQUEST_METHOD: `PUT` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:18.418436 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f7145-9f59-4cee-a6d3-cc72951d2706 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:18.418991 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f7145-9f59-4cee-a6d3-cc72951d2706 None admin] PATH_INFO: `/v3/projects/8e7672bb827a4f4ea1fedd14bfb4311b/groups/1c13717fabab49609f633047e3f1a4eb/roles/36909bbf31d04993bb2a9fe587b572dc` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:18.423974 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691f7145-9f59-4cee-a6d3-cc72951d2706 None admin] RBAC: Authorizing `identity:create_grant(project_id=8e7672bb827a4f4ea1fedd14bfb4311b, group_id=1c13717fabab49609f633047e3f1a4eb, role_id=36909bbf31d04993bb2a9fe587b572dc)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:18.425648 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691f7145-9f59-4cee-a6d3-cc72951d2706 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:18.449664 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 203/415] 10.222.0.30 () {58 vars in 1442 bytes} [Wed Mar 30 01:15:18 2022] PUT /identity/v3/projects/8e7672bb827a4f4ea1fedd14bfb4311b/groups/1c13717fabab49609f633047e3f1a4eb/roles/36909bbf31d04993bb2a9fe587b572dc => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:15:18.450743 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1844879a-0a74-4929-950e-f9e92a215bcf None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:18.451065 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1844879a-0a74-4929-950e-f9e92a215bcf None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:18.451566 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1844879a-0a74-4929-950e-f9e92a215bcf None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:18.453817 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 213/416] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:15:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 01:15:18.460078 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9524a892-c0cf-4ffb-97e8-5ad9f881197e None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:18.460745 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9524a892-c0cf-4ffb-97e8-5ad9f881197e None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:18.461224 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9524a892-c0cf-4ffb-97e8-5ad9f881197e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:18.480934 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-9524a892-c0cf-4ffb-97e8-5ad9f881197e None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:15:18.482658 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-9524a892-c0cf-4ffb-97e8-5ad9f881197e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:15:18.557621 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 204/417] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:15:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 01:15:18.581586 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1844879a-0a74-4929-950e-f9e92a215bcf None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:18.682229 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01aaeb2-cf01-4b33-83d5-17a16897d6ad None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:18.682527 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01aaeb2-cf01-4b33-83d5-17a16897d6ad None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:18.682734 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01aaeb2-cf01-4b33-83d5-17a16897d6ad None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:18.684719 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 205/418] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:15:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:15:18.689976 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8503327-09f4-4f42-81c0-c3a666092884 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:18.690532 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8503327-09f4-4f42-81c0-c3a666092884 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:18.691084 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8503327-09f4-4f42-81c0-c3a666092884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:18.707871 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1844879a-0a74-4929-950e-f9e92a215bcf None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:18.734878 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-f8503327-09f4-4f42-81c0-c3a666092884 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:15:18.736422 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-f8503327-09f4-4f42-81c0-c3a666092884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:15:18.760659 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1db008-3b77-4c52-a044-92469de30a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:18.761802 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1db008-3b77-4c52-a044-92469de30a95 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:18.762099 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1db008-3b77-4c52-a044-92469de30a95 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:18.762380 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1db008-3b77-4c52-a044-92469de30a95 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:18.776945 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1db008-3b77-4c52-a044-92469de30a95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:15:18.785944 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-1b1db008-3b77-4c52-a044-92469de30a95 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 30 01:15:18.787399 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 214/419] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Mar 30 01:15:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:18.792892 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1db008-3b77-4c52-a044-92469de30a95 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:18.827372 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 206/420] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:15:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 30 01:15:18.854088 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8503327-09f4-4f42-81c0-c3a666092884 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:18.921159 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1db008-3b77-4c52-a044-92469de30a95 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:18.956411 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58824e17-f7b5-41fb-94be-61c15a976a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:18.956809 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58824e17-f7b5-41fb-94be-61c15a976a4d None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:18.957170 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58824e17-f7b5-41fb-94be-61c15a976a4d None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:18.957726 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58824e17-f7b5-41fb-94be-61c15a976a4d None admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:18.958620 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58824e17-f7b5-41fb-94be-61c15a976a4d None admin] RBAC: Adding query filter params (name=member) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:18.958932 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58824e17-f7b5-41fb-94be-61c15a976a4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:18.960309 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58824e17-f7b5-41fb-94be-61c15a976a4d None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:18.969123 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 215/421] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Mar 30 01:15:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:15:18.979747 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58824e17-f7b5-41fb-94be-61c15a976a4d None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:19.008272 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8503327-09f4-4f42-81c0-c3a666092884 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:19.099524 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5600f911-19a7-47f6-af45-bb770cfc8ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:19.100545 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600f911-19a7-47f6-af45-bb770cfc8ecf None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:19.100918 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600f911-19a7-47f6-af45-bb770cfc8ecf None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:19.101315 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600f911-19a7-47f6-af45-bb770cfc8ecf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:19.104204 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58824e17-f7b5-41fb-94be-61c15a976a4d None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:19.119966 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5600f911-19a7-47f6-af45-bb770cfc8ecf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:15:19.127675 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-5600f911-19a7-47f6-af45-bb770cfc8ecf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 30 01:15:19.129664 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 207/422] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Mar 30 01:15:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 01:15:19.135493 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5600f911-19a7-47f6-af45-bb770cfc8ecf None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:19.140038 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c71b70-f524-4930-8387-e2631bed7b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:19.140862 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c71b70-f524-4930-8387-e2631bed7b5e None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:19.141290 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c71b70-f524-4930-8387-e2631bed7b5e None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:19.141727 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c71b70-f524-4930-8387-e2631bed7b5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:19.211120 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c71b70-f524-4930-8387-e2631bed7b5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:19.213253 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c71b70-f524-4930-8387-e2631bed7b5e None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:19.238571 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5600f911-19a7-47f6-af45-bb770cfc8ecf None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:19.273654 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871daf6-8ae0-4847-8218-2769a88cd629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:19.274488 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871daf6-8ae0-4847-8218-2769a88cd629 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:19.274906 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871daf6-8ae0-4847-8218-2769a88cd629 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:19.275468 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871daf6-8ae0-4847-8218-2769a88cd629 None admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:19.276198 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9871daf6-8ae0-4847-8218-2769a88cd629 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:19.276540 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9871daf6-8ae0-4847-8218-2769a88cd629 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:19.277971 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9871daf6-8ae0-4847-8218-2769a88cd629 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:19.287563 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 208/423] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Mar 30 01:15:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:19.293309 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871daf6-8ae0-4847-8218-2769a88cd629 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:19.316333 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 216/424] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Mar 30 01:15:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 30 01:15:19.327760 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c71b70-f524-4930-8387-e2631bed7b5e None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:19.399289 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871daf6-8ae0-4847-8218-2769a88cd629 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:19.434740 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd4e085-69af-4985-a7ea-0ad06ae4db25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:19.435646 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd4e085-69af-4985-a7ea-0ad06ae4db25 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:19.436042 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd4e085-69af-4985-a7ea-0ad06ae4db25 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:19.436414 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd4e085-69af-4985-a7ea-0ad06ae4db25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:19.450674 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c71b70-f524-4930-8387-e2631bed7b5e None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:19.485632 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dd999a-b41f-47b6-9806-689564bdee81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:19.486879 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd999a-b41f-47b6-9806-689564bdee81 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:19.487353 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd999a-b41f-47b6-9806-689564bdee81 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:19.487787 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd999a-b41f-47b6-9806-689564bdee81 None admin] PATH_INFO: `/v3/projects/4a955500342c498384e96caede5f019f` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:19.489731 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dd999a-b41f-47b6-9806-689564bdee81 None admin] RBAC: Authorizing `identity:get_project(project_id=4a955500342c498384e96caede5f019f)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:19.491396 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dd999a-b41f-47b6-9806-689564bdee81 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:19.493772 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 217/425] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Mar 30 01:15:19 2022] GET /identity/v3/projects/4a955500342c498384e96caede5f019f => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:19.501027 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dd999a-b41f-47b6-9806-689564bdee81 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:19.556744 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd4e085-69af-4985-a7ea-0ad06ae4db25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:19.558198 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd4e085-69af-4985-a7ea-0ad06ae4db25 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:19.632137 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dd999a-b41f-47b6-9806-689564bdee81 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:19.692381 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 209/426] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Mar 30 01:15:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 30 01:15:19.697820 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd4e085-69af-4985-a7ea-0ad06ae4db25 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:19.740044 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9cceec-cd30-40fb-b05d-acb83d602dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:19.740834 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9cceec-cd30-40fb-b05d-acb83d602dad None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:19.741115 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9cceec-cd30-40fb-b05d-acb83d602dad None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:19.741388 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9cceec-cd30-40fb-b05d-acb83d602dad None admin] PATH_INFO: `/v3/groups/f4e5616e2d87414ca17512f840cc2a59` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:19.743398 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9cceec-cd30-40fb-b05d-acb83d602dad None admin] RBAC: Authorizing `identity:get_group(group_id=f4e5616e2d87414ca17512f840cc2a59)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:19.744853 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9cceec-cd30-40fb-b05d-acb83d602dad None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:19.746787 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 218/427] 10.222.0.30 () {56 vars in 1180 bytes} [Wed Mar 30 01:15:19 2022] GET /identity/v3/groups/f4e5616e2d87414ca17512f840cc2a59 => generated 226 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:19.752080 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9cceec-cd30-40fb-b05d-acb83d602dad None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:19.798436 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd4e085-69af-4985-a7ea-0ad06ae4db25 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:19.833805 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c769a7-3f09-49e9-8610-1c0bc2de12f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:19.834672 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c769a7-3f09-49e9-8610-1c0bc2de12f9 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:19.834985 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c769a7-3f09-49e9-8610-1c0bc2de12f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:19.835261 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c769a7-3f09-49e9-8610-1c0bc2de12f9 None admin] PATH_INFO: `/v3/projects/4a955500342c498384e96caede5f019f` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:19.836460 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c769a7-3f09-49e9-8610-1c0bc2de12f9 None admin] RBAC: Authorizing `identity:get_project(project_id=4a955500342c498384e96caede5f019f)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:19.837897 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c769a7-3f09-49e9-8610-1c0bc2de12f9 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:19.839900 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 210/428] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Mar 30 01:15:19 2022] GET /identity/v3/projects/4a955500342c498384e96caede5f019f => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:19.845146 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c769a7-3f09-49e9-8610-1c0bc2de12f9 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:19.943743 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9cceec-cd30-40fb-b05d-acb83d602dad None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:19.949108 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c769a7-3f09-49e9-8610-1c0bc2de12f9 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:19.980794 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae565eb-51e2-4ad0-b413-00d467baeff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:19.982195 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae565eb-51e2-4ad0-b413-00d467baeff6 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:19.982930 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae565eb-51e2-4ad0-b413-00d467baeff6 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:19.983626 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae565eb-51e2-4ad0-b413-00d467baeff6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:19.985202 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae565eb-51e2-4ad0-b413-00d467baeff6 None admin] RBAC: Adding query filter params (group.id=f4e5616e2d87414ca17512f840cc2a59, role.id=7185d0cfbcd44502b1613bcfe1b42f6f, scope.project.id=4a955500342c498384e96caede5f019f) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:19.985938 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae565eb-51e2-4ad0-b413-00d467baeff6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:19.989062 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae565eb-51e2-4ad0-b413-00d467baeff6 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:19.999106 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 219/429] 10.222.0.30 () {56 vars in 1376 bytes} [Wed Mar 30 01:15:19 2022] GET /identity/v3/role_assignments?group.id=f4e5616e2d87414ca17512f840cc2a59&scope.project.id=4a955500342c498384e96caede5f019f&role.id=7185d0cfbcd44502b1613bcfe1b42f6f => generated 611 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:15:20.005142 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c27499b-fd0d-4459-9e2f-4eee96040515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:20.007092 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c27499b-fd0d-4459-9e2f-4eee96040515 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:20.007872 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c27499b-fd0d-4459-9e2f-4eee96040515 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:20.008782 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c27499b-fd0d-4459-9e2f-4eee96040515 None admin] PATH_INFO: `/v3/groups/f4e5616e2d87414ca17512f840cc2a59` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:20.011015 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c27499b-fd0d-4459-9e2f-4eee96040515 None admin] RBAC: Authorizing `identity:get_group(group_id=f4e5616e2d87414ca17512f840cc2a59)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:20.012758 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c27499b-fd0d-4459-9e2f-4eee96040515 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:20.015099 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 211/430] 10.222.0.30 () {56 vars in 1180 bytes} [Wed Mar 30 01:15:19 2022] GET /identity/v3/groups/f4e5616e2d87414ca17512f840cc2a59 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:15:20.021285 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae565eb-51e2-4ad0-b413-00d467baeff6 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:20.138612 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae565eb-51e2-4ad0-b413-00d467baeff6 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:20.153270 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a9593-49fa-4331-891c-dd7ec02f85d8 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:20.154229 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a9593-49fa-4331-891c-dd7ec02f85d8 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:20.154726 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a9593-49fa-4331-891c-dd7ec02f85d8 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:20.156995 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 212/431] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:15:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 01:15:20.162918 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90531afa-078d-48ec-8285-d4070dab11e8 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:20.163549 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90531afa-078d-48ec-8285-d4070dab11e8 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:20.164043 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90531afa-078d-48ec-8285-d4070dab11e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:20.190064 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f69ec0-cf0c-4bfd-82c5-7da5f5e2971e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:20.191049 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f69ec0-cf0c-4bfd-82c5-7da5f5e2971e None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:20.191533 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f69ec0-cf0c-4bfd-82c5-7da5f5e2971e None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:20.192069 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f69ec0-cf0c-4bfd-82c5-7da5f5e2971e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:20.193027 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f69ec0-cf0c-4bfd-82c5-7da5f5e2971e None admin] RBAC: Adding query filter params (group.id=f4e5616e2d87414ca17512f840cc2a59, role.id=7ab1dc76ea3e450689be4c2ab56097f4, scope.project.id=4a955500342c498384e96caede5f019f) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:20.193459 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f69ec0-cf0c-4bfd-82c5-7da5f5e2971e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:20.195069 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f69ec0-cf0c-4bfd-82c5-7da5f5e2971e None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:20.196142 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-90531afa-078d-48ec-8285-d4070dab11e8 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:15:20.197572 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-90531afa-078d-48ec-8285-d4070dab11e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:15:20.201937 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 220/432] 10.222.0.30 () {56 vars in 1376 bytes} [Wed Mar 30 01:15:20 2022] GET /identity/v3/role_assignments?group.id=f4e5616e2d87414ca17512f840cc2a59&scope.project.id=4a955500342c498384e96caede5f019f&role.id=7ab1dc76ea3e450689be4c2ab56097f4 => generated 611 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:20.277216 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 213/433] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:15:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 01:15:20.303669 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f69ec0-cf0c-4bfd-82c5-7da5f5e2971e None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:20.418694 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f69ec0-cf0c-4bfd-82c5-7da5f5e2971e None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:20.460460 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75836b4-85ce-4199-b5ce-39faaf93e53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:20.461270 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75836b4-85ce-4199-b5ce-39faaf93e53e None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:20.461552 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75836b4-85ce-4199-b5ce-39faaf93e53e None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:20.461828 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75836b4-85ce-4199-b5ce-39faaf93e53e None admin] PATH_INFO: `/v3/roles/member` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:20.475573 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75836b4-85ce-4199-b5ce-39faaf93e53e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:15:20.482604 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-f75836b4-85ce-4199-b5ce-39faaf93e53e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 30 01:15:20.484169 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 221/434] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Mar 30 01:15:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:20.490953 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90531afa-078d-48ec-8285-d4070dab11e8 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:20.605449 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90531afa-078d-48ec-8285-d4070dab11e8 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:20.641686 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099e6a7-4bfd-4b78-9bb0-2ba1c97d5289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:20.642757 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099e6a7-4bfd-4b78-9bb0-2ba1c97d5289 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:20.643240 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099e6a7-4bfd-4b78-9bb0-2ba1c97d5289 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:20.643711 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099e6a7-4bfd-4b78-9bb0-2ba1c97d5289 None admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:20.644739 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a099e6a7-4bfd-4b78-9bb0-2ba1c97d5289 None admin] RBAC: Adding query filter params (name=member) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:20.645263 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a099e6a7-4bfd-4b78-9bb0-2ba1c97d5289 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:20.646852 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a099e6a7-4bfd-4b78-9bb0-2ba1c97d5289 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:20.656548 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 214/435] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Mar 30 01:15:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:15:20.662771 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75836b4-85ce-4199-b5ce-39faaf93e53e None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:20.774163 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75836b4-85ce-4199-b5ce-39faaf93e53e None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:20.808659 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcd3618-a119-4bf0-87fd-0a04282cc7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:20.809304 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd3618-a119-4bf0-87fd-0a04282cc7fa None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:20.809589 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd3618-a119-4bf0-87fd-0a04282cc7fa None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:20.809867 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd3618-a119-4bf0-87fd-0a04282cc7fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:20.883165 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcd3618-a119-4bf0-87fd-0a04282cc7fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:20.884552 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcd3618-a119-4bf0-87fd-0a04282cc7fa None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:20.967729 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb9ba6-d93f-4b64-bbc6-85d6a199cda3 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:20.968047 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb9ba6-d93f-4b64-bbc6-85d6a199cda3 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:20.968303 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb9ba6-d93f-4b64-bbc6-85d6a199cda3 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:20.970065 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 215/436] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:15:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 01:15:20.975144 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d47f1e-824e-4fa6-bff2-1fcafa12aa7b None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:20.975431 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d47f1e-824e-4fa6-bff2-1fcafa12aa7b None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:20.975713 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d47f1e-824e-4fa6-bff2-1fcafa12aa7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:20.992370 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 222/437] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Mar 30 01:15:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 30 01:15:20.993420 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcd3618-a119-4bf0-87fd-0a04282cc7fa None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:20.994106 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-50d47f1e-824e-4fa6-bff2-1fcafa12aa7b None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:15:20.995371 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-50d47f1e-824e-4fa6-bff2-1fcafa12aa7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:15:21.074235 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 216/438] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:15:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 30 01:15:21.095776 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcd3618-a119-4bf0-87fd-0a04282cc7fa None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:21.097185 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d47f1e-824e-4fa6-bff2-1fcafa12aa7b None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:21.132172 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886ede29-7877-466b-9b6e-bb246e9fc1b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:21.133027 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ede29-7877-466b-9b6e-bb246e9fc1b6 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:21.133365 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ede29-7877-466b-9b6e-bb246e9fc1b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:21.133586 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ede29-7877-466b-9b6e-bb246e9fc1b6 None admin] PATH_INFO: `/v3/projects/9a11dd1e0b1549e8b39995a2cbec195f` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:21.134806 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886ede29-7877-466b-9b6e-bb246e9fc1b6 None admin] RBAC: Authorizing `identity:get_project(project_id=9a11dd1e0b1549e8b39995a2cbec195f)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:21.136243 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886ede29-7877-466b-9b6e-bb246e9fc1b6 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:21.142478 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 223/439] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Mar 30 01:15:20 2022] GET /identity/v3/projects/9a11dd1e0b1549e8b39995a2cbec195f => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:15:21.143374 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886ede29-7877-466b-9b6e-bb246e9fc1b6 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:21.196714 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d47f1e-824e-4fa6-bff2-1fcafa12aa7b None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:21.230285 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0f94de-11c9-4b46-a166-3b451424302d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:21.231120 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0f94de-11c9-4b46-a166-3b451424302d None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:21.231405 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0f94de-11c9-4b46-a166-3b451424302d None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:21.231682 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0f94de-11c9-4b46-a166-3b451424302d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:21.241014 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886ede29-7877-466b-9b6e-bb246e9fc1b6 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:21.242206 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0f94de-11c9-4b46-a166-3b451424302d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:15:21.249508 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-fd0f94de-11c9-4b46-a166-3b451424302d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 30 01:15:21.250684 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 217/440] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Mar 30 01:15:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 01:15:21.251932 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836f6de-509b-464b-b9a2-5cfc2f954660 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:21.252214 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836f6de-509b-464b-b9a2-5cfc2f954660 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:21.252488 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836f6de-509b-464b-b9a2-5cfc2f954660 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:21.254745 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 218/441] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:15:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:15:21.256274 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4836f6de-509b-464b-b9a2-5cfc2f954660 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:21.277148 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce45fc57-c58c-4027-9cc1-8973d210aadb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:21.277999 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce45fc57-c58c-4027-9cc1-8973d210aadb None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:21.278277 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce45fc57-c58c-4027-9cc1-8973d210aadb None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:21.278584 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce45fc57-c58c-4027-9cc1-8973d210aadb None admin] PATH_INFO: `/v3/groups/f4e5616e2d87414ca17512f840cc2a59` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:21.279765 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce45fc57-c58c-4027-9cc1-8973d210aadb None admin] RBAC: Authorizing `identity:get_group(group_id=f4e5616e2d87414ca17512f840cc2a59)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:21.281443 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce45fc57-c58c-4027-9cc1-8973d210aadb None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:21.283213 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 224/442] 10.222.0.30 () {56 vars in 1180 bytes} [Wed Mar 30 01:15:21 2022] GET /identity/v3/groups/f4e5616e2d87414ca17512f840cc2a59 => generated 226 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:15:21.284175 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fcc3af-eac1-492c-862e-58dad71f50de None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:21.284457 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fcc3af-eac1-492c-862e-58dad71f50de None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:21.284730 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fcc3af-eac1-492c-862e-58dad71f50de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:21.301544 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-86fcc3af-eac1-492c-862e-58dad71f50de None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:15:21.302729 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-86fcc3af-eac1-492c-862e-58dad71f50de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:15:21.356056 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4836f6de-509b-464b-b9a2-5cfc2f954660 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:21.367332 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 225/443] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:15:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 01:15:21.368193 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fcc3af-eac1-492c-862e-58dad71f50de None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:21.391331 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6540d04a-a2b0-44c5-9b08-2fa88e62d706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:21.391927 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6540d04a-a2b0-44c5-9b08-2fa88e62d706 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:21.392207 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6540d04a-a2b0-44c5-9b08-2fa88e62d706 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:21.392484 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6540d04a-a2b0-44c5-9b08-2fa88e62d706 None admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:21.393220 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6540d04a-a2b0-44c5-9b08-2fa88e62d706 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:21.393523 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6540d04a-a2b0-44c5-9b08-2fa88e62d706 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:21.395472 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6540d04a-a2b0-44c5-9b08-2fa88e62d706 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:21.403240 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 219/444] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Mar 30 01:15:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:15:21.404797 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6540d04a-a2b0-44c5-9b08-2fa88e62d706 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:21.463738 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fcc3af-eac1-492c-862e-58dad71f50de None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:21.496374 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8b6338-7132-4b6b-9c58-e8350f68c842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:21.497018 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b6338-7132-4b6b-9c58-e8350f68c842 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:21.497297 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b6338-7132-4b6b-9c58-e8350f68c842 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:21.497567 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b6338-7132-4b6b-9c58-e8350f68c842 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:21.498386 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8b6338-7132-4b6b-9c58-e8350f68c842 None admin] RBAC: Adding query filter params (group.id=f4e5616e2d87414ca17512f840cc2a59, role.id=7185d0cfbcd44502b1613bcfe1b42f6f, scope.project.id=9a11dd1e0b1549e8b39995a2cbec195f) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:21.498628 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6540d04a-a2b0-44c5-9b08-2fa88e62d706 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:21.498756 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8b6338-7132-4b6b-9c58-e8350f68c842 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:21.500133 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8b6338-7132-4b6b-9c58-e8350f68c842 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:21.506629 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 226/445] 10.222.0.30 () {56 vars in 1376 bytes} [Wed Mar 30 01:15:21 2022] GET /identity/v3/role_assignments?group.id=f4e5616e2d87414ca17512f840cc2a59&scope.project.id=9a11dd1e0b1549e8b39995a2cbec195f&role.id=7185d0cfbcd44502b1613bcfe1b42f6f => generated 611 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:21.507427 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8b6338-7132-4b6b-9c58-e8350f68c842 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:21.533446 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1ad6b5-2bb8-43f0-b976-897ac1a18aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:21.534266 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ad6b5-2bb8-43f0-b976-897ac1a18aee None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:21.534542 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ad6b5-2bb8-43f0-b976-897ac1a18aee None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:21.534849 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ad6b5-2bb8-43f0-b976-897ac1a18aee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:21.546576 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1ad6b5-2bb8-43f0-b976-897ac1a18aee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:15:21.554228 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-5d1ad6b5-2bb8-43f0-b976-897ac1a18aee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 30 01:15:21.555507 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 220/446] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Mar 30 01:15:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:21.561552 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1ad6b5-2bb8-43f0-b976-897ac1a18aee None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:21.622304 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8b6338-7132-4b6b-9c58-e8350f68c842 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:21.660744 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8be965-a8a4-4b66-b5e8-a1d996a6afd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:21.661522 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8be965-a8a4-4b66-b5e8-a1d996a6afd4 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:21.661807 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8be965-a8a4-4b66-b5e8-a1d996a6afd4 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:21.662086 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8be965-a8a4-4b66-b5e8-a1d996a6afd4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:21.679542 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1ad6b5-2bb8-43f0-b976-897ac1a18aee None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:21.718362 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff174185-0d44-45f8-84de-93c5938a97be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:21.719156 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff174185-0d44-45f8-84de-93c5938a97be None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:21.719443 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff174185-0d44-45f8-84de-93c5938a97be None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:21.719715 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff174185-0d44-45f8-84de-93c5938a97be None admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:21.720465 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff174185-0d44-45f8-84de-93c5938a97be None admin] RBAC: Adding query filter params (name=admin) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:21.720772 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff174185-0d44-45f8-84de-93c5938a97be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:21.722180 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff174185-0d44-45f8-84de-93c5938a97be None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:21.732093 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 221/447] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Mar 30 01:15:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:15:21.734958 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8be965-a8a4-4b66-b5e8-a1d996a6afd4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:21.736448 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8be965-a8a4-4b66-b5e8-a1d996a6afd4 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:21.738671 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff174185-0d44-45f8-84de-93c5938a97be None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:21.847378 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff174185-0d44-45f8-84de-93c5938a97be None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:21.853356 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 227/448] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Mar 30 01:15:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 30 01:15:21.858674 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8be965-a8a4-4b66-b5e8-a1d996a6afd4 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:21.886781 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8476bf-8d7a-4f31-ba5d-b73cabe3e7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:21.887436 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8476bf-8d7a-4f31-ba5d-b73cabe3e7dc None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:21.887719 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8476bf-8d7a-4f31-ba5d-b73cabe3e7dc None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:21.887996 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8476bf-8d7a-4f31-ba5d-b73cabe3e7dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:21.953758 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8476bf-8d7a-4f31-ba5d-b73cabe3e7dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:21.955175 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8476bf-8d7a-4f31-ba5d-b73cabe3e7dc None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:21.955890 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8be965-a8a4-4b66-b5e8-a1d996a6afd4 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:21.987502 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bed1f4-07f4-4ae6-9c4e-330ab5ff0b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:21.988490 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bed1f4-07f4-4ae6-9c4e-330ab5ff0b27 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:21.988770 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bed1f4-07f4-4ae6-9c4e-330ab5ff0b27 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:21.989035 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bed1f4-07f4-4ae6-9c4e-330ab5ff0b27 None admin] PATH_INFO: `/v3/projects/9a11dd1e0b1549e8b39995a2cbec195f` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:21.990205 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bed1f4-07f4-4ae6-9c4e-330ab5ff0b27 None admin] RBAC: Authorizing `identity:get_project(project_id=9a11dd1e0b1549e8b39995a2cbec195f)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:21.991678 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bed1f4-07f4-4ae6-9c4e-330ab5ff0b27 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:21.993329 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 228/449] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Mar 30 01:15:21 2022] GET /identity/v3/projects/9a11dd1e0b1549e8b39995a2cbec195f => generated 302 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:15:21.998638 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bed1f4-07f4-4ae6-9c4e-330ab5ff0b27 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:22.049437 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 222/450] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Mar 30 01:15:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 30 01:15:22.055095 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8476bf-8d7a-4f31-ba5d-b73cabe3e7dc None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:22.091613 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bed1f4-07f4-4ae6-9c4e-330ab5ff0b27 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:22.123044 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbd6114-8f6e-4c6b-b151-c22014e9e162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:22.123884 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd6114-8f6e-4c6b-b151-c22014e9e162 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:22.124176 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd6114-8f6e-4c6b-b151-c22014e9e162 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:22.124452 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd6114-8f6e-4c6b-b151-c22014e9e162 None admin] PATH_INFO: `/v3/groups/f4e5616e2d87414ca17512f840cc2a59` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:22.125630 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbd6114-8f6e-4c6b-b151-c22014e9e162 None admin] RBAC: Authorizing `identity:get_group(group_id=f4e5616e2d87414ca17512f840cc2a59)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:22.127090 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbd6114-8f6e-4c6b-b151-c22014e9e162 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:22.129340 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 229/451] 10.222.0.30 () {56 vars in 1180 bytes} [Wed Mar 30 01:15:21 2022] GET /identity/v3/groups/f4e5616e2d87414ca17512f840cc2a59 => generated 226 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:15:22.134859 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbd6114-8f6e-4c6b-b151-c22014e9e162 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:22.146907 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8476bf-8d7a-4f31-ba5d-b73cabe3e7dc None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:22.178898 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b9b2a4-7c74-4c52-ac0c-e02d16f26734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:22.179751 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9b2a4-7c74-4c52-ac0c-e02d16f26734 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:22.180025 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9b2a4-7c74-4c52-ac0c-e02d16f26734 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:22.180295 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9b2a4-7c74-4c52-ac0c-e02d16f26734 None admin] PATH_INFO: `/v3/projects/8e7672bb827a4f4ea1fedd14bfb4311b` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:22.181535 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b9b2a4-7c74-4c52-ac0c-e02d16f26734 None admin] RBAC: Authorizing `identity:get_project(project_id=8e7672bb827a4f4ea1fedd14bfb4311b)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:22.182983 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b9b2a4-7c74-4c52-ac0c-e02d16f26734 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:22.184649 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 223/452] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Mar 30 01:15:22 2022] GET /identity/v3/projects/8e7672bb827a4f4ea1fedd14bfb4311b => generated 344 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:15:22.189910 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b9b2a4-7c74-4c52-ac0c-e02d16f26734 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:22.228291 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbd6114-8f6e-4c6b-b151-c22014e9e162 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:22.260350 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b7e79f-81a0-4e49-8206-23c15285a3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:22.260991 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b7e79f-81a0-4e49-8206-23c15285a3f2 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:22.261279 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b7e79f-81a0-4e49-8206-23c15285a3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:22.261556 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b7e79f-81a0-4e49-8206-23c15285a3f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:22.262380 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b7e79f-81a0-4e49-8206-23c15285a3f2 None admin] RBAC: Adding query filter params (group.id=f4e5616e2d87414ca17512f840cc2a59, role.id=7ab1dc76ea3e450689be4c2ab56097f4, scope.project.id=9a11dd1e0b1549e8b39995a2cbec195f) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:22.262692 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b7e79f-81a0-4e49-8206-23c15285a3f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:22.264140 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b7e79f-81a0-4e49-8206-23c15285a3f2 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:22.270326 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 230/453] 10.222.0.30 () {56 vars in 1376 bytes} [Wed Mar 30 01:15:22 2022] GET /identity/v3/role_assignments?group.id=f4e5616e2d87414ca17512f840cc2a59&scope.project.id=9a11dd1e0b1549e8b39995a2cbec195f&role.id=7ab1dc76ea3e450689be4c2ab56097f4 => generated 611 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:15:22.282245 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b9b2a4-7c74-4c52-ac0c-e02d16f26734 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:22.319528 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0dd813-f69f-49c6-8d64-19b792ebdae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:22.320392 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0dd813-f69f-49c6-8d64-19b792ebdae8 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:22.320674 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0dd813-f69f-49c6-8d64-19b792ebdae8 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:22.320950 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0dd813-f69f-49c6-8d64-19b792ebdae8 None admin] PATH_INFO: `/v3/groups/1c13717fabab49609f633047e3f1a4eb` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:22.322185 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0dd813-f69f-49c6-8d64-19b792ebdae8 None admin] RBAC: Authorizing `identity:get_group(group_id=1c13717fabab49609f633047e3f1a4eb)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:22.323755 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0dd813-f69f-49c6-8d64-19b792ebdae8 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:22.325455 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 224/454] 10.222.0.30 () {56 vars in 1180 bytes} [Wed Mar 30 01:15:22 2022] GET /identity/v3/groups/1c13717fabab49609f633047e3f1a4eb => generated 229 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:15:22.331564 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b7e79f-81a0-4e49-8206-23c15285a3f2 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:22.432906 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b7e79f-81a0-4e49-8206-23c15285a3f2 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:22.467378 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3245089f-34ac-4fde-8eaa-f8211e33934f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:22.468033 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3245089f-34ac-4fde-8eaa-f8211e33934f None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:22.468326 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3245089f-34ac-4fde-8eaa-f8211e33934f None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:22.468604 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3245089f-34ac-4fde-8eaa-f8211e33934f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:22.469438 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3245089f-34ac-4fde-8eaa-f8211e33934f None admin] RBAC: Adding query filter params (group.id=1c13717fabab49609f633047e3f1a4eb, role.id=36909bbf31d04993bb2a9fe587b572dc, scope.project.id=8e7672bb827a4f4ea1fedd14bfb4311b) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:22.469751 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3245089f-34ac-4fde-8eaa-f8211e33934f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:22.471242 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3245089f-34ac-4fde-8eaa-f8211e33934f None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:22.477723 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 231/455] 10.222.0.30 () {56 vars in 1376 bytes} [Wed Mar 30 01:15:22 2022] GET /identity/v3/role_assignments?group.id=1c13717fabab49609f633047e3f1a4eb&scope.project.id=8e7672bb827a4f4ea1fedd14bfb4311b&role.id=36909bbf31d04993bb2a9fe587b572dc => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:25.367148 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a0f79-08b6-41ec-8262-75bd3a8d437d None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:25.367655 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a0f79-08b6-41ec-8262-75bd3a8d437d None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:25.367729 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a0f79-08b6-41ec-8262-75bd3a8d437d None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:25.369708 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 225/456] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:15:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:15:25.376763 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045c8e3-85be-4df0-b8db-76b05384546d None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:25.376763 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045c8e3-85be-4df0-b8db-76b05384546d None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:25.376763 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045c8e3-85be-4df0-b8db-76b05384546d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:25.400431 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-1045c8e3-85be-4df0-b8db-76b05384546d None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:15:25.401986 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-1045c8e3-85be-4df0-b8db-76b05384546d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:15:25.499780 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 232/457] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:15:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 01:15:25.525940 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a0f79-08b6-41ec-8262-75bd3a8d437d None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:25.667308 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a0f79-08b6-41ec-8262-75bd3a8d437d None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:25.721212 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e04a7e-40a9-489a-9551-d22ee2cdb6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:25.722864 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e04a7e-40a9-489a-9551-d22ee2cdb6ad None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:25.723609 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e04a7e-40a9-489a-9551-d22ee2cdb6ad None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:25.724072 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e04a7e-40a9-489a-9551-d22ee2cdb6ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:25.736786 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e04a7e-40a9-489a-9551-d22ee2cdb6ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:25.738295 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e04a7e-40a9-489a-9551-d22ee2cdb6ad None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:25.761528 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-a1e04a7e-40a9-489a-9551-d22ee2cdb6ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:15:25.763057 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 226/458] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:15:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:25.769879 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1045c8e3-85be-4df0-b8db-76b05384546d None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:25.898376 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b01b3d5-1720-4515-a2fe-c2c8faed66b0 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:25.898565 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b01b3d5-1720-4515-a2fe-c2c8faed66b0 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:25.898868 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b01b3d5-1720-4515-a2fe-c2c8faed66b0 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:25.900786 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 227/459] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:15:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:15:25.906659 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b7347d-5712-4004-8e3f-eb266e31718f None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:25.906963 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b7347d-5712-4004-8e3f-eb266e31718f None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:25.907228 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b7347d-5712-4004-8e3f-eb266e31718f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:25.923342 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1045c8e3-85be-4df0-b8db-76b05384546d None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:25.930953 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-89b7347d-5712-4004-8e3f-eb266e31718f None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:15:25.932380 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-89b7347d-5712-4004-8e3f-eb266e31718f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:15:25.964653 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98173159-22b8-49c4-bb17-7f229e585489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:25.965407 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98173159-22b8-49c4-bb17-7f229e585489 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:25.965691 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98173159-22b8-49c4-bb17-7f229e585489 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:25.965964 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98173159-22b8-49c4-bb17-7f229e585489 None admin] PATH_INFO: `/v3/domains` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:25.966808 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98173159-22b8-49c4-bb17-7f229e585489 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:25.967113 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98173159-22b8-49c4-bb17-7f229e585489 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:25.968534 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98173159-22b8-49c4-bb17-7f229e585489 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:25.988839 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 233/460] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:15:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:25.990637 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d432a-a332-46c9-b772-ca1283d8b956 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:25.991154 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d432a-a332-46c9-b772-ca1283d8b956 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:25.991674 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d432a-a332-46c9-b772-ca1283d8b956 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:25.994129 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 234/461] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:15:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:15:25.995101 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108d432a-a332-46c9-b772-ca1283d8b956 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:26.006149 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 228/462] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:15:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 30 01:15:26.007494 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4275198-306d-4152-b1da-4ddddb6d302d None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:26.007781 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4275198-306d-4152-b1da-4ddddb6d302d None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:26.008099 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4275198-306d-4152-b1da-4ddddb6d302d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:26.029690 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-a4275198-306d-4152-b1da-4ddddb6d302d None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:15:26.031255 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-a4275198-306d-4152-b1da-4ddddb6d302d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:15:26.099188 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108d432a-a332-46c9-b772-ca1283d8b956 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:26.104916 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 229/463] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:15:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 01:15:26.104916 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb00e28-1cd4-46a9-a2b2-642257a80118 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:26.104916 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb00e28-1cd4-46a9-a2b2-642257a80118 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:26.104916 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb00e28-1cd4-46a9-a2b2-642257a80118 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:26.104916 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 230/464] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:15:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:15:26.104916 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb00e28-1cd4-46a9-a2b2-642257a80118 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:26.147071 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d69246a-9dda-4b28-8c4f-e15c085fb637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:26.147743 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d69246a-9dda-4b28-8c4f-e15c085fb637 None admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:26.148018 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d69246a-9dda-4b28-8c4f-e15c085fb637 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:26.148289 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d69246a-9dda-4b28-8c4f-e15c085fb637 None admin] PATH_INFO: `/v3/users` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:26.149036 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d69246a-9dda-4b28-8c4f-e15c085fb637 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:26.150435 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d69246a-9dda-4b28-8c4f-e15c085fb637 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:26.171118 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 235/465] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Mar 30 01:15:25 2022] POST /identity/v3/users => generated 246 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:15:26.172411 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd17ad-0399-4ac9-9791-418ad65ca489 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:26.172748 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd17ad-0399-4ac9-9791-418ad65ca489 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:26.173026 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd17ad-0399-4ac9-9791-418ad65ca489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:26.191938 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-3bdd17ad-0399-4ac9-9791-418ad65ca489 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:15:26.193159 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-3bdd17ad-0399-4ac9-9791-418ad65ca489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:15:26.236764 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb00e28-1cd4-46a9-a2b2-642257a80118 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:26.271130 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 236/466] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:15:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 01:15:26.272187 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdd17ad-0399-4ac9-9791-418ad65ca489 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:26.280325 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f08a01-09dc-4259-9c75-e186bba643d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:26.282673 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f08a01-09dc-4259-9c75-e186bba643d2 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:26.283373 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f08a01-09dc-4259-9c75-e186bba643d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:26.283853 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f08a01-09dc-4259-9c75-e186bba643d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:26.301913 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f08a01-09dc-4259-9c75-e186bba643d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:26.304054 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f08a01-09dc-4259-9c75-e186bba643d2 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:26.328407 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-e1f08a01-09dc-4259-9c75-e186bba643d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:15:26.330332 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 231/467] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:15:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:26.336334 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f08a01-09dc-4259-9c75-e186bba643d2 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:26.407652 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdd17ad-0399-4ac9-9791-418ad65ca489 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:26.452546 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c9ae3-dc56-4509-a5c4-9b87fd523bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:26.453710 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c9ae3-dc56-4509-a5c4-9b87fd523bb3 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:26.454182 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c9ae3-dc56-4509-a5c4-9b87fd523bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:26.454641 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c9ae3-dc56-4509-a5c4-9b87fd523bb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:26.462949 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f08a01-09dc-4259-9c75-e186bba643d2 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:26.467177 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159c9ae3-dc56-4509-a5c4-9b87fd523bb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:26.468885 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159c9ae3-dc56-4509-a5c4-9b87fd523bb3 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:26.486999 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-159c9ae3-dc56-4509-a5c4-9b87fd523bb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:15:26.489505 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 237/468] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:15:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:26.490611 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c9ae3-dc56-4509-a5c4-9b87fd523bb3 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:26.501247 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe21aa16-17cf-4cd0-84d9-89b05b3e352e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:26.502021 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe21aa16-17cf-4cd0-84d9-89b05b3e352e None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:26.502304 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe21aa16-17cf-4cd0-84d9-89b05b3e352e None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:26.503017 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe21aa16-17cf-4cd0-84d9-89b05b3e352e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:26.515606 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe21aa16-17cf-4cd0-84d9-89b05b3e352e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:26.517076 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe21aa16-17cf-4cd0-84d9-89b05b3e352e None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:26.539122 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-fe21aa16-17cf-4cd0-84d9-89b05b3e352e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:15:26.540870 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 232/469] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:15:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:26.541481 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe21aa16-17cf-4cd0-84d9-89b05b3e352e None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:26.606404 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c9ae3-dc56-4509-a5c4-9b87fd523bb3 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:26.641004 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d65272-5832-4a8f-bd85-6b013da2dc8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:26.641632 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d65272-5832-4a8f-bd85-6b013da2dc8c None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:26.641909 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d65272-5832-4a8f-bd85-6b013da2dc8c None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:26.642181 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d65272-5832-4a8f-bd85-6b013da2dc8c None admin] PATH_INFO: `/v3/domains` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:26.642925 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d65272-5832-4a8f-bd85-6b013da2dc8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:26.643228 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d65272-5832-4a8f-bd85-6b013da2dc8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:26.644792 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d65272-5832-4a8f-bd85-6b013da2dc8c None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:26.647640 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe21aa16-17cf-4cd0-84d9-89b05b3e352e None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:26.661872 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 238/470] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:15:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:26.661872 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d65272-5832-4a8f-bd85-6b013da2dc8c None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:26.692433 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7389a29f-321c-49d7-ab5e-f5e0c53f6ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:26.693331 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7389a29f-321c-49d7-ab5e-f5e0c53f6ee9 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:26.693613 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7389a29f-321c-49d7-ab5e-f5e0c53f6ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:26.693885 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7389a29f-321c-49d7-ab5e-f5e0c53f6ee9 None admin] PATH_INFO: `/v3/domains` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:26.694598 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7389a29f-321c-49d7-ab5e-f5e0c53f6ee9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:26.694931 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7389a29f-321c-49d7-ab5e-f5e0c53f6ee9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:26.696283 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7389a29f-321c-49d7-ab5e-f5e0c53f6ee9 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:26.708359 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 233/471] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:15:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:26.709393 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7389a29f-321c-49d7-ab5e-f5e0c53f6ee9 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:26.772835 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d65272-5832-4a8f-bd85-6b013da2dc8c None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:26.806394 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0869f9-c2de-400c-a316-2fe71bff061d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:26.806815 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7389a29f-321c-49d7-ab5e-f5e0c53f6ee9 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:26.807152 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0869f9-c2de-400c-a316-2fe71bff061d None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:26.807437 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0869f9-c2de-400c-a316-2fe71bff061d None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:26.807771 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0869f9-c2de-400c-a316-2fe71bff061d None admin] PATH_INFO: `/v3/domains` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:26.808494 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0869f9-c2de-400c-a316-2fe71bff061d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:26.808803 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0869f9-c2de-400c-a316-2fe71bff061d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:26.810172 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0869f9-c2de-400c-a316-2fe71bff061d None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:26.821722 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 239/472] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:15:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:26.824110 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247901c4-7413-47f6-8bff-fb555e5fbaeb None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:26.824968 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247901c4-7413-47f6-8bff-fb555e5fbaeb None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:26.825450 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247901c4-7413-47f6-8bff-fb555e5fbaeb None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:26.827364 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 240/473] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:15:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:15:26.828241 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247901c4-7413-47f6-8bff-fb555e5fbaeb None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:26.844875 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678a69f9-8624-436a-9654-1f83bb8983cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:26.845531 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a69f9-8624-436a-9654-1f83bb8983cd None admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:26.845808 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a69f9-8624-436a-9654-1f83bb8983cd None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:26.846078 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a69f9-8624-436a-9654-1f83bb8983cd None admin] PATH_INFO: `/v3/users` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:26.846798 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678a69f9-8624-436a-9654-1f83bb8983cd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:26.848446 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678a69f9-8624-436a-9654-1f83bb8983cd None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:26.868443 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 234/474] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Mar 30 01:15:26 2022] POST /identity/v3/users => generated 249 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:15:26.869275 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678a69f9-8624-436a-9654-1f83bb8983cd None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:26.962551 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247901c4-7413-47f6-8bff-fb555e5fbaeb None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:26.980038 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678a69f9-8624-436a-9654-1f83bb8983cd None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:27.009443 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6808f51-ee24-452c-87cd-22c510e372d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:27.010460 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6808f51-ee24-452c-87cd-22c510e372d7 None admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:27.010786 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6808f51-ee24-452c-87cd-22c510e372d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:27.011065 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6808f51-ee24-452c-87cd-22c510e372d7 None admin] PATH_INFO: `/v3/users` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:27.011901 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6808f51-ee24-452c-87cd-22c510e372d7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:27.014415 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6808f51-ee24-452c-87cd-22c510e372d7 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:27.018167 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0157e674-9c37-472e-9ac3-a8bbafbbf997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:27.019759 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157e674-9c37-472e-9ac3-a8bbafbbf997 None admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:27.020495 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157e674-9c37-472e-9ac3-a8bbafbbf997 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:27.020990 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157e674-9c37-472e-9ac3-a8bbafbbf997 None admin] PATH_INFO: `/v3/users` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:27.021935 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0157e674-9c37-472e-9ac3-a8bbafbbf997 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:27.023769 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0157e674-9c37-472e-9ac3-a8bbafbbf997 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:27.042858 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 241/475] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Mar 30 01:15:26 2022] POST /identity/v3/users => generated 248 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:15:27.044487 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f55122-c8d2-4919-a764-08d388f28c5c None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:27.044863 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f55122-c8d2-4919-a764-08d388f28c5c None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:27.045276 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f55122-c8d2-4919-a764-08d388f28c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:27.055006 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 235/476] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Mar 30 01:15:26 2022] POST /identity/v3/users => generated 248 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:15:27.072012 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-a7f55122-c8d2-4919-a764-08d388f28c5c None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:15:27.073318 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-a7f55122-c8d2-4919-a764-08d388f28c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:15:27.156360 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 242/477] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:15:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 01:15:27.181499 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0157e674-9c37-472e-9ac3-a8bbafbbf997 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:27.302133 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0157e674-9c37-472e-9ac3-a8bbafbbf997 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:27.339700 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc303a-5e0f-4fea-b334-22c4383e6463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:27.340364 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc303a-5e0f-4fea-b334-22c4383e6463 None admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:27.340644 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc303a-5e0f-4fea-b334-22c4383e6463 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:27.340915 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc303a-5e0f-4fea-b334-22c4383e6463 None admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:27.341714 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fc303a-5e0f-4fea-b334-22c4383e6463 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:27.343108 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fc303a-5e0f-4fea-b334-22c4383e6463 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:27.351919 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.sql.core [None req-02fc303a-5e0f-4fea-b334-22c4383e6463 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Mar 30 01:15:27.351919 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Mar 30 01:15:27.351919 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [parameters: {'id': 'e8bbf315f0954a24badce0a9dbd8fda6', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Mar 30 01:15:27.351919 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79701) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Mar 30 01:15:27.367155 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-02fc303a-5e0f-4fea-b334-22c4383e6463 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Mar 30 01:15:27.368863 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 236/478] 10.222.0.30 () {60 vars in 1131 bytes} [Wed Mar 30 01:15:27 2022] POST /identity/v3/roles => generated 144 bytes in 188 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:27.374579 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f55122-c8d2-4919-a764-08d388f28c5c None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:27.473796 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f55122-c8d2-4919-a764-08d388f28c5c None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:27.514606 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5461531-62e7-4158-bd0f-caca4d15e2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:27.515445 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5461531-62e7-4158-bd0f-caca4d15e2e3 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:27.515722 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5461531-62e7-4158-bd0f-caca4d15e2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:27.515990 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5461531-62e7-4158-bd0f-caca4d15e2e3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:27.531560 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5461531-62e7-4158-bd0f-caca4d15e2e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:15:27.538941 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-d5461531-62e7-4158-bd0f-caca4d15e2e3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 30 01:15:27.540331 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 243/479] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Mar 30 01:15:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:27.545720 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc303a-5e0f-4fea-b334-22c4383e6463 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:27.649741 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc303a-5e0f-4fea-b334-22c4383e6463 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:27.684304 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b7924f-81e2-4fa0-bbc3-420535568758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:27.684972 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b7924f-81e2-4fa0-bbc3-420535568758 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:27.685248 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b7924f-81e2-4fa0-bbc3-420535568758 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:27.685520 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b7924f-81e2-4fa0-bbc3-420535568758 None admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:27.686272 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b7924f-81e2-4fa0-bbc3-420535568758 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:27.686574 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b7924f-81e2-4fa0-bbc3-420535568758 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:27.687978 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b7924f-81e2-4fa0-bbc3-420535568758 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:27.696744 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 237/480] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Mar 30 01:15:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:28.813331 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36757b1d-ea28-4c53-8ef0-78edb087e911 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:28.813331 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36757b1d-ea28-4c53-8ef0-78edb087e911 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:28.813331 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36757b1d-ea28-4c53-8ef0-78edb087e911 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:28.814265 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 244/481] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:15:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:15:28.819754 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47445efa-2aa0-407b-ba73-e4761427159b None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:28.820486 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47445efa-2aa0-407b-ba73-e4761427159b None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:28.820926 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47445efa-2aa0-407b-ba73-e4761427159b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:28.838161 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-47445efa-2aa0-407b-ba73-e4761427159b None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:15:28.839596 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-47445efa-2aa0-407b-ba73-e4761427159b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:15:28.914874 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 238/482] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:15:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 01:15:28.931723 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36757b1d-ea28-4c53-8ef0-78edb087e911 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:29.036010 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36757b1d-ea28-4c53-8ef0-78edb087e911 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:29.070378 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbb58cf-2f29-404d-af3a-d5859b85f06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:29.071447 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb58cf-2f29-404d-af3a-d5859b85f06d None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:29.071963 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb58cf-2f29-404d-af3a-d5859b85f06d None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:29.075923 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb58cf-2f29-404d-af3a-d5859b85f06d None admin] PATH_INFO: `/v3/roles/service` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:29.088336 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbb58cf-2f29-404d-af3a-d5859b85f06d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:15:29.095511 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-fcbb58cf-2f29-404d-af3a-d5859b85f06d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 30 01:15:29.102197 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 245/483] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Mar 30 01:15:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:29.103722 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47445efa-2aa0-407b-ba73-e4761427159b None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:29.203822 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47445efa-2aa0-407b-ba73-e4761427159b None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:29.252782 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa7631c-0f77-408d-82bf-35660da91fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:29.253487 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa7631c-0f77-408d-82bf-35660da91fc9 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:29.253881 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa7631c-0f77-408d-82bf-35660da91fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:29.254162 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa7631c-0f77-408d-82bf-35660da91fc9 None admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:29.254940 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa7631c-0f77-408d-82bf-35660da91fc9 None admin] RBAC: Adding query filter params (name=service) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:29.255256 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa7631c-0f77-408d-82bf-35660da91fc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:29.256637 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa7631c-0f77-408d-82bf-35660da91fc9 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:29.270462 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 239/484] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Mar 30 01:15:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:29.276290 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbb58cf-2f29-404d-af3a-d5859b85f06d None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:29.398224 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbb58cf-2f29-404d-af3a-d5859b85f06d None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:29.438226 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09539f80-8ab6-49b9-a20d-b49ab815bfc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:29.439484 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09539f80-8ab6-49b9-a20d-b49ab815bfc0 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:29.439965 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09539f80-8ab6-49b9-a20d-b49ab815bfc0 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:29.440434 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09539f80-8ab6-49b9-a20d-b49ab815bfc0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:29.454140 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09539f80-8ab6-49b9-a20d-b49ab815bfc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:29.456160 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09539f80-8ab6-49b9-a20d-b49ab815bfc0 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:29.486079 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-09539f80-8ab6-49b9-a20d-b49ab815bfc0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:15:29.488169 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 246/485] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:15:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:29.495522 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa7631c-0f77-408d-82bf-35660da91fc9 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:29.668583 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa7631c-0f77-408d-82bf-35660da91fc9 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:29.712981 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07329754-79ce-48dc-bfc4-1e4a373ba87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:29.713555 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07329754-79ce-48dc-bfc4-1e4a373ba87c None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:29.713839 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07329754-79ce-48dc-bfc4-1e4a373ba87c None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:29.714116 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07329754-79ce-48dc-bfc4-1e4a373ba87c None admin] PATH_INFO: `/v3/domains` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:29.714872 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07329754-79ce-48dc-bfc4-1e4a373ba87c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:29.715182 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07329754-79ce-48dc-bfc4-1e4a373ba87c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:29.716548 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07329754-79ce-48dc-bfc4-1e4a373ba87c None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:29.733554 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 240/486] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:15:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:29.739876 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09539f80-8ab6-49b9-a20d-b49ab815bfc0 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:29.864346 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20aa2b5-8535-4134-b39f-dc08c1c23390 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:29.864859 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20aa2b5-8535-4134-b39f-dc08c1c23390 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:29.864933 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20aa2b5-8535-4134-b39f-dc08c1c23390 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:29.866958 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 241/487] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:15:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 01:15:29.875490 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c2e49-c613-42af-88b8-016d17b82a00 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:29.875778 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c2e49-c613-42af-88b8-016d17b82a00 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:29.876060 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c2e49-c613-42af-88b8-016d17b82a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:29.893213 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09539f80-8ab6-49b9-a20d-b49ab815bfc0 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:29.899771 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-546c2e49-c613-42af-88b8-016d17b82a00 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:15:29.901190 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-546c2e49-c613-42af-88b8-016d17b82a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:15:29.931609 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c963dc-af43-4aad-be00-8f2779c6467f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:29.932700 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c963dc-af43-4aad-be00-8f2779c6467f None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:29.932979 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c963dc-af43-4aad-be00-8f2779c6467f None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:29.933249 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c963dc-af43-4aad-be00-8f2779c6467f None admin] PATH_INFO: `/v3/users/nova` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:29.943462 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c963dc-af43-4aad-be00-8f2779c6467f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:29.945287 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c963dc-af43-4aad-be00-8f2779c6467f None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:29.959453 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-55c963dc-af43-4aad-be00-8f2779c6467f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 30 01:15:29.965925 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 247/488] 10.222.0.30 () {56 vars in 1093 bytes} [Wed Mar 30 01:15:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:29.967818 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f7963-93e9-4cf0-987e-e4e788ed6c96 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:29.968323 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f7963-93e9-4cf0-987e-e4e788ed6c96 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:29.968795 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f7963-93e9-4cf0-987e-e4e788ed6c96 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:29.971496 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 248/489] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:15:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:15:29.972672 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f7963-93e9-4cf0-987e-e4e788ed6c96 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:29.974219 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 242/490] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:15:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 30 01:15:29.980750 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b8bf18-3f4d-4251-8f70-91828b294102 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:29.981094 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b8bf18-3f4d-4251-8f70-91828b294102 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:29.981281 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b8bf18-3f4d-4251-8f70-91828b294102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:30.019046 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-c9b8bf18-3f4d-4251-8f70-91828b294102 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:15:30.020629 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-c9b8bf18-3f4d-4251-8f70-91828b294102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:15:30.078859 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f7963-93e9-4cf0-987e-e4e788ed6c96 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:30.090283 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 243/491] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:15:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 01:15:30.091258 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b8bf18-3f4d-4251-8f70-91828b294102 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:30.115020 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae9c1ab-c9b9-4a9e-ba83-da32b3675701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:30.116041 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9c1ab-c9b9-4a9e-ba83-da32b3675701 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:30.116523 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9c1ab-c9b9-4a9e-ba83-da32b3675701 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:30.116990 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9c1ab-c9b9-4a9e-ba83-da32b3675701 None admin] PATH_INFO: `/v3/users` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:30.118073 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae9c1ab-c9b9-4a9e-ba83-da32b3675701 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:30.118578 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae9c1ab-c9b9-4a9e-ba83-da32b3675701 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:30.120323 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae9c1ab-c9b9-4a9e-ba83-da32b3675701 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:30.162671 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 249/492] 10.222.0.30 () {56 vars in 1133 bytes} [Wed Mar 30 01:15:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:30.163899 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae9c1ab-c9b9-4a9e-ba83-da32b3675701 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:30.193980 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b8bf18-3f4d-4251-8f70-91828b294102 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:30.229033 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc0568-c508-49eb-a0b9-78adbda0fd8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:30.229880 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc0568-c508-49eb-a0b9-78adbda0fd8e None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:30.230059 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc0568-c508-49eb-a0b9-78adbda0fd8e None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:30.230327 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc0568-c508-49eb-a0b9-78adbda0fd8e None admin] PATH_INFO: `/v3/roles/service` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:30.240694 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcc0568-c508-49eb-a0b9-78adbda0fd8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:15:30.247902 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-cbcc0568-c508-49eb-a0b9-78adbda0fd8e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 30 01:15:30.249453 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 244/493] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Mar 30 01:15:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:30.250230 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc0568-c508-49eb-a0b9-78adbda0fd8e None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:30.266247 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae9c1ab-c9b9-4a9e-ba83-da32b3675701 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:30.301244 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c860575-8561-4780-8345-122c96de4d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:30.302398 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c860575-8561-4780-8345-122c96de4d3b None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:30.302909 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c860575-8561-4780-8345-122c96de4d3b None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:30.303379 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c860575-8561-4780-8345-122c96de4d3b None admin] PATH_INFO: `/v3/roles/service` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:30.314258 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c860575-8561-4780-8345-122c96de4d3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:15:30.322454 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-4c860575-8561-4780-8345-122c96de4d3b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 30 01:15:30.324281 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 250/494] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Mar 30 01:15:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:30.325376 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c860575-8561-4780-8345-122c96de4d3b None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:30.356720 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc0568-c508-49eb-a0b9-78adbda0fd8e None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:30.389827 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d79f5f-39a1-4c86-a861-9477792eb6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:30.390474 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d79f5f-39a1-4c86-a861-9477792eb6e1 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:30.390784 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d79f5f-39a1-4c86-a861-9477792eb6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:30.391065 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d79f5f-39a1-4c86-a861-9477792eb6e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:30.429403 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c860575-8561-4780-8345-122c96de4d3b None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:30.457855 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d79f5f-39a1-4c86-a861-9477792eb6e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:30.459330 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d79f5f-39a1-4c86-a861-9477792eb6e1 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:30.461446 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991ea93-7748-443e-a3ce-55ec9d968da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:30.462119 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991ea93-7748-443e-a3ce-55ec9d968da0 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:30.462403 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991ea93-7748-443e-a3ce-55ec9d968da0 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:30.462682 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991ea93-7748-443e-a3ce-55ec9d968da0 None admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:30.463453 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8991ea93-7748-443e-a3ce-55ec9d968da0 None admin] RBAC: Adding query filter params (name=service) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:30.463757 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8991ea93-7748-443e-a3ce-55ec9d968da0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:30.465126 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8991ea93-7748-443e-a3ce-55ec9d968da0 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:30.473578 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 251/495] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Mar 30 01:15:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:30.474372 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991ea93-7748-443e-a3ce-55ec9d968da0 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:30.571033 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 245/496] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Mar 30 01:15:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 30 01:15:30.572682 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b084c-134d-4630-89b0-eb6309f9689e None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:30.572789 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b084c-134d-4630-89b0-eb6309f9689e None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:30.572998 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b084c-134d-4630-89b0-eb6309f9689e None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:30.578492 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 246/497] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:15:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:15:30.578492 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b084c-134d-4630-89b0-eb6309f9689e None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:30.584810 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991ea93-7748-443e-a3ce-55ec9d968da0 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:30.621633 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b929b46-e170-4de1-b2cc-bb8a9bc90cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:30.622307 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b929b46-e170-4de1-b2cc-bb8a9bc90cb4 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:30.622588 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b929b46-e170-4de1-b2cc-bb8a9bc90cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:30.622890 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b929b46-e170-4de1-b2cc-bb8a9bc90cb4 None admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:30.623643 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b929b46-e170-4de1-b2cc-bb8a9bc90cb4 None admin] RBAC: Adding query filter params (name=service) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:30.623945 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b929b46-e170-4de1-b2cc-bb8a9bc90cb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:30.625330 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b929b46-e170-4de1-b2cc-bb8a9bc90cb4 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:30.633518 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 252/498] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Mar 30 01:15:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:30.634331 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b929b46-e170-4de1-b2cc-bb8a9bc90cb4 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:30.689463 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b084c-134d-4630-89b0-eb6309f9689e None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:30.722883 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96253c92-a523-4aed-aab5-5e1e7ab7e852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:30.723845 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96253c92-a523-4aed-aab5-5e1e7ab7e852 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:30.724315 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96253c92-a523-4aed-aab5-5e1e7ab7e852 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:30.724736 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96253c92-a523-4aed-aab5-5e1e7ab7e852 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:30.731030 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b929b46-e170-4de1-b2cc-bb8a9bc90cb4 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:30.734856 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96253c92-a523-4aed-aab5-5e1e7ab7e852 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:30.736288 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96253c92-a523-4aed-aab5-5e1e7ab7e852 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:30.753222 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-96253c92-a523-4aed-aab5-5e1e7ab7e852 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:15:30.754662 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 247/499] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:15:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:30.760110 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e67c2-9df0-4993-8ac3-710544976d92 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:30.760401 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e67c2-9df0-4993-8ac3-710544976d92 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:30.760799 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e67c2-9df0-4993-8ac3-710544976d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:30.763743 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853c803c-91b0-4622-aaa9-37440badc700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:30.764527 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c803c-91b0-4622-aaa9-37440badc700 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:30.764808 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c803c-91b0-4622-aaa9-37440badc700 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:30.765080 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c803c-91b0-4622-aaa9-37440badc700 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:30.777691 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853c803c-91b0-4622-aaa9-37440badc700 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:30.777871 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-e50e67c2-9df0-4993-8ac3-710544976d92 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:15:30.778924 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-e50e67c2-9df0-4993-8ac3-710544976d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:15:30.779194 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853c803c-91b0-4622-aaa9-37440badc700 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:30.796814 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-853c803c-91b0-4622-aaa9-37440badc700 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:15:30.802648 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 253/500] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:15:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:30.802648 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853c803c-91b0-4622-aaa9-37440badc700 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:30.849715 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 248/501] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:15:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 01:15:30.850549 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e67c2-9df0-4993-8ac3-710544976d92 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:30.899839 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853c803c-91b0-4622-aaa9-37440badc700 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:30.931021 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05355e6c-75d4-41dd-a61b-243204761a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:30.931802 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05355e6c-75d4-41dd-a61b-243204761a29 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:30.932087 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05355e6c-75d4-41dd-a61b-243204761a29 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:30.932359 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05355e6c-75d4-41dd-a61b-243204761a29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:30.943224 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05355e6c-75d4-41dd-a61b-243204761a29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:30.944673 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05355e6c-75d4-41dd-a61b-243204761a29 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:30.946111 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e67c2-9df0-4993-8ac3-710544976d92 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:30.961461 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-05355e6c-75d4-41dd-a61b-243204761a29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:15:30.967305 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 254/502] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:15:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:30.967305 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05355e6c-75d4-41dd-a61b-243204761a29 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:30.978205 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2407189d-4b81-4ee0-8a4d-be37cc4dc4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:30.978894 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2407189d-4b81-4ee0-8a4d-be37cc4dc4a2 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:30.979180 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2407189d-4b81-4ee0-8a4d-be37cc4dc4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:30.979457 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2407189d-4b81-4ee0-8a4d-be37cc4dc4a2 None admin] PATH_INFO: `/v3/domains` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:30.980183 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2407189d-4b81-4ee0-8a4d-be37cc4dc4a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:30.980503 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2407189d-4b81-4ee0-8a4d-be37cc4dc4a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:30.981863 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2407189d-4b81-4ee0-8a4d-be37cc4dc4a2 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:30.992710 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 249/503] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:15:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:30.993484 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2407189d-4b81-4ee0-8a4d-be37cc4dc4a2 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:31.057430 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05355e6c-75d4-41dd-a61b-243204761a29 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:31.085908 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2407189d-4b81-4ee0-8a4d-be37cc4dc4a2 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:31.089136 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36adce5-87bd-44d0-9ba0-471386a8e563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:31.089794 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36adce5-87bd-44d0-9ba0-471386a8e563 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:31.090084 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36adce5-87bd-44d0-9ba0-471386a8e563 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:31.090445 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36adce5-87bd-44d0-9ba0-471386a8e563 None admin] PATH_INFO: `/v3/domains` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:31.091115 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36adce5-87bd-44d0-9ba0-471386a8e563 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:31.091431 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36adce5-87bd-44d0-9ba0-471386a8e563 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:31.092811 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36adce5-87bd-44d0-9ba0-471386a8e563 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:31.105247 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 255/504] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:15:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:31.106497 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e12e4-c852-4a43-9ffb-6af8da0c2549 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:31.106820 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e12e4-c852-4a43-9ffb-6af8da0c2549 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:31.107106 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e12e4-c852-4a43-9ffb-6af8da0c2549 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:31.108740 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 256/505] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:15:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:15:31.110408 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958e12e4-c852-4a43-9ffb-6af8da0c2549 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:31.125533 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa61ec75-9c15-43d4-b4b1-3872cc3c25f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:31.126330 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61ec75-9c15-43d4-b4b1-3872cc3c25f1 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:31.126613 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61ec75-9c15-43d4-b4b1-3872cc3c25f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:31.126924 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61ec75-9c15-43d4-b4b1-3872cc3c25f1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:31.137082 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa61ec75-9c15-43d4-b4b1-3872cc3c25f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:15:31.143978 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-aa61ec75-9c15-43d4-b4b1-3872cc3c25f1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 30 01:15:31.145694 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 250/506] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Mar 30 01:15:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:31.146445 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa61ec75-9c15-43d4-b4b1-3872cc3c25f1 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:31.207290 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958e12e4-c852-4a43-9ffb-6af8da0c2549 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:31.239860 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa61ec75-9c15-43d4-b4b1-3872cc3c25f1 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:31.240415 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32da3f5-fba2-453b-a316-0ae4b63e0f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:31.241075 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32da3f5-fba2-453b-a316-0ae4b63e0f18 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:31.241356 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32da3f5-fba2-453b-a316-0ae4b63e0f18 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:31.241631 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32da3f5-fba2-453b-a316-0ae4b63e0f18 None admin] PATH_INFO: `/v3/domains` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:31.242350 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32da3f5-fba2-453b-a316-0ae4b63e0f18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:31.242657 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32da3f5-fba2-453b-a316-0ae4b63e0f18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:31.244067 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32da3f5-fba2-453b-a316-0ae4b63e0f18 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:31.255019 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 257/507] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:15:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:31.255807 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32da3f5-fba2-453b-a316-0ae4b63e0f18 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:31.271779 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b6c0ba-5396-4c5b-a33f-42934431731c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:31.272560 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6c0ba-5396-4c5b-a33f-42934431731c None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:31.272838 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6c0ba-5396-4c5b-a33f-42934431731c None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:31.273108 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6c0ba-5396-4c5b-a33f-42934431731c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:31.280576 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b6c0ba-5396-4c5b-a33f-42934431731c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:31.281990 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b6c0ba-5396-4c5b-a33f-42934431731c None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:31.295317 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-80b6c0ba-5396-4c5b-a33f-42934431731c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Mar 30 01:15:31.296471 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 251/508] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Mar 30 01:15:31 2022] GET /identity/v3/users/neutron => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:31.297589 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a0fb1-0355-4854-b119-ec2282c519c7 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:31.297867 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a0fb1-0355-4854-b119-ec2282c519c7 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:31.298138 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a0fb1-0355-4854-b119-ec2282c519c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:31.313854 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-f33a0fb1-0355-4854-b119-ec2282c519c7 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:15:31.315055 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-f33a0fb1-0355-4854-b119-ec2282c519c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:15:31.351633 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32da3f5-fba2-453b-a316-0ae4b63e0f18 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:31.376802 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 252/509] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:15:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 01:15:31.377547 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33a0fb1-0355-4854-b119-ec2282c519c7 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:31.383740 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16528b02-009c-4277-b6c6-359d19097347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:31.384521 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16528b02-009c-4277-b6c6-359d19097347 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:31.384843 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16528b02-009c-4277-b6c6-359d19097347 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:31.385128 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16528b02-009c-4277-b6c6-359d19097347 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:31.391526 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16528b02-009c-4277-b6c6-359d19097347 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:31.392976 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16528b02-009c-4277-b6c6-359d19097347 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:31.406474 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-16528b02-009c-4277-b6c6-359d19097347 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 30 01:15:31.407677 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 258/510] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Mar 30 01:15:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:31.408443 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16528b02-009c-4277-b6c6-359d19097347 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:31.483393 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33a0fb1-0355-4854-b119-ec2282c519c7 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:31.501540 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16528b02-009c-4277-b6c6-359d19097347 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:31.515430 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44af011-ddb4-441d-a2dd-7a73263ae4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:31.516085 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44af011-ddb4-441d-a2dd-7a73263ae4c7 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:31.516364 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44af011-ddb4-441d-a2dd-7a73263ae4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:31.516635 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44af011-ddb4-441d-a2dd-7a73263ae4c7 None admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:31.517363 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44af011-ddb4-441d-a2dd-7a73263ae4c7 None admin] RBAC: Adding query filter params (name=service) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:31.517664 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44af011-ddb4-441d-a2dd-7a73263ae4c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:31.519574 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44af011-ddb4-441d-a2dd-7a73263ae4c7 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:31.527251 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 253/511] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Mar 30 01:15:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:31.528042 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44af011-ddb4-441d-a2dd-7a73263ae4c7 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:31.538672 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4a87f5-14ba-4211-a89e-9ff1d042d93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:31.539489 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a87f5-14ba-4211-a89e-9ff1d042d93f None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:31.539770 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a87f5-14ba-4211-a89e-9ff1d042d93f None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:31.540045 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a87f5-14ba-4211-a89e-9ff1d042d93f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:31.546926 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4a87f5-14ba-4211-a89e-9ff1d042d93f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:31.548355 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4a87f5-14ba-4211-a89e-9ff1d042d93f None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:31.562037 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-5e4a87f5-14ba-4211-a89e-9ff1d042d93f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Mar 30 01:15:31.563315 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 259/512] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Mar 30 01:15:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:31.564078 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4a87f5-14ba-4211-a89e-9ff1d042d93f None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:31.626362 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44af011-ddb4-441d-a2dd-7a73263ae4c7 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:31.658778 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4a87f5-14ba-4211-a89e-9ff1d042d93f None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:31.662822 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282e8fba-880c-4a75-9fab-b1489268a444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:31.663488 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282e8fba-880c-4a75-9fab-b1489268a444 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:31.663774 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282e8fba-880c-4a75-9fab-b1489268a444 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:31.664145 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282e8fba-880c-4a75-9fab-b1489268a444 None admin] PATH_INFO: `/v3/users` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:31.664980 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282e8fba-880c-4a75-9fab-b1489268a444 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:31.665287 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282e8fba-880c-4a75-9fab-b1489268a444 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:31.666723 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282e8fba-880c-4a75-9fab-b1489268a444 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:31.692112 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18980214-4485-450b-9b31-3ff22a4e130c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:31.692890 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18980214-4485-450b-9b31-3ff22a4e130c None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:31.693174 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18980214-4485-450b-9b31-3ff22a4e130c None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:31.693455 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18980214-4485-450b-9b31-3ff22a4e130c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:31.702793 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 254/513] 10.222.0.30 () {56 vars in 1139 bytes} [Wed Mar 30 01:15:31 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:31.703132 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18980214-4485-450b-9b31-3ff22a4e130c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:31.703617 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282e8fba-880c-4a75-9fab-b1489268a444 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:31.704588 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18980214-4485-450b-9b31-3ff22a4e130c None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:31.721318 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-18980214-4485-450b-9b31-3ff22a4e130c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:15:31.723041 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 260/514] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:15:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:31.723814 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18980214-4485-450b-9b31-3ff22a4e130c None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:31.801340 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282e8fba-880c-4a75-9fab-b1489268a444 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:31.816613 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18980214-4485-450b-9b31-3ff22a4e130c None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:31.834641 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e68f8e-bb8d-49a7-a6cd-25b7e239022c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:31.835326 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e68f8e-bb8d-49a7-a6cd-25b7e239022c None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:31.835608 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e68f8e-bb8d-49a7-a6cd-25b7e239022c None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:31.835883 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e68f8e-bb8d-49a7-a6cd-25b7e239022c None admin] PATH_INFO: `/v3/projects` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:31.836656 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e68f8e-bb8d-49a7-a6cd-25b7e239022c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:31.836965 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e68f8e-bb8d-49a7-a6cd-25b7e239022c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:31.838409 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e68f8e-bb8d-49a7-a6cd-25b7e239022c None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:31.849100 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13793227-716d-4d3f-8923-ee03286adc8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:31.849873 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13793227-716d-4d3f-8923-ee03286adc8d None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:31.850156 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13793227-716d-4d3f-8923-ee03286adc8d None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:31.850432 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13793227-716d-4d3f-8923-ee03286adc8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:31.855900 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 255/515] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Mar 30 01:15:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:31.856703 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e68f8e-bb8d-49a7-a6cd-25b7e239022c None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:31.860285 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13793227-716d-4d3f-8923-ee03286adc8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:31.861734 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13793227-716d-4d3f-8923-ee03286adc8d None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:31.878239 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-13793227-716d-4d3f-8923-ee03286adc8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:15:31.880217 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 261/516] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:15:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:31.881001 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13793227-716d-4d3f-8923-ee03286adc8d None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:31.958228 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e68f8e-bb8d-49a7-a6cd-25b7e239022c None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:31.975089 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13793227-716d-4d3f-8923-ee03286adc8d None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:31.990627 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277da30c-0d7e-4e29-a057-efffdd05d061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:31.991327 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277da30c-0d7e-4e29-a057-efffdd05d061 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:31.991622 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277da30c-0d7e-4e29-a057-efffdd05d061 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:31.991891 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277da30c-0d7e-4e29-a057-efffdd05d061 None admin] PATH_INFO: `/v3/users` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:31.992715 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277da30c-0d7e-4e29-a057-efffdd05d061 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:31.993021 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277da30c-0d7e-4e29-a057-efffdd05d061 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:31.994456 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277da30c-0d7e-4e29-a057-efffdd05d061 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:32.009022 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba02f74-ee8d-4aff-8ba9-962b1bf229d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:32.009658 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba02f74-ee8d-4aff-8ba9-962b1bf229d7 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:32.009934 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba02f74-ee8d-4aff-8ba9-962b1bf229d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:32.010203 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba02f74-ee8d-4aff-8ba9-962b1bf229d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:32.011428 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 256/517] 10.222.0.30 () {56 vars in 1137 bytes} [Wed Mar 30 01:15:31 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:32.012243 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277da30c-0d7e-4e29-a057-efffdd05d061 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:32.073967 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba02f74-ee8d-4aff-8ba9-962b1bf229d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:32.075436 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba02f74-ee8d-4aff-8ba9-962b1bf229d7 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:32.109389 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277da30c-0d7e-4e29-a057-efffdd05d061 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:32.142096 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe448d22-7495-49e8-8637-e41235030234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:32.142768 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe448d22-7495-49e8-8637-e41235030234 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:32.143053 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe448d22-7495-49e8-8637-e41235030234 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:32.143329 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe448d22-7495-49e8-8637-e41235030234 None admin] PATH_INFO: `/v3/domains` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:32.144074 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe448d22-7495-49e8-8637-e41235030234 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:32.144551 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe448d22-7495-49e8-8637-e41235030234 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:32.145901 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe448d22-7495-49e8-8637-e41235030234 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:32.156865 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 257/518] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:15:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:32.157646 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe448d22-7495-49e8-8637-e41235030234 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:32.170178 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 262/519] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Mar 30 01:15:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 30 01:15:32.170178 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba02f74-ee8d-4aff-8ba9-962b1bf229d7 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:32.255346 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe448d22-7495-49e8-8637-e41235030234 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:32.258077 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba02f74-ee8d-4aff-8ba9-962b1bf229d7 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:32.287756 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d3a6fa-2d16-49f7-90d1-b74b5cf58332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:32.288398 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d3a6fa-2d16-49f7-90d1-b74b5cf58332 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:32.288679 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d3a6fa-2d16-49f7-90d1-b74b5cf58332 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:32.288954 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d3a6fa-2d16-49f7-90d1-b74b5cf58332 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:32.289765 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d3a6fa-2d16-49f7-90d1-b74b5cf58332 None admin] RBAC: Adding query filter params (role.id=4121aef9b31c4671aebb65fda1c11185, scope.project.id=0c9a4444228d4be89a4ba8aa53099531, user.id=140c6d1a20e94192bde06e72040f162d) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:32.290071 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d3a6fa-2d16-49f7-90d1-b74b5cf58332 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:32.290282 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f9ef2-0063-4023-bff0-adf42b5bcf62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:32.290957 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f9ef2-0063-4023-bff0-adf42b5bcf62 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:32.291242 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f9ef2-0063-4023-bff0-adf42b5bcf62 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:32.291517 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d3a6fa-2d16-49f7-90d1-b74b5cf58332 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:32.291618 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f9ef2-0063-4023-bff0-adf42b5bcf62 None admin] PATH_INFO: `/v3/domains` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:32.292230 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652f9ef2-0063-4023-bff0-adf42b5bcf62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:32.292536 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652f9ef2-0063-4023-bff0-adf42b5bcf62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:32.293886 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652f9ef2-0063-4023-bff0-adf42b5bcf62 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:32.296699 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 258/520] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Mar 30 01:15:32 2022] GET /identity/v3/role_assignments?user.id=140c6d1a20e94192bde06e72040f162d&scope.project.id=0c9a4444228d4be89a4ba8aa53099531&role.id=4121aef9b31c4671aebb65fda1c11185 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:32.297463 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d3a6fa-2d16-49f7-90d1-b74b5cf58332 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:32.306263 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 263/521] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:15:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:32.307658 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f9ef2-0063-4023-bff0-adf42b5bcf62 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:32.402219 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d3a6fa-2d16-49f7-90d1-b74b5cf58332 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:32.414832 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f9ef2-0063-4023-bff0-adf42b5bcf62 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:32.438270 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b71f49-1286-4027-a7a6-1d9064d02671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:32.438998 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b71f49-1286-4027-a7a6-1d9064d02671 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:32.439295 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b71f49-1286-4027-a7a6-1d9064d02671 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:32.439571 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b71f49-1286-4027-a7a6-1d9064d02671 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:32.451082 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e78e85-3397-44cc-aa85-f15c4d9010e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:32.451758 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e78e85-3397-44cc-aa85-f15c4d9010e1 None admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:32.452041 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e78e85-3397-44cc-aa85-f15c4d9010e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:32.452325 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e78e85-3397-44cc-aa85-f15c4d9010e1 None admin] PATH_INFO: `/v3/users` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:32.453031 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e78e85-3397-44cc-aa85-f15c4d9010e1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:32.454495 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e78e85-3397-44cc-aa85-f15c4d9010e1 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:32.486741 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 264/522] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Mar 30 01:15:32 2022] POST /identity/v3/users => generated 247 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:15:32.486741 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e78e85-3397-44cc-aa85-f15c4d9010e1 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:32.517871 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b71f49-1286-4027-a7a6-1d9064d02671 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:32.519955 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b71f49-1286-4027-a7a6-1d9064d02671 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:32.610377 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e78e85-3397-44cc-aa85-f15c4d9010e1 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:32.627514 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 259/523] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Mar 30 01:15:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 30 01:15:32.628920 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b71f49-1286-4027-a7a6-1d9064d02671 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:32.657053 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714df3c7-b568-45a7-b904-d3996772c484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:32.658246 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714df3c7-b568-45a7-b904-d3996772c484 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:32.658786 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714df3c7-b568-45a7-b904-d3996772c484 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:32.659255 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714df3c7-b568-45a7-b904-d3996772c484 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:32.671460 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714df3c7-b568-45a7-b904-d3996772c484 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:32.673271 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714df3c7-b568-45a7-b904-d3996772c484 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:32.691748 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-714df3c7-b568-45a7-b904-d3996772c484 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:15:32.693303 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 265/524] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:15:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:32.694097 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714df3c7-b568-45a7-b904-d3996772c484 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:32.736961 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b71f49-1286-4027-a7a6-1d9064d02671 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:32.771464 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7c451d-0376-4a7c-9bb3-6845476d4fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:32.772191 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c451d-0376-4a7c-9bb3-6845476d4fc7 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:32.772469 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c451d-0376-4a7c-9bb3-6845476d4fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:32.772737 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c451d-0376-4a7c-9bb3-6845476d4fc7 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:32.780275 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7c451d-0376-4a7c-9bb3-6845476d4fc7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:32.781721 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7c451d-0376-4a7c-9bb3-6845476d4fc7 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:32.796098 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-2e7c451d-0376-4a7c-9bb3-6845476d4fc7 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Mar 30 01:15:32.797595 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 260/525] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Mar 30 01:15:32 2022] GET /identity/v3/users/glance => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:32.798374 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7c451d-0376-4a7c-9bb3-6845476d4fc7 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:32.811113 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714df3c7-b568-45a7-b904-d3996772c484 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:32.845604 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d454f9c-951f-4b58-a986-3aeaab210b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:32.846198 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d454f9c-951f-4b58-a986-3aeaab210b69 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:32.846478 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d454f9c-951f-4b58-a986-3aeaab210b69 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:32.846776 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d454f9c-951f-4b58-a986-3aeaab210b69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:32.858158 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d454f9c-951f-4b58-a986-3aeaab210b69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:32.859646 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d454f9c-951f-4b58-a986-3aeaab210b69 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:32.876302 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-2d454f9c-951f-4b58-a986-3aeaab210b69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:15:32.876978 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 266/526] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:15:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:32.877803 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d454f9c-951f-4b58-a986-3aeaab210b69 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:32.907531 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7c451d-0376-4a7c-9bb3-6845476d4fc7 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:32.943296 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c41f1-4013-4910-b9a6-8e828221d939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:32.944200 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c41f1-4013-4910-b9a6-8e828221d939 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:32.944654 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c41f1-4013-4910-b9a6-8e828221d939 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:32.945075 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c41f1-4013-4910-b9a6-8e828221d939 None admin] PATH_INFO: `/v3/domains` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:32.945940 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0c41f1-4013-4910-b9a6-8e828221d939 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:32.946458 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0c41f1-4013-4910-b9a6-8e828221d939 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:32.948046 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0c41f1-4013-4910-b9a6-8e828221d939 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:32.961164 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 261/527] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:15:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:32.962694 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c41f1-4013-4910-b9a6-8e828221d939 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:32.982580 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d454f9c-951f-4b58-a986-3aeaab210b69 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:33.016177 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f3582f-ac48-4511-a3dc-341a7d7833e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:33.016847 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3582f-ac48-4511-a3dc-341a7d7833e8 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:33.017127 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3582f-ac48-4511-a3dc-341a7d7833e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:33.017402 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3582f-ac48-4511-a3dc-341a7d7833e8 None admin] PATH_INFO: `/v3/users` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:33.018235 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f3582f-ac48-4511-a3dc-341a7d7833e8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:33.018541 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f3582f-ac48-4511-a3dc-341a7d7833e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:33.020769 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f3582f-ac48-4511-a3dc-341a7d7833e8 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:33.038952 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 267/528] 10.222.0.30 () {56 vars in 1137 bytes} [Wed Mar 30 01:15:32 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:33.039790 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f3582f-ac48-4511-a3dc-341a7d7833e8 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:33.069191 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c41f1-4013-4910-b9a6-8e828221d939 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:33.105418 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6125106f-a942-4e89-a90c-163d0316bf06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:33.106206 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6125106f-a942-4e89-a90c-163d0316bf06 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:33.106557 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6125106f-a942-4e89-a90c-163d0316bf06 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:33.106940 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6125106f-a942-4e89-a90c-163d0316bf06 None admin] PATH_INFO: `/v3/domains` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:33.107734 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6125106f-a942-4e89-a90c-163d0316bf06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:33.108111 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6125106f-a942-4e89-a90c-163d0316bf06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:33.109620 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6125106f-a942-4e89-a90c-163d0316bf06 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:33.122196 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 262/529] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:15:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:33.123218 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6125106f-a942-4e89-a90c-163d0316bf06 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:33.141984 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f3582f-ac48-4511-a3dc-341a7d7833e8 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:33.177844 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c16362e-79b2-4fd6-a229-48a7c0703dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:33.178630 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c16362e-79b2-4fd6-a229-48a7c0703dc2 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:33.178936 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c16362e-79b2-4fd6-a229-48a7c0703dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:33.179208 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c16362e-79b2-4fd6-a229-48a7c0703dc2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:33.186187 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c16362e-79b2-4fd6-a229-48a7c0703dc2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:33.188265 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c16362e-79b2-4fd6-a229-48a7c0703dc2 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:33.201999 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-5c16362e-79b2-4fd6-a229-48a7c0703dc2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 30 01:15:33.203543 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 268/530] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Mar 30 01:15:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:33.204380 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c16362e-79b2-4fd6-a229-48a7c0703dc2 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:33.244040 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6125106f-a942-4e89-a90c-163d0316bf06 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:33.285742 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c6c2b1-fe98-4d09-b3e8-11d40c856720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:33.286391 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6c2b1-fe98-4d09-b3e8-11d40c856720 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:33.287125 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6c2b1-fe98-4d09-b3e8-11d40c856720 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:33.287415 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6c2b1-fe98-4d09-b3e8-11d40c856720 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:33.315438 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c16362e-79b2-4fd6-a229-48a7c0703dc2 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:33.356400 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed95502-c01d-44f9-80d3-d12f13a083a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:33.357516 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed95502-c01d-44f9-80d3-d12f13a083a6 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:33.358062 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed95502-c01d-44f9-80d3-d12f13a083a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:33.358347 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed95502-c01d-44f9-80d3-d12f13a083a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:33.367445 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed95502-c01d-44f9-80d3-d12f13a083a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:33.369574 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed95502-c01d-44f9-80d3-d12f13a083a6 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:33.371122 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c6c2b1-fe98-4d09-b3e8-11d40c856720 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:33.373132 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c6c2b1-fe98-4d09-b3e8-11d40c856720 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:33.386408 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-fed95502-c01d-44f9-80d3-d12f13a083a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 30 01:15:33.388201 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 269/531] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Mar 30 01:15:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:33.389365 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed95502-c01d-44f9-80d3-d12f13a083a6 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:33.486407 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 263/532] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Mar 30 01:15:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 30 01:15:33.487553 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c6c2b1-fe98-4d09-b3e8-11d40c856720 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:33.514593 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed95502-c01d-44f9-80d3-d12f13a083a6 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:33.548825 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4635af0d-787c-4a00-8968-54486232f52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:33.549481 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4635af0d-787c-4a00-8968-54486232f52e None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:33.549760 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4635af0d-787c-4a00-8968-54486232f52e None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:33.550030 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4635af0d-787c-4a00-8968-54486232f52e None admin] PATH_INFO: `/v3/projects` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:33.551532 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4635af0d-787c-4a00-8968-54486232f52e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:33.551838 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4635af0d-787c-4a00-8968-54486232f52e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:33.553267 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4635af0d-787c-4a00-8968-54486232f52e None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:33.572357 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 270/533] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Mar 30 01:15:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:33.573117 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4635af0d-787c-4a00-8968-54486232f52e None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:33.589040 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c6c2b1-fe98-4d09-b3e8-11d40c856720 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:33.624133 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2022c2ac-e2de-4411-8ae4-b0d4c074a297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:33.624987 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2022c2ac-e2de-4411-8ae4-b0d4c074a297 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:33.625118 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2022c2ac-e2de-4411-8ae4-b0d4c074a297 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:33.625358 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2022c2ac-e2de-4411-8ae4-b0d4c074a297 None admin] PATH_INFO: `/v3/projects` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:33.626169 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2022c2ac-e2de-4411-8ae4-b0d4c074a297 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:33.626503 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2022c2ac-e2de-4411-8ae4-b0d4c074a297 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:33.627927 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2022c2ac-e2de-4411-8ae4-b0d4c074a297 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:33.640006 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 264/534] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Mar 30 01:15:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:33.640930 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2022c2ac-e2de-4411-8ae4-b0d4c074a297 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:33.681534 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4635af0d-787c-4a00-8968-54486232f52e None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:33.715502 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8954d2c-5fe3-4c77-83c4-b1f6ca8c071e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:33.716566 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8954d2c-5fe3-4c77-83c4-b1f6ca8c071e None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:33.717041 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8954d2c-5fe3-4c77-83c4-b1f6ca8c071e None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:33.717491 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8954d2c-5fe3-4c77-83c4-b1f6ca8c071e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:33.728009 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8954d2c-5fe3-4c77-83c4-b1f6ca8c071e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:33.729694 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8954d2c-5fe3-4c77-83c4-b1f6ca8c071e None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:33.746877 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-d8954d2c-5fe3-4c77-83c4-b1f6ca8c071e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:15:33.747885 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2022c2ac-e2de-4411-8ae4-b0d4c074a297 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:33.748846 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 271/535] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:15:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:33.750011 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8954d2c-5fe3-4c77-83c4-b1f6ca8c071e None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:33.788759 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac4ec8d-8d07-4529-a95f-639f5f3f259d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:33.789987 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac4ec8d-8d07-4529-a95f-639f5f3f259d None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:33.790613 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac4ec8d-8d07-4529-a95f-639f5f3f259d None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:33.791085 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac4ec8d-8d07-4529-a95f-639f5f3f259d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:33.792679 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac4ec8d-8d07-4529-a95f-639f5f3f259d None admin] RBAC: Adding query filter params (role.id=4121aef9b31c4671aebb65fda1c11185, scope.project.id=0c9a4444228d4be89a4ba8aa53099531, user.id=41745b7f8a804e75b490a0a34977b23b) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:33.793208 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac4ec8d-8d07-4529-a95f-639f5f3f259d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:33.795586 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac4ec8d-8d07-4529-a95f-639f5f3f259d None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:33.803070 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 265/536] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Mar 30 01:15:33 2022] GET /identity/v3/role_assignments?user.id=41745b7f8a804e75b490a0a34977b23b&scope.project.id=0c9a4444228d4be89a4ba8aa53099531&role.id=4121aef9b31c4671aebb65fda1c11185 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:33.804098 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac4ec8d-8d07-4529-a95f-639f5f3f259d None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:33.927575 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8954d2c-5fe3-4c77-83c4-b1f6ca8c071e None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:33.995289 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1650ad-2d02-470b-92c3-ee6b75163666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:33.995927 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1650ad-2d02-470b-92c3-ee6b75163666 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:33.996249 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1650ad-2d02-470b-92c3-ee6b75163666 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:33.996529 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1650ad-2d02-470b-92c3-ee6b75163666 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:33.996881 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac4ec8d-8d07-4529-a95f-639f5f3f259d None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:33.998003 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1650ad-2d02-470b-92c3-ee6b75163666 None admin] RBAC: Adding query filter params (role.id=4121aef9b31c4671aebb65fda1c11185, scope.project.id=0c9a4444228d4be89a4ba8aa53099531, user.id=45219f386f0147b6bd380efe4ab62812) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:33.998003 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1650ad-2d02-470b-92c3-ee6b75163666 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:33.999117 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1650ad-2d02-470b-92c3-ee6b75163666 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:34.011024 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 272/537] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Mar 30 01:15:33 2022] GET /identity/v3/role_assignments?user.id=45219f386f0147b6bd380efe4ab62812&scope.project.id=0c9a4444228d4be89a4ba8aa53099531&role.id=4121aef9b31c4671aebb65fda1c11185 => generated 259 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:34.034264 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06f7926-fd83-411f-843d-34023c5b3017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:34.035524 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f7926-fd83-411f-843d-34023c5b3017 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:34.035809 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f7926-fd83-411f-843d-34023c5b3017 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:34.036091 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f7926-fd83-411f-843d-34023c5b3017 None admin] PATH_INFO: `/v3/domains` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:34.036895 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06f7926-fd83-411f-843d-34023c5b3017 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:34.037214 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06f7926-fd83-411f-843d-34023c5b3017 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:34.038690 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06f7926-fd83-411f-843d-34023c5b3017 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:34.052785 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 266/538] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:15:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:34.058155 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1650ad-2d02-470b-92c3-ee6b75163666 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:34.205262 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1650ad-2d02-470b-92c3-ee6b75163666 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:34.241468 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a97121-282a-469f-bbfb-06535bbfa368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:34.242330 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a97121-282a-469f-bbfb-06535bbfa368 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:34.242620 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a97121-282a-469f-bbfb-06535bbfa368 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:34.242924 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a97121-282a-469f-bbfb-06535bbfa368 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:34.250513 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a97121-282a-469f-bbfb-06535bbfa368 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:34.252036 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a97121-282a-469f-bbfb-06535bbfa368 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:34.265800 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-24a97121-282a-469f-bbfb-06535bbfa368 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 30 01:15:34.267520 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 273/539] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Mar 30 01:15:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:34.273598 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06f7926-fd83-411f-843d-34023c5b3017 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:34.405123 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06f7926-fd83-411f-843d-34023c5b3017 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:34.440279 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f647fe6e-ee2d-482a-972e-5c58fface87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:34.440977 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f647fe6e-ee2d-482a-972e-5c58fface87d None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:34.441265 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f647fe6e-ee2d-482a-972e-5c58fface87d None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:34.441547 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f647fe6e-ee2d-482a-972e-5c58fface87d None admin] PATH_INFO: `/v3/projects` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:34.442331 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f647fe6e-ee2d-482a-972e-5c58fface87d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:34.442643 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f647fe6e-ee2d-482a-972e-5c58fface87d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:34.444093 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f647fe6e-ee2d-482a-972e-5c58fface87d None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:34.456120 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 267/540] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Mar 30 01:15:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:34.462603 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a97121-282a-469f-bbfb-06535bbfa368 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:34.592260 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a97121-282a-469f-bbfb-06535bbfa368 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:34.634289 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4aeafc-eccc-44c3-8813-ae884ecb6cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:34.634980 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4aeafc-eccc-44c3-8813-ae884ecb6cbe None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:34.635265 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4aeafc-eccc-44c3-8813-ae884ecb6cbe None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:34.635542 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4aeafc-eccc-44c3-8813-ae884ecb6cbe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:34.636379 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4aeafc-eccc-44c3-8813-ae884ecb6cbe None admin] RBAC: Adding query filter params (role.id=4121aef9b31c4671aebb65fda1c11185, scope.project.id=0c9a4444228d4be89a4ba8aa53099531, user.id=ebf28c0ec3d94fb99bcd573dd8dd0e30) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:34.636692 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4aeafc-eccc-44c3-8813-ae884ecb6cbe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:34.638150 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4aeafc-eccc-44c3-8813-ae884ecb6cbe None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:34.644464 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 274/541] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Mar 30 01:15:34 2022] GET /identity/v3/role_assignments?user.id=ebf28c0ec3d94fb99bcd573dd8dd0e30&scope.project.id=0c9a4444228d4be89a4ba8aa53099531&role.id=4121aef9b31c4671aebb65fda1c11185 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:34.871541 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d416d531-139f-4636-a174-8e0ade1c5192 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:34.871922 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d416d531-139f-4636-a174-8e0ade1c5192 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:34.872086 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d416d531-139f-4636-a174-8e0ade1c5192 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:34.874171 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 268/542] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:15:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:15:34.881240 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805f0a6-a55b-4505-8f6d-f37695a17fb2 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:34.881526 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805f0a6-a55b-4505-8f6d-f37695a17fb2 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:34.881805 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805f0a6-a55b-4505-8f6d-f37695a17fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:34.900920 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-b805f0a6-a55b-4505-8f6d-f37695a17fb2 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:15:34.902115 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-b805f0a6-a55b-4505-8f6d-f37695a17fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:15:34.973520 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 275/543] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:15:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 01:15:34.997856 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d416d531-139f-4636-a174-8e0ade1c5192 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:35.078234 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb11395-f9f6-4c19-9d42-9a66f54815a6 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:35.078780 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb11395-f9f6-4c19-9d42-9a66f54815a6 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:35.078889 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb11395-f9f6-4c19-9d42-9a66f54815a6 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:35.080871 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 276/544] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:15:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:15:35.087162 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626efba9-cad3-401b-9966-592eb89e286b None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:35.087441 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626efba9-cad3-401b-9966-592eb89e286b None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:35.087868 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626efba9-cad3-401b-9966-592eb89e286b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:35.121893 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-626efba9-cad3-401b-9966-592eb89e286b None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:15:35.123056 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-626efba9-cad3-401b-9966-592eb89e286b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:15:35.171382 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d416d531-139f-4636-a174-8e0ade1c5192 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:35.244300 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a851c3ea-750a-42fe-8389-9fec2461a485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:35.245106 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851c3ea-750a-42fe-8389-9fec2461a485 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:35.245387 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851c3ea-750a-42fe-8389-9fec2461a485 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:35.245661 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851c3ea-750a-42fe-8389-9fec2461a485 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:35.245931 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 277/545] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:15:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 30 01:15:35.256834 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a851c3ea-750a-42fe-8389-9fec2461a485 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:15:35.264001 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-a851c3ea-750a-42fe-8389-9fec2461a485 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 30 01:15:35.265565 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 269/546] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Mar 30 01:15:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:35.272120 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626efba9-cad3-401b-9966-592eb89e286b None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:35.285989 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a851c3ea-750a-42fe-8389-9fec2461a485 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:35.406220 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626efba9-cad3-401b-9966-592eb89e286b None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:35.444091 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dfd8b2-1576-424b-9316-e9ceb38e421b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:35.444760 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dfd8b2-1576-424b-9316-e9ceb38e421b None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:35.445045 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dfd8b2-1576-424b-9316-e9ceb38e421b None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:35.445324 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dfd8b2-1576-424b-9316-e9ceb38e421b None admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:35.446074 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dfd8b2-1576-424b-9316-e9ceb38e421b None admin] RBAC: Adding query filter params (name=service) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:35.446380 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dfd8b2-1576-424b-9316-e9ceb38e421b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:35.454722 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dfd8b2-1576-424b-9316-e9ceb38e421b None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:35.457013 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 278/547] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Mar 30 01:15:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:35.463047 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dfd8b2-1576-424b-9316-e9ceb38e421b None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:35.528834 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a851c3ea-750a-42fe-8389-9fec2461a485 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:35.577184 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dfd8b2-1576-424b-9316-e9ceb38e421b None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:35.614784 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec1c96-a7f7-45d7-8fa3-846bd945b6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:35.615645 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec1c96-a7f7-45d7-8fa3-846bd945b6e2 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:35.615937 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec1c96-a7f7-45d7-8fa3-846bd945b6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:35.616218 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec1c96-a7f7-45d7-8fa3-846bd945b6e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:35.619953 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5dc001-081e-4cba-b6fe-e0607d05bbe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:35.620767 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5dc001-081e-4cba-b6fe-e0607d05bbe8 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:35.621046 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5dc001-081e-4cba-b6fe-e0607d05bbe8 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:35.621317 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5dc001-081e-4cba-b6fe-e0607d05bbe8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:35.627363 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efec1c96-a7f7-45d7-8fa3-846bd945b6e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:35.629534 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efec1c96-a7f7-45d7-8fa3-846bd945b6e2 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:35.647555 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-efec1c96-a7f7-45d7-8fa3-846bd945b6e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:15:35.649126 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 279/548] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:15:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 01:15:35.655129 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec1c96-a7f7-45d7-8fa3-846bd945b6e2 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:35.671424 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5dc001-081e-4cba-b6fe-e0607d05bbe8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:15:35.678332 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-2c5dc001-081e-4cba-b6fe-e0607d05bbe8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 30 01:15:35.684324 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 270/549] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Mar 30 01:15:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 395 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:35.685516 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5dc001-081e-4cba-b6fe-e0607d05bbe8 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:35.790261 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec1c96-a7f7-45d7-8fa3-846bd945b6e2 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:35.827938 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5dc001-081e-4cba-b6fe-e0607d05bbe8 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:35.865407 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1e7594-4077-4b16-9e61-ec8c8889a48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:35.866080 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e7594-4077-4b16-9e61-ec8c8889a48f None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:35.866366 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e7594-4077-4b16-9e61-ec8c8889a48f None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:35.866645 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e7594-4077-4b16-9e61-ec8c8889a48f None admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:35.867435 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1e7594-4077-4b16-9e61-ec8c8889a48f None admin] RBAC: Adding query filter params (name=service) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:35.867766 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1e7594-4077-4b16-9e61-ec8c8889a48f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:35.869106 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1e7594-4077-4b16-9e61-ec8c8889a48f None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:35.875419 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3730fe-f084-4c3b-89d6-c64213a3f2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:35.876083 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3730fe-f084-4c3b-89d6-c64213a3f2bc None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:35.876361 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3730fe-f084-4c3b-89d6-c64213a3f2bc None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:35.876634 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3730fe-f084-4c3b-89d6-c64213a3f2bc None admin] PATH_INFO: `/v3/domains` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:35.877361 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3730fe-f084-4c3b-89d6-c64213a3f2bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:35.877636 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 271/550] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Mar 30 01:15:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:15:35.877756 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3730fe-f084-4c3b-89d6-c64213a3f2bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:35.879251 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3730fe-f084-4c3b-89d6-c64213a3f2bc None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:35.882810 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1e7594-4077-4b16-9e61-ec8c8889a48f None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:35.903729 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 280/551] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:15:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:35.908870 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3730fe-f084-4c3b-89d6-c64213a3f2bc None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:36.083659 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1e7594-4077-4b16-9e61-ec8c8889a48f None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:36.094966 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3730fe-f084-4c3b-89d6-c64213a3f2bc None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:36.153497 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ea0d00-f250-4c13-bb34-4743b0115e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:36.154293 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ea0d00-f250-4c13-bb34-4743b0115e85 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:36.154574 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ea0d00-f250-4c13-bb34-4743b0115e85 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:36.155124 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ea0d00-f250-4c13-bb34-4743b0115e85 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:36.158373 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc2952-8b56-4188-90f4-778be36ebbd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:36.159178 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc2952-8b56-4188-90f4-778be36ebbd0 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:36.159504 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc2952-8b56-4188-90f4-778be36ebbd0 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:36.159782 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc2952-8b56-4188-90f4-778be36ebbd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:36.174185 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ea0d00-f250-4c13-bb34-4743b0115e85 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:36.175746 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ea0d00-f250-4c13-bb34-4743b0115e85 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:36.179262 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cc2952-8b56-4188-90f4-778be36ebbd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:36.181453 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cc2952-8b56-4188-90f4-778be36ebbd0 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:36.208786 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-f6ea0d00-f250-4c13-bb34-4743b0115e85 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 30 01:15:36.210108 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-35cc2952-8b56-4188-90f4-778be36ebbd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:15:36.210408 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 281/552] 10.222.0.30 () {56 vars in 1093 bytes} [Wed Mar 30 01:15:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:36.211680 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 272/553] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:15:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 01:15:36.215641 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ea0d00-f250-4c13-bb34-4743b0115e85 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:36.216920 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc2952-8b56-4188-90f4-778be36ebbd0 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:36.340339 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc2952-8b56-4188-90f4-778be36ebbd0 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:36.377263 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e50ac9b-f623-489c-8582-a62361191557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:36.377923 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e50ac9b-f623-489c-8582-a62361191557 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:36.378250 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e50ac9b-f623-489c-8582-a62361191557 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:36.382736 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e50ac9b-f623-489c-8582-a62361191557 None admin] PATH_INFO: `/v3/domains` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:36.382736 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e50ac9b-f623-489c-8582-a62361191557 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:36.382736 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e50ac9b-f623-489c-8582-a62361191557 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:36.382736 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e50ac9b-f623-489c-8582-a62361191557 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:36.393455 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 273/554] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:15:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:36.398731 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e50ac9b-f623-489c-8582-a62361191557 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:36.444908 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ea0d00-f250-4c13-bb34-4743b0115e85 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:36.522196 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e50ac9b-f623-489c-8582-a62361191557 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:36.538264 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b4a82c-cc3b-4ec7-9b85-b753d78f6e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:36.538960 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4a82c-cc3b-4ec7-9b85-b753d78f6e43 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:36.539239 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4a82c-cc3b-4ec7-9b85-b753d78f6e43 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:36.539513 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4a82c-cc3b-4ec7-9b85-b753d78f6e43 None admin] PATH_INFO: `/v3/users` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:36.540347 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b4a82c-cc3b-4ec7-9b85-b753d78f6e43 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:36.540648 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b4a82c-cc3b-4ec7-9b85-b753d78f6e43 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:36.542093 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b4a82c-cc3b-4ec7-9b85-b753d78f6e43 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:36.579684 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 282/555] 10.222.0.30 () {56 vars in 1133 bytes} [Wed Mar 30 01:15:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:15:36.586281 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b4a82c-cc3b-4ec7-9b85-b753d78f6e43 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:36.594720 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f54bc32-3524-4814-86e7-b05eefef9c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:36.595515 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f54bc32-3524-4814-86e7-b05eefef9c58 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:36.595808 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f54bc32-3524-4814-86e7-b05eefef9c58 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:36.596057 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f54bc32-3524-4814-86e7-b05eefef9c58 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:36.612069 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f54bc32-3524-4814-86e7-b05eefef9c58 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:36.616570 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f54bc32-3524-4814-86e7-b05eefef9c58 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:36.642239 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-1f54bc32-3524-4814-86e7-b05eefef9c58 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 30 01:15:36.646788 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 274/556] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Mar 30 01:15:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 01:15:36.648156 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32056b-e141-4698-bb6e-bb482abe45c3 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:36.648448 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32056b-e141-4698-bb6e-bb482abe45c3 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:36.648730 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32056b-e141-4698-bb6e-bb482abe45c3 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:36.650448 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 275/557] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:15:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:15:36.651226 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e32056b-e141-4698-bb6e-bb482abe45c3 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:36.721794 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b4a82c-cc3b-4ec7-9b85-b753d78f6e43 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:36.763382 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b7aee1-6bd3-402e-b5fd-2a2751e83b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:36.764162 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e32056b-e141-4698-bb6e-bb482abe45c3 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:36.764274 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7aee1-6bd3-402e-b5fd-2a2751e83b59 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:36.764450 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7aee1-6bd3-402e-b5fd-2a2751e83b59 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:36.764735 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7aee1-6bd3-402e-b5fd-2a2751e83b59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:36.777594 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b7aee1-6bd3-402e-b5fd-2a2751e83b59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:36.779233 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b7aee1-6bd3-402e-b5fd-2a2751e83b59 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:36.797140 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-92b7aee1-6bd3-402e-b5fd-2a2751e83b59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:15:36.801920 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956cc40b-8677-4e1f-b4c5-4f22a3cc9a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:36.802893 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956cc40b-8677-4e1f-b4c5-4f22a3cc9a27 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:36.803000 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 283/558] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:15:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 01:15:36.803097 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956cc40b-8677-4e1f-b4c5-4f22a3cc9a27 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:36.803361 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956cc40b-8677-4e1f-b4c5-4f22a3cc9a27 None admin] PATH_INFO: `/v3/users` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:36.804195 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956cc40b-8677-4e1f-b4c5-4f22a3cc9a27 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:36.804295 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244eed4f-8733-42c4-ae0e-35136f059cae None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:36.804497 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956cc40b-8677-4e1f-b4c5-4f22a3cc9a27 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:36.804595 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244eed4f-8733-42c4-ae0e-35136f059cae None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:36.804773 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244eed4f-8733-42c4-ae0e-35136f059cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:36.805929 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956cc40b-8677-4e1f-b4c5-4f22a3cc9a27 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:36.821253 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-244eed4f-8733-42c4-ae0e-35136f059cae None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:15:36.822559 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-244eed4f-8733-42c4-ae0e-35136f059cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:15:36.830784 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 276/559] 10.222.0.30 () {56 vars in 1135 bytes} [Wed Mar 30 01:15:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:36.834226 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956cc40b-8677-4e1f-b4c5-4f22a3cc9a27 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:36.898914 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 284/560] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:15:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 01:15:36.899756 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244eed4f-8733-42c4-ae0e-35136f059cae None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:36.949024 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956cc40b-8677-4e1f-b4c5-4f22a3cc9a27 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:36.983177 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa46b00f-0ce6-4bce-b38e-126b688bdc4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:36.983833 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46b00f-0ce6-4bce-b38e-126b688bdc4a None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:36.984110 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46b00f-0ce6-4bce-b38e-126b688bdc4a None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:36.984382 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46b00f-0ce6-4bce-b38e-126b688bdc4a None admin] PATH_INFO: `/v3/domains` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:36.985096 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa46b00f-0ce6-4bce-b38e-126b688bdc4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:36.985399 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa46b00f-0ce6-4bce-b38e-126b688bdc4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:36.986784 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa46b00f-0ce6-4bce-b38e-126b688bdc4a None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:37.002357 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 277/561] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:15:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:37.002357 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b705a-aae7-4761-b42e-17e5902367f4 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:37.002357 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b705a-aae7-4761-b42e-17e5902367f4 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:37.002357 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b705a-aae7-4761-b42e-17e5902367f4 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:37.002357 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 278/562] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:15:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:15:37.003913 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b705a-aae7-4761-b42e-17e5902367f4 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:37.014253 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244eed4f-8733-42c4-ae0e-35136f059cae None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:37.049960 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d878856-e600-42b9-b189-9c06aaeedd34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:37.050887 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d878856-e600-42b9-b189-9c06aaeedd34 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:37.051355 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d878856-e600-42b9-b189-9c06aaeedd34 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:37.051636 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d878856-e600-42b9-b189-9c06aaeedd34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:37.114681 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b705a-aae7-4761-b42e-17e5902367f4 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:37.123966 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d878856-e600-42b9-b189-9c06aaeedd34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:37.125890 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d878856-e600-42b9-b189-9c06aaeedd34 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:37.149592 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bebbe0f-b746-4e5c-9710-7da7b9e13b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:37.150329 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bebbe0f-b746-4e5c-9710-7da7b9e13b4b None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:37.150625 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bebbe0f-b746-4e5c-9710-7da7b9e13b4b None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:37.150947 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bebbe0f-b746-4e5c-9710-7da7b9e13b4b None admin] PATH_INFO: `/v3/roles/service` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:37.161528 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bebbe0f-b746-4e5c-9710-7da7b9e13b4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:15:37.168488 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-9bebbe0f-b746-4e5c-9710-7da7b9e13b4b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 30 01:15:37.174201 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 279/563] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Mar 30 01:15:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:37.174201 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bebbe0f-b746-4e5c-9710-7da7b9e13b4b None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:37.225519 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 285/564] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Mar 30 01:15:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 30 01:15:37.226951 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc516d7a-1eb1-4b0a-896e-318a4888b253 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:37.227244 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc516d7a-1eb1-4b0a-896e-318a4888b253 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:37.227521 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc516d7a-1eb1-4b0a-896e-318a4888b253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:37.244047 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-cc516d7a-1eb1-4b0a-896e-318a4888b253 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:15:37.245229 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-cc516d7a-1eb1-4b0a-896e-318a4888b253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:15:37.289296 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bebbe0f-b746-4e5c-9710-7da7b9e13b4b None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:37.310337 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 286/565] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:15:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 01:15:37.311229 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc516d7a-1eb1-4b0a-896e-318a4888b253 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:37.323253 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8073d7-ead0-4978-b859-38aafe17110e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:37.324042 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8073d7-ead0-4978-b859-38aafe17110e None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:37.324329 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8073d7-ead0-4978-b859-38aafe17110e None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:37.324608 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8073d7-ead0-4978-b859-38aafe17110e None admin] PATH_INFO: `/v3/projects/service` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:37.331210 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8073d7-ead0-4978-b859-38aafe17110e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:37.333233 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8073d7-ead0-4978-b859-38aafe17110e None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:37.353541 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-8a8073d7-ead0-4978-b859-38aafe17110e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 30 01:15:37.357327 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 280/566] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Mar 30 01:15:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:37.357327 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8073d7-ead0-4978-b859-38aafe17110e None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:37.408269 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc516d7a-1eb1-4b0a-896e-318a4888b253 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:37.443599 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa679378-ab3a-45c1-afa9-a4e201aa3dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:37.444269 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa679378-ab3a-45c1-afa9-a4e201aa3dd2 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:37.444551 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa679378-ab3a-45c1-afa9-a4e201aa3dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:37.444824 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa679378-ab3a-45c1-afa9-a4e201aa3dd2 None admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:37.445563 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa679378-ab3a-45c1-afa9-a4e201aa3dd2 None admin] RBAC: Adding query filter params (name=service) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:37.445897 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa679378-ab3a-45c1-afa9-a4e201aa3dd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:37.447295 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa679378-ab3a-45c1-afa9-a4e201aa3dd2 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:37.455055 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 287/567] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Mar 30 01:15:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:37.456231 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458f138-5925-4b9c-8941-01b9161f2f8f None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:37.457143 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458f138-5925-4b9c-8941-01b9161f2f8f None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:37.457427 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458f138-5925-4b9c-8941-01b9161f2f8f None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:37.462821 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 288/568] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:15:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:15:37.462821 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b458f138-5925-4b9c-8941-01b9161f2f8f None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:37.482859 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8073d7-ead0-4978-b859-38aafe17110e None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:37.515153 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db743e2-9f00-42ca-89fc-0525c4f51f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:37.515950 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db743e2-9f00-42ca-89fc-0525c4f51f26 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:37.516215 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db743e2-9f00-42ca-89fc-0525c4f51f26 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:37.516490 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db743e2-9f00-42ca-89fc-0525c4f51f26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:37.526521 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db743e2-9f00-42ca-89fc-0525c4f51f26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:37.527986 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db743e2-9f00-42ca-89fc-0525c4f51f26 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:37.545453 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-5db743e2-9f00-42ca-89fc-0525c4f51f26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:15:37.546607 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 281/569] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:15:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:37.547387 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db743e2-9f00-42ca-89fc-0525c4f51f26 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:37.559659 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b458f138-5925-4b9c-8941-01b9161f2f8f None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:37.591415 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d03f77-f502-4cbe-8d6d-73ee474feebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:37.592205 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d03f77-f502-4cbe-8d6d-73ee474feebe None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:37.592488 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d03f77-f502-4cbe-8d6d-73ee474feebe None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:37.592761 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d03f77-f502-4cbe-8d6d-73ee474feebe None admin] PATH_INFO: `/v3/roles/service` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:37.602467 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d03f77-f502-4cbe-8d6d-73ee474feebe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:15:37.609312 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-65d03f77-f502-4cbe-8d6d-73ee474feebe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 30 01:15:37.610623 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 289/570] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Mar 30 01:15:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:37.611413 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d03f77-f502-4cbe-8d6d-73ee474feebe None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:37.642122 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db743e2-9f00-42ca-89fc-0525c4f51f26 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:37.677916 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bc4652-1a78-4c08-aefa-c5b346c542eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:37.678493 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc4652-1a78-4c08-aefa-c5b346c542eb None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:37.678798 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc4652-1a78-4c08-aefa-c5b346c542eb None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:37.679073 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc4652-1a78-4c08-aefa-c5b346c542eb None admin] PATH_INFO: `/v3/projects` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:37.679844 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bc4652-1a78-4c08-aefa-c5b346c542eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:37.680148 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bc4652-1a78-4c08-aefa-c5b346c542eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:37.681567 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bc4652-1a78-4c08-aefa-c5b346c542eb None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:37.692782 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 282/571] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Mar 30 01:15:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:37.693789 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382382f9-faa4-4cab-8b97-e05e4cb93730 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:37.694081 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382382f9-faa4-4cab-8b97-e05e4cb93730 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:37.694441 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382382f9-faa4-4cab-8b97-e05e4cb93730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:37.709802 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-382382f9-faa4-4cab-8b97-e05e4cb93730 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:15:37.711008 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-382382f9-faa4-4cab-8b97-e05e4cb93730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:15:37.713423 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d03f77-f502-4cbe-8d6d-73ee474feebe None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:37.749477 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe7e291-e6a0-45ee-bc97-e17a1f533b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:37.750257 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe7e291-e6a0-45ee-bc97-e17a1f533b44 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:37.750534 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe7e291-e6a0-45ee-bc97-e17a1f533b44 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:37.750833 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe7e291-e6a0-45ee-bc97-e17a1f533b44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:37.761557 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe7e291-e6a0-45ee-bc97-e17a1f533b44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:37.763049 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe7e291-e6a0-45ee-bc97-e17a1f533b44 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:37.778250 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 283/572] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:15:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 01:15:37.779484 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382382f9-faa4-4cab-8b97-e05e4cb93730 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:37.787427 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-fbe7e291-e6a0-45ee-bc97-e17a1f533b44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:15:37.793795 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 290/573] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:15:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:37.793795 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe7e291-e6a0-45ee-bc97-e17a1f533b44 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:37.877556 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382382f9-faa4-4cab-8b97-e05e4cb93730 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:37.889323 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe7e291-e6a0-45ee-bc97-e17a1f533b44 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:37.910484 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db2d0f5-575a-4ede-a3f8-3998f82cd394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:37.911170 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db2d0f5-575a-4ede-a3f8-3998f82cd394 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:37.911455 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db2d0f5-575a-4ede-a3f8-3998f82cd394 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:37.911732 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db2d0f5-575a-4ede-a3f8-3998f82cd394 None admin] PATH_INFO: `/v3/domains` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:37.912440 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db2d0f5-575a-4ede-a3f8-3998f82cd394 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:37.912743 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db2d0f5-575a-4ede-a3f8-3998f82cd394 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:37.914097 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db2d0f5-575a-4ede-a3f8-3998f82cd394 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:37.921830 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c9f01-09c2-4391-9284-34eda2e59141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:37.922482 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c9f01-09c2-4391-9284-34eda2e59141 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:37.922802 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c9f01-09c2-4391-9284-34eda2e59141 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:37.923082 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c9f01-09c2-4391-9284-34eda2e59141 None admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:37.923816 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1c9f01-09c2-4391-9284-34eda2e59141 None admin] RBAC: Adding query filter params (name=service) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:37.924120 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1c9f01-09c2-4391-9284-34eda2e59141 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:37.924891 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 284/574] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:15:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:37.925530 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1c9f01-09c2-4391-9284-34eda2e59141 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:37.925908 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db2d0f5-575a-4ede-a3f8-3998f82cd394 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:37.933533 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 291/575] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Mar 30 01:15:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:37.934274 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c9f01-09c2-4391-9284-34eda2e59141 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:38.020913 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db2d0f5-575a-4ede-a3f8-3998f82cd394 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:38.028190 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c9f01-09c2-4391-9284-34eda2e59141 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:38.052885 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd699b4-ba16-400e-a24f-c6d0fe7f3029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:38.053758 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd699b4-ba16-400e-a24f-c6d0fe7f3029 None admin] REQUEST_METHOD: `PUT` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:38.054042 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd699b4-ba16-400e-a24f-c6d0fe7f3029 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:38.054316 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd699b4-ba16-400e-a24f-c6d0fe7f3029 None admin] PATH_INFO: `/v3/projects/0c9a4444228d4be89a4ba8aa53099531/users/140c6d1a20e94192bde06e72040f162d/roles/4121aef9b31c4671aebb65fda1c11185` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:38.059698 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e81f6fb-80c5-4083-a27a-5e3edcccf4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:38.060341 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81f6fb-80c5-4083-a27a-5e3edcccf4c1 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:38.060621 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81f6fb-80c5-4083-a27a-5e3edcccf4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:38.060893 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81f6fb-80c5-4083-a27a-5e3edcccf4c1 None admin] PATH_INFO: `/v3/domains` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:38.061588 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e81f6fb-80c5-4083-a27a-5e3edcccf4c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:38.061887 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e81f6fb-80c5-4083-a27a-5e3edcccf4c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:38.063264 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e81f6fb-80c5-4083-a27a-5e3edcccf4c1 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:38.069760 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd699b4-ba16-400e-a24f-c6d0fe7f3029 None admin] RBAC: Authorizing `identity:create_grant(project_id=0c9a4444228d4be89a4ba8aa53099531, user_id=140c6d1a20e94192bde06e72040f162d, role_id=4121aef9b31c4671aebb65fda1c11185)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:38.071210 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd699b4-ba16-400e-a24f-c6d0fe7f3029 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:38.075545 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 292/576] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:15:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:38.076367 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e81f6fb-80c5-4083-a27a-5e3edcccf4c1 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:38.085554 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 285/577] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Mar 30 01:15:37 2022] PUT /identity/v3/projects/0c9a4444228d4be89a4ba8aa53099531/users/140c6d1a20e94192bde06e72040f162d/roles/4121aef9b31c4671aebb65fda1c11185 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:15:38.086400 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd699b4-ba16-400e-a24f-c6d0fe7f3029 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:38.188759 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e81f6fb-80c5-4083-a27a-5e3edcccf4c1 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:38.201263 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd699b4-ba16-400e-a24f-c6d0fe7f3029 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:38.224914 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514be0ce-9a0c-4fdf-85b8-45a6af3b0f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:38.225720 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514be0ce-9a0c-4fdf-85b8-45a6af3b0f96 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:38.226001 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514be0ce-9a0c-4fdf-85b8-45a6af3b0f96 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:38.226274 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514be0ce-9a0c-4fdf-85b8-45a6af3b0f96 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:38.236895 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514be0ce-9a0c-4fdf-85b8-45a6af3b0f96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:15:38.238528 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3824ed66-1b63-443f-9101-cca021f7d08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:38.239518 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824ed66-1b63-443f-9101-cca021f7d08f None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:38.240104 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824ed66-1b63-443f-9101-cca021f7d08f None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:38.240524 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824ed66-1b63-443f-9101-cca021f7d08f None admin] PATH_INFO: `/v3/projects/service` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:38.244440 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-514be0ce-9a0c-4fdf-85b8-45a6af3b0f96 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 30 01:15:38.245690 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 293/578] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Mar 30 01:15:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:38.246485 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514be0ce-9a0c-4fdf-85b8-45a6af3b0f96 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:38.252071 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3824ed66-1b63-443f-9101-cca021f7d08f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:38.254418 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3824ed66-1b63-443f-9101-cca021f7d08f None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:38.268908 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-3824ed66-1b63-443f-9101-cca021f7d08f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 30 01:15:38.270447 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 286/579] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Mar 30 01:15:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:38.271278 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3824ed66-1b63-443f-9101-cca021f7d08f None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:38.356375 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514be0ce-9a0c-4fdf-85b8-45a6af3b0f96 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:38.372268 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3824ed66-1b63-443f-9101-cca021f7d08f None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:38.392677 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558cfc40-c63a-476e-bca0-10457154d4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:38.393464 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558cfc40-c63a-476e-bca0-10457154d4ef None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:38.393768 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558cfc40-c63a-476e-bca0-10457154d4ef None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:38.394152 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558cfc40-c63a-476e-bca0-10457154d4ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:38.404692 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558cfc40-c63a-476e-bca0-10457154d4ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:38.405918 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab096367-003b-4c56-8348-3944d1384f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:38.406384 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558cfc40-c63a-476e-bca0-10457154d4ef None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:38.406727 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab096367-003b-4c56-8348-3944d1384f37 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:38.407017 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab096367-003b-4c56-8348-3944d1384f37 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:38.407291 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab096367-003b-4c56-8348-3944d1384f37 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:38.416046 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab096367-003b-4c56-8348-3944d1384f37 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:38.417460 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab096367-003b-4c56-8348-3944d1384f37 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:38.424320 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-558cfc40-c63a-476e-bca0-10457154d4ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:15:38.430999 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 294/580] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:15:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:38.430999 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558cfc40-c63a-476e-bca0-10457154d4ef None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:38.432117 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-ab096367-003b-4c56-8348-3944d1384f37 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Mar 30 01:15:38.438028 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 287/581] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Mar 30 01:15:38 2022] GET /identity/v3/users/neutron => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:38.438028 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab096367-003b-4c56-8348-3944d1384f37 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:38.534232 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558cfc40-c63a-476e-bca0-10457154d4ef None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:38.537162 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab096367-003b-4c56-8348-3944d1384f37 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:38.567452 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88bc838-457d-4009-abdb-fbea8da07b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:38.568119 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88bc838-457d-4009-abdb-fbea8da07b76 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:38.568402 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88bc838-457d-4009-abdb-fbea8da07b76 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:38.568679 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88bc838-457d-4009-abdb-fbea8da07b76 None admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:38.568907 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a4546-f157-42d2-86aa-9b6057c44fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:38.569413 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88bc838-457d-4009-abdb-fbea8da07b76 None admin] RBAC: Adding query filter params (name=service) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:38.569573 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a4546-f157-42d2-86aa-9b6057c44fb7 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:38.569724 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88bc838-457d-4009-abdb-fbea8da07b76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:38.569878 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a4546-f157-42d2-86aa-9b6057c44fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:38.570153 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a4546-f157-42d2-86aa-9b6057c44fb7 None admin] PATH_INFO: `/v3/projects` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:38.570952 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8a4546-f157-42d2-86aa-9b6057c44fb7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:38.571137 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88bc838-457d-4009-abdb-fbea8da07b76 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:38.571285 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8a4546-f157-42d2-86aa-9b6057c44fb7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:38.572654 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8a4546-f157-42d2-86aa-9b6057c44fb7 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:38.583507 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 295/582] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Mar 30 01:15:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:38.583507 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88bc838-457d-4009-abdb-fbea8da07b76 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:38.593539 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 288/583] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Mar 30 01:15:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:38.593539 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a4546-f157-42d2-86aa-9b6057c44fb7 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:38.691479 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88bc838-457d-4009-abdb-fbea8da07b76 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:38.692810 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a4546-f157-42d2-86aa-9b6057c44fb7 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:38.726362 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d8335-d336-4d8d-9560-9b6760408321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:38.727537 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d8335-d336-4d8d-9560-9b6760408321 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:38.727759 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa63b5c3-d22e-4ed3-8dee-259f78592b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:38.728011 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d8335-d336-4d8d-9560-9b6760408321 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:38.728412 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63b5c3-d22e-4ed3-8dee-259f78592b56 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:38.728514 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d8335-d336-4d8d-9560-9b6760408321 None admin] PATH_INFO: `/v3/users` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:38.728694 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63b5c3-d22e-4ed3-8dee-259f78592b56 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:38.728968 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63b5c3-d22e-4ed3-8dee-259f78592b56 None admin] PATH_INFO: `/v3/domains` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:38.729680 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa63b5c3-d22e-4ed3-8dee-259f78592b56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:38.729989 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa63b5c3-d22e-4ed3-8dee-259f78592b56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:38.730084 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294d8335-d336-4d8d-9560-9b6760408321 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:38.730522 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294d8335-d336-4d8d-9560-9b6760408321 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:38.731393 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa63b5c3-d22e-4ed3-8dee-259f78592b56 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:38.732151 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294d8335-d336-4d8d-9560-9b6760408321 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:38.748800 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 296/584] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:15:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:38.748800 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa63b5c3-d22e-4ed3-8dee-259f78592b56 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:38.754126 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 289/585] 10.222.0.30 () {56 vars in 1139 bytes} [Wed Mar 30 01:15:38 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:38.754126 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d8335-d336-4d8d-9560-9b6760408321 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:38.847819 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d8335-d336-4d8d-9560-9b6760408321 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:38.853977 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa63b5c3-d22e-4ed3-8dee-259f78592b56 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:38.881832 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c172e3-84b7-4ae3-b91b-50a5a01bcad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:38.882493 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c172e3-84b7-4ae3-b91b-50a5a01bcad7 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:38.882803 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c172e3-84b7-4ae3-b91b-50a5a01bcad7 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:38.883078 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c172e3-84b7-4ae3-b91b-50a5a01bcad7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:38.883900 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c172e3-84b7-4ae3-b91b-50a5a01bcad7 None admin] RBAC: Adding query filter params (role.id=4121aef9b31c4671aebb65fda1c11185, scope.project.id=0c9a4444228d4be89a4ba8aa53099531, user.id=76f16de81dfb4c14b027cd6cd1e6ff2c) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:38.884207 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c172e3-84b7-4ae3-b91b-50a5a01bcad7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:38.885641 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c172e3-84b7-4ae3-b91b-50a5a01bcad7 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:38.890264 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a34af7-10f9-4954-bc3b-352be7b9f7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:38.891049 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 290/586] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Mar 30 01:15:38 2022] GET /identity/v3/role_assignments?user.id=76f16de81dfb4c14b027cd6cd1e6ff2c&scope.project.id=0c9a4444228d4be89a4ba8aa53099531&role.id=4121aef9b31c4671aebb65fda1c11185 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:38.891553 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a34af7-10f9-4954-bc3b-352be7b9f7d4 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:38.891835 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c172e3-84b7-4ae3-b91b-50a5a01bcad7 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:38.892390 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a34af7-10f9-4954-bc3b-352be7b9f7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:38.892853 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a34af7-10f9-4954-bc3b-352be7b9f7d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:38.908735 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a34af7-10f9-4954-bc3b-352be7b9f7d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:38.911503 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a34af7-10f9-4954-bc3b-352be7b9f7d4 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:38.930036 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-c9a34af7-10f9-4954-bc3b-352be7b9f7d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:15:38.936484 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 297/587] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:15:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:38.937773 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a34af7-10f9-4954-bc3b-352be7b9f7d4 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:39.003912 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c172e3-84b7-4ae3-b91b-50a5a01bcad7 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:39.041078 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1816f4fe-2b9a-4d59-a855-6eb478c6080c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:39.041880 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816f4fe-2b9a-4d59-a855-6eb478c6080c None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:39.042166 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816f4fe-2b9a-4d59-a855-6eb478c6080c None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:39.042445 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816f4fe-2b9a-4d59-a855-6eb478c6080c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:39.046185 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a34af7-10f9-4954-bc3b-352be7b9f7d4 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:39.051978 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1816f4fe-2b9a-4d59-a855-6eb478c6080c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:39.053483 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1816f4fe-2b9a-4d59-a855-6eb478c6080c None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:39.071574 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-1816f4fe-2b9a-4d59-a855-6eb478c6080c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Mar 30 01:15:39.077146 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 291/588] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Mar 30 01:15:38 2022] GET /identity/v3/users/cinder => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:39.077146 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1816f4fe-2b9a-4d59-a855-6eb478c6080c None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:39.087561 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0211554-590e-4219-9396-9a2502714996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:39.088353 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0211554-590e-4219-9396-9a2502714996 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:39.088634 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0211554-590e-4219-9396-9a2502714996 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:39.088903 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0211554-590e-4219-9396-9a2502714996 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:39.100758 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0211554-590e-4219-9396-9a2502714996 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:39.102510 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0211554-590e-4219-9396-9a2502714996 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:39.125907 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-b0211554-590e-4219-9396-9a2502714996 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:15:39.132418 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 298/589] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:15:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:39.133279 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0211554-590e-4219-9396-9a2502714996 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:39.191715 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1816f4fe-2b9a-4d59-a855-6eb478c6080c None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:39.227527 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdb9fa2-800c-405f-9447-928e523075c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:39.228997 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdb9fa2-800c-405f-9447-928e523075c7 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:39.229492 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdb9fa2-800c-405f-9447-928e523075c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:39.229962 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdb9fa2-800c-405f-9447-928e523075c7 None admin] PATH_INFO: `/v3/domains` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:39.230908 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdb9fa2-800c-405f-9447-928e523075c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:39.231428 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdb9fa2-800c-405f-9447-928e523075c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:39.232813 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0211554-590e-4219-9396-9a2502714996 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:39.233495 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdb9fa2-800c-405f-9447-928e523075c7 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:39.252391 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 292/590] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:15:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:39.255099 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdb9fa2-800c-405f-9447-928e523075c7 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:39.271046 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8444b16a-d560-472d-8580-aebba11f099e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:39.271804 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8444b16a-d560-472d-8580-aebba11f099e None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:39.272003 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8444b16a-d560-472d-8580-aebba11f099e None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:39.272261 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8444b16a-d560-472d-8580-aebba11f099e None admin] PATH_INFO: `/v3/users` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:39.273089 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8444b16a-d560-472d-8580-aebba11f099e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:39.273637 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8444b16a-d560-472d-8580-aebba11f099e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:39.274852 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8444b16a-d560-472d-8580-aebba11f099e None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:39.297205 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 299/591] 10.222.0.30 () {56 vars in 1137 bytes} [Wed Mar 30 01:15:39 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:39.298108 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8444b16a-d560-472d-8580-aebba11f099e None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:39.367564 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdb9fa2-800c-405f-9447-928e523075c7 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:39.399016 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8444b16a-d560-472d-8580-aebba11f099e None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:39.404301 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cec373-1316-48c3-88ff-60798fea8d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:39.405524 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cec373-1316-48c3-88ff-60798fea8d5c None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:39.406015 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cec373-1316-48c3-88ff-60798fea8d5c None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:39.406492 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cec373-1316-48c3-88ff-60798fea8d5c None admin] PATH_INFO: `/v3/domains` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:39.407442 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cec373-1316-48c3-88ff-60798fea8d5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:39.407955 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cec373-1316-48c3-88ff-60798fea8d5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:39.410028 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cec373-1316-48c3-88ff-60798fea8d5c None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:39.422680 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 293/592] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:15:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:39.423803 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cec373-1316-48c3-88ff-60798fea8d5c None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:39.438837 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb063ac-57bb-4b1c-8fb3-e6923ef94640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:39.439626 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb063ac-57bb-4b1c-8fb3-e6923ef94640 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:39.439906 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb063ac-57bb-4b1c-8fb3-e6923ef94640 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:39.440178 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb063ac-57bb-4b1c-8fb3-e6923ef94640 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:39.448937 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb063ac-57bb-4b1c-8fb3-e6923ef94640 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:39.450302 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb063ac-57bb-4b1c-8fb3-e6923ef94640 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:39.464768 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-ffb063ac-57bb-4b1c-8fb3-e6923ef94640 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Mar 30 01:15:39.466736 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 300/593] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Mar 30 01:15:39 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:39.467115 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb063ac-57bb-4b1c-8fb3-e6923ef94640 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:39.538640 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cec373-1316-48c3-88ff-60798fea8d5c None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:39.570943 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb063ac-57bb-4b1c-8fb3-e6923ef94640 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:39.573921 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f9556c-cf99-45e6-8590-5ebfd6db569f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:39.574845 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f9556c-cf99-45e6-8590-5ebfd6db569f None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:39.575230 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f9556c-cf99-45e6-8590-5ebfd6db569f None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:39.575606 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f9556c-cf99-45e6-8590-5ebfd6db569f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:39.587724 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f9556c-cf99-45e6-8590-5ebfd6db569f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:39.589311 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f9556c-cf99-45e6-8590-5ebfd6db569f None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:39.605399 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb08f15-4209-4252-b867-0091ece288d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:39.606221 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb08f15-4209-4252-b867-0091ece288d9 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:39.606495 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb08f15-4209-4252-b867-0091ece288d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:39.606791 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb08f15-4209-4252-b867-0091ece288d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:39.608096 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-65f9556c-cf99-45e6-8590-5ebfd6db569f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:15:39.614668 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb08f15-4209-4252-b867-0091ece288d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:39.616327 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb08f15-4209-4252-b867-0091ece288d9 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:39.616948 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 294/594] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:15:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:39.617905 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f9556c-cf99-45e6-8590-5ebfd6db569f None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:39.632710 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-ceb08f15-4209-4252-b867-0091ece288d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 30 01:15:39.638664 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 301/595] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Mar 30 01:15:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:39.639646 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb08f15-4209-4252-b867-0091ece288d9 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:39.731932 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f9556c-cf99-45e6-8590-5ebfd6db569f None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:39.750770 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb08f15-4209-4252-b867-0091ece288d9 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:39.778334 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1086ab-8942-4148-8fe0-eab01ecc3cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:39.780114 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1086ab-8942-4148-8fe0-eab01ecc3cc6 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:39.780859 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1086ab-8942-4148-8fe0-eab01ecc3cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:39.781380 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1086ab-8942-4148-8fe0-eab01ecc3cc6 None admin] PATH_INFO: `/v3/users` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:39.782875 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1086ab-8942-4148-8fe0-eab01ecc3cc6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:39.783614 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1086ab-8942-4148-8fe0-eab01ecc3cc6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:39.785800 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1086ab-8942-4148-8fe0-eab01ecc3cc6 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:39.789137 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82429d4-3380-4fcf-9966-83eca8130e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:39.789285 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82429d4-3380-4fcf-9966-83eca8130e8f None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:39.789545 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82429d4-3380-4fcf-9966-83eca8130e8f None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:39.789893 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82429d4-3380-4fcf-9966-83eca8130e8f None admin] PATH_INFO: `/v3/domains` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:39.790678 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82429d4-3380-4fcf-9966-83eca8130e8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:39.791081 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82429d4-3380-4fcf-9966-83eca8130e8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:39.792510 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82429d4-3380-4fcf-9966-83eca8130e8f None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:39.808337 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 295/596] 10.222.0.30 () {56 vars in 1137 bytes} [Wed Mar 30 01:15:39 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:39.809590 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1086ab-8942-4148-8fe0-eab01ecc3cc6 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:39.810870 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 302/597] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:15:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:39.813550 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82429d4-3380-4fcf-9966-83eca8130e8f None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:39.919954 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1086ab-8942-4148-8fe0-eab01ecc3cc6 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:39.939402 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82429d4-3380-4fcf-9966-83eca8130e8f None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:39.959032 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c181e-a74d-4157-a1e3-f46efe34827e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:39.959859 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c181e-a74d-4157-a1e3-f46efe34827e None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:39.960138 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c181e-a74d-4157-a1e3-f46efe34827e None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:39.960504 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c181e-a74d-4157-a1e3-f46efe34827e None admin] PATH_INFO: `/v3/projects` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:39.961376 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37c181e-a74d-4157-a1e3-f46efe34827e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:39.961794 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37c181e-a74d-4157-a1e3-f46efe34827e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:39.963518 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37c181e-a74d-4157-a1e3-f46efe34827e None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:39.981412 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 296/598] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Mar 30 01:15:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:39.981412 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c181e-a74d-4157-a1e3-f46efe34827e None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:39.990853 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d0adac-b2d8-40c2-bb74-3781a9aba2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:39.991880 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d0adac-b2d8-40c2-bb74-3781a9aba2fc None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:39.992693 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d0adac-b2d8-40c2-bb74-3781a9aba2fc None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:39.993119 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d0adac-b2d8-40c2-bb74-3781a9aba2fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:40.006353 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d0adac-b2d8-40c2-bb74-3781a9aba2fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:40.008521 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d0adac-b2d8-40c2-bb74-3781a9aba2fc None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:40.027063 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-18d0adac-b2d8-40c2-bb74-3781a9aba2fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:15:40.028879 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 303/599] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:15:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:40.030082 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d0adac-b2d8-40c2-bb74-3781a9aba2fc None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:40.090734 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c181e-a74d-4157-a1e3-f46efe34827e None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:40.125651 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5196c1-5d29-4471-9728-3bacbd9d178c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:40.126811 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5196c1-5d29-4471-9728-3bacbd9d178c None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:40.127280 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5196c1-5d29-4471-9728-3bacbd9d178c None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:40.127743 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5196c1-5d29-4471-9728-3bacbd9d178c None admin] PATH_INFO: `/v3/projects/service` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:40.136163 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5196c1-5d29-4471-9728-3bacbd9d178c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:40.137834 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5196c1-5d29-4471-9728-3bacbd9d178c None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:40.146361 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d0adac-b2d8-40c2-bb74-3781a9aba2fc None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:40.152004 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-4a5196c1-5d29-4471-9728-3bacbd9d178c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 30 01:15:40.153701 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 297/600] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Mar 30 01:15:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:40.155103 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5196c1-5d29-4471-9728-3bacbd9d178c None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:40.186605 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec70755c-23cf-4278-8f8f-0152395eebc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:40.187456 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec70755c-23cf-4278-8f8f-0152395eebc7 None admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:40.187743 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec70755c-23cf-4278-8f8f-0152395eebc7 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:40.188063 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec70755c-23cf-4278-8f8f-0152395eebc7 None admin] PATH_INFO: `/v3/projects/0c9a4444228d4be89a4ba8aa53099531/users/41745b7f8a804e75b490a0a34977b23b/roles/4121aef9b31c4671aebb65fda1c11185` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:40.204903 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec70755c-23cf-4278-8f8f-0152395eebc7 None admin] RBAC: Authorizing `identity:create_grant(project_id=0c9a4444228d4be89a4ba8aa53099531, user_id=41745b7f8a804e75b490a0a34977b23b, role_id=4121aef9b31c4671aebb65fda1c11185)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:40.206590 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec70755c-23cf-4278-8f8f-0152395eebc7 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:40.226773 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 304/601] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Mar 30 01:15:40 2022] PUT /identity/v3/projects/0c9a4444228d4be89a4ba8aa53099531/users/41745b7f8a804e75b490a0a34977b23b/roles/4121aef9b31c4671aebb65fda1c11185 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:15:40.228104 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec70755c-23cf-4278-8f8f-0152395eebc7 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:40.305691 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5196c1-5d29-4471-9728-3bacbd9d178c None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:40.372060 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcfb6ba-690f-40f7-a476-3ae02b6b69db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:40.376680 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcfb6ba-690f-40f7-a476-3ae02b6b69db None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:40.377272 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcfb6ba-690f-40f7-a476-3ae02b6b69db None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:40.377760 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcfb6ba-690f-40f7-a476-3ae02b6b69db None admin] PATH_INFO: `/v3/domains` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:40.378885 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcfb6ba-690f-40f7-a476-3ae02b6b69db None admin] RBAC: Adding query filter params (name=Default) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:40.379544 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcfb6ba-690f-40f7-a476-3ae02b6b69db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:40.381146 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcfb6ba-690f-40f7-a476-3ae02b6b69db None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:40.411206 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 298/602] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:15:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:40.417574 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcfb6ba-690f-40f7-a476-3ae02b6b69db None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:40.444619 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec70755c-23cf-4278-8f8f-0152395eebc7 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:40.487177 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a244896-7f6c-4091-8011-bb7412a76b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:40.488626 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a244896-7f6c-4091-8011-bb7412a76b0e None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:40.489141 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a244896-7f6c-4091-8011-bb7412a76b0e None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:40.489616 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a244896-7f6c-4091-8011-bb7412a76b0e None admin] PATH_INFO: `/v3/projects` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:40.490774 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a244896-7f6c-4091-8011-bb7412a76b0e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:40.491349 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a244896-7f6c-4091-8011-bb7412a76b0e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:40.492837 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a244896-7f6c-4091-8011-bb7412a76b0e None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:40.506966 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 305/603] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Mar 30 01:15:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:40.508265 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d406a69-8e2b-41ea-909f-88bc4f850a6b None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:40.508608 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d406a69-8e2b-41ea-909f-88bc4f850a6b None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:40.508882 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d406a69-8e2b-41ea-909f-88bc4f850a6b None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:40.510807 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 306/604] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:15:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:15:40.513622 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d406a69-8e2b-41ea-909f-88bc4f850a6b None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:40.553822 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcfb6ba-690f-40f7-a476-3ae02b6b69db None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:40.604701 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e50fd8-23d9-4187-8053-5276e0069890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:40.606095 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e50fd8-23d9-4187-8053-5276e0069890 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:40.606382 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e50fd8-23d9-4187-8053-5276e0069890 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:40.606659 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e50fd8-23d9-4187-8053-5276e0069890 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:40.615363 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e50fd8-23d9-4187-8053-5276e0069890 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:40.616802 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e50fd8-23d9-4187-8053-5276e0069890 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:40.628047 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d406a69-8e2b-41ea-909f-88bc4f850a6b None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:40.637490 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-29e50fd8-23d9-4187-8053-5276e0069890 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 30 01:15:40.639590 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 299/605] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Mar 30 01:15:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 01:15:40.641303 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18dc9c9-7fb4-4c1d-9368-a9c5fba9b242 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:40.641741 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18dc9c9-7fb4-4c1d-9368-a9c5fba9b242 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:40.642151 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18dc9c9-7fb4-4c1d-9368-a9c5fba9b242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:40.670904 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-b18dc9c9-7fb4-4c1d-9368-a9c5fba9b242 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:15:40.672324 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-b18dc9c9-7fb4-4c1d-9368-a9c5fba9b242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:15:40.674251 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f3b731-7c21-4096-8660-f426a236c03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:40.675244 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f3b731-7c21-4096-8660-f426a236c03f None admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:40.676350 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f3b731-7c21-4096-8660-f426a236c03f None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:40.676548 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f3b731-7c21-4096-8660-f426a236c03f None admin] PATH_INFO: `/v3/projects/0c9a4444228d4be89a4ba8aa53099531/users/45219f386f0147b6bd380efe4ab62812/roles/4121aef9b31c4671aebb65fda1c11185` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:40.693044 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f3b731-7c21-4096-8660-f426a236c03f None admin] RBAC: Authorizing `identity:create_grant(project_id=0c9a4444228d4be89a4ba8aa53099531, user_id=45219f386f0147b6bd380efe4ab62812, role_id=4121aef9b31c4671aebb65fda1c11185)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:40.694494 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f3b731-7c21-4096-8660-f426a236c03f None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:40.713458 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 307/606] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Mar 30 01:15:40 2022] PUT /identity/v3/projects/0c9a4444228d4be89a4ba8aa53099531/users/45219f386f0147b6bd380efe4ab62812/roles/4121aef9b31c4671aebb65fda1c11185 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:15:40.715385 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f3b731-7c21-4096-8660-f426a236c03f None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:40.801805 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 300/607] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:15:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 01:15:40.841738 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18dc9c9-7fb4-4c1d-9368-a9c5fba9b242 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:40.863318 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f3b731-7c21-4096-8660-f426a236c03f None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:40.912229 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50566796-b1de-4459-bc6b-bde576e8cbc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:40.913224 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50566796-b1de-4459-bc6b-bde576e8cbc1 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:40.913660 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50566796-b1de-4459-bc6b-bde576e8cbc1 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:40.914083 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50566796-b1de-4459-bc6b-bde576e8cbc1 None admin] PATH_INFO: `/v3/projects` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:40.915060 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50566796-b1de-4459-bc6b-bde576e8cbc1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:40.915536 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50566796-b1de-4459-bc6b-bde576e8cbc1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:40.917187 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50566796-b1de-4459-bc6b-bde576e8cbc1 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:40.946202 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 308/608] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Mar 30 01:15:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:40.952059 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50566796-b1de-4459-bc6b-bde576e8cbc1 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:40.998589 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18dc9c9-7fb4-4c1d-9368-a9c5fba9b242 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:41.039045 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a77ec-6352-48e4-b22d-dcf72863d1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:41.039848 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a77ec-6352-48e4-b22d-dcf72863d1ba None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:41.040129 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a77ec-6352-48e4-b22d-dcf72863d1ba None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:41.040402 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a77ec-6352-48e4-b22d-dcf72863d1ba None admin] PATH_INFO: `/v3/roles/service` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:41.051495 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914a77ec-6352-48e4-b22d-dcf72863d1ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:15:41.058624 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-914a77ec-6352-48e4-b22d-dcf72863d1ba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 30 01:15:41.060175 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 301/609] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Mar 30 01:15:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 01:15:41.065844 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a77ec-6352-48e4-b22d-dcf72863d1ba None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:41.070502 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50566796-b1de-4459-bc6b-bde576e8cbc1 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:41.112315 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99daa594-286f-47be-be74-a957dd8f37f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:41.113248 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99daa594-286f-47be-be74-a957dd8f37f1 None admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:41.113532 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99daa594-286f-47be-be74-a957dd8f37f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:41.113808 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99daa594-286f-47be-be74-a957dd8f37f1 None admin] PATH_INFO: `/v3/projects/0c9a4444228d4be89a4ba8aa53099531/users/ebf28c0ec3d94fb99bcd573dd8dd0e30/roles/4121aef9b31c4671aebb65fda1c11185` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:41.130954 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99daa594-286f-47be-be74-a957dd8f37f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=0c9a4444228d4be89a4ba8aa53099531, user_id=ebf28c0ec3d94fb99bcd573dd8dd0e30, role_id=4121aef9b31c4671aebb65fda1c11185)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:41.132471 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99daa594-286f-47be-be74-a957dd8f37f1 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:41.146413 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 309/610] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Mar 30 01:15:40 2022] PUT /identity/v3/projects/0c9a4444228d4be89a4ba8aa53099531/users/ebf28c0ec3d94fb99bcd573dd8dd0e30/roles/4121aef9b31c4671aebb65fda1c11185 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:15:41.173867 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a77ec-6352-48e4-b22d-dcf72863d1ba None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:41.212631 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf7f3f6-c231-4aab-97f7-2f0a54cbf412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:41.213308 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf7f3f6-c231-4aab-97f7-2f0a54cbf412 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:41.213591 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf7f3f6-c231-4aab-97f7-2f0a54cbf412 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:41.213869 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf7f3f6-c231-4aab-97f7-2f0a54cbf412 None admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:41.214628 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf7f3f6-c231-4aab-97f7-2f0a54cbf412 None admin] RBAC: Adding query filter params (name=service) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:41.214967 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf7f3f6-c231-4aab-97f7-2f0a54cbf412 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:41.216339 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf7f3f6-c231-4aab-97f7-2f0a54cbf412 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:41.227043 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 302/611] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Mar 30 01:15:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:41.232883 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99daa594-286f-47be-be74-a957dd8f37f1 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:41.348225 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029096a-f9c9-4309-a00b-0c825cc2f891 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:41.348769 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029096a-f9c9-4309-a00b-0c825cc2f891 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:41.348769 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029096a-f9c9-4309-a00b-0c825cc2f891 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:41.350925 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 303/612] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:15:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:15:41.356648 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d7ebb-e27c-450e-9ef1-f66a4aee76fc None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:41.356972 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d7ebb-e27c-450e-9ef1-f66a4aee76fc None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:41.357210 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d7ebb-e27c-450e-9ef1-f66a4aee76fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:41.379625 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99daa594-286f-47be-be74-a957dd8f37f1 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:41.405839 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-6f0d7ebb-e27c-450e-9ef1-f66a4aee76fc None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:15:41.407094 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-6f0d7ebb-e27c-450e-9ef1-f66a4aee76fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:15:41.418331 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcbce10-ccb4-4711-867a-f48cfea3e9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:41.419177 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcbce10-ccb4-4711-867a-f48cfea3e9e4 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:41.419463 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcbce10-ccb4-4711-867a-f48cfea3e9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:41.419732 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcbce10-ccb4-4711-867a-f48cfea3e9e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:41.432934 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcbce10-ccb4-4711-867a-f48cfea3e9e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:41.434408 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcbce10-ccb4-4711-867a-f48cfea3e9e4 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:41.456398 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-fdcbce10-ccb4-4711-867a-f48cfea3e9e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:15:41.458018 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 310/613] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:15:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:41.463375 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcbce10-ccb4-4711-867a-f48cfea3e9e4 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:41.521213 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 304/614] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:15:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 30 01:15:41.587717 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0d7ebb-e27c-450e-9ef1-f66a4aee76fc None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:41.599983 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcbce10-ccb4-4711-867a-f48cfea3e9e4 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:41.665038 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3470b91-4062-49f0-ae80-4fb9a8c32f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:41.665761 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3470b91-4062-49f0-ae80-4fb9a8c32f06 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:41.666049 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3470b91-4062-49f0-ae80-4fb9a8c32f06 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:41.666333 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3470b91-4062-49f0-ae80-4fb9a8c32f06 None admin] PATH_INFO: `/v3/domains` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:41.667086 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3470b91-4062-49f0-ae80-4fb9a8c32f06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:41.667392 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3470b91-4062-49f0-ae80-4fb9a8c32f06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:41.668765 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3470b91-4062-49f0-ae80-4fb9a8c32f06 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:41.693775 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 311/615] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:15:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:15:41.699441 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3470b91-4062-49f0-ae80-4fb9a8c32f06 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:41.772554 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0d7ebb-e27c-450e-9ef1-f66a4aee76fc None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:41.832360 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b861ca-308a-4267-b80e-9e3a183618a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:41.833157 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b861ca-308a-4267-b80e-9e3a183618a0 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:41.833439 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b861ca-308a-4267-b80e-9e3a183618a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:41.833712 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b861ca-308a-4267-b80e-9e3a183618a0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:41.851591 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b861ca-308a-4267-b80e-9e3a183618a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:15:41.858382 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-31b861ca-308a-4267-b80e-9e3a183618a0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 30 01:15:41.860571 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 305/616] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Mar 30 01:15:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 01:15:41.866264 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b861ca-308a-4267-b80e-9e3a183618a0 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:41.869019 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3470b91-4062-49f0-ae80-4fb9a8c32f06 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:41.936240 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e755e-3374-46b3-906c-5c8b4d200f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:41.937451 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e755e-3374-46b3-906c-5c8b4d200f2b None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:41.937984 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e755e-3374-46b3-906c-5c8b4d200f2b None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:41.938511 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e755e-3374-46b3-906c-5c8b4d200f2b None admin] PATH_INFO: `/v3/users/nova` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:41.951430 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389e755e-3374-46b3-906c-5c8b4d200f2b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:41.953489 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389e755e-3374-46b3-906c-5c8b4d200f2b None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:41.978404 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-389e755e-3374-46b3-906c-5c8b4d200f2b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 30 01:15:41.981126 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 312/617] 10.222.0.30 () {56 vars in 1093 bytes} [Wed Mar 30 01:15:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 01:15:41.987140 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e755e-3374-46b3-906c-5c8b4d200f2b None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:42.029113 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b861ca-308a-4267-b80e-9e3a183618a0 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:42.064566 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6003838b-9c68-4e01-909d-4240862a1481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:42.065647 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6003838b-9c68-4e01-909d-4240862a1481 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:42.066153 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6003838b-9c68-4e01-909d-4240862a1481 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:42.066647 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6003838b-9c68-4e01-909d-4240862a1481 None admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:42.067649 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6003838b-9c68-4e01-909d-4240862a1481 None admin] RBAC: Adding query filter params (name=service) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:42.068153 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6003838b-9c68-4e01-909d-4240862a1481 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:42.069738 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6003838b-9c68-4e01-909d-4240862a1481 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:42.078989 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 306/618] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Mar 30 01:15:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:42.085480 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6003838b-9c68-4e01-909d-4240862a1481 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:42.162516 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e755e-3374-46b3-906c-5c8b4d200f2b None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:42.227175 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb9f9d2-fd0b-4bae-81d8-3831ce289adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:42.227870 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb9f9d2-fd0b-4bae-81d8-3831ce289adb None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:42.228155 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb9f9d2-fd0b-4bae-81d8-3831ce289adb None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:42.228437 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb9f9d2-fd0b-4bae-81d8-3831ce289adb None admin] PATH_INFO: `/v3/users` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:42.229303 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb9f9d2-fd0b-4bae-81d8-3831ce289adb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:42.230562 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb9f9d2-fd0b-4bae-81d8-3831ce289adb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:42.232085 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb9f9d2-fd0b-4bae-81d8-3831ce289adb None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:42.262263 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 313/619] 10.222.0.30 () {56 vars in 1133 bytes} [Wed Mar 30 01:15:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:42.265155 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb9f9d2-fd0b-4bae-81d8-3831ce289adb None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:42.291182 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6003838b-9c68-4e01-909d-4240862a1481 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:42.350014 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a2051c-27a8-4275-b0cd-74475025bd5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:42.350838 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2051c-27a8-4275-b0cd-74475025bd5f None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:42.351124 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2051c-27a8-4275-b0cd-74475025bd5f None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:42.351398 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2051c-27a8-4275-b0cd-74475025bd5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:42.369192 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a2051c-27a8-4275-b0cd-74475025bd5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:42.370647 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a2051c-27a8-4275-b0cd-74475025bd5f None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:42.399734 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-c4a2051c-27a8-4275-b0cd-74475025bd5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:15:42.401352 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 307/620] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:15:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 01:15:42.407278 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a2051c-27a8-4275-b0cd-74475025bd5f None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:42.460777 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb9f9d2-fd0b-4bae-81d8-3831ce289adb None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:42.511202 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a2051c-27a8-4275-b0cd-74475025bd5f None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:42.528169 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d445d58-647d-44d7-87a2-79f52d92421f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:42.529168 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d445d58-647d-44d7-87a2-79f52d92421f None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:42.529675 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d445d58-647d-44d7-87a2-79f52d92421f None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:42.530395 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d445d58-647d-44d7-87a2-79f52d92421f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:42.548312 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc1e6e6-a38a-4308-9365-1a05b129016a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:42.548985 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1e6e6-a38a-4308-9365-1a05b129016a None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:42.549266 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1e6e6-a38a-4308-9365-1a05b129016a None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:42.549546 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1e6e6-a38a-4308-9365-1a05b129016a None admin] PATH_INFO: `/v3/domains` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:42.550308 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc1e6e6-a38a-4308-9365-1a05b129016a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:42.550618 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc1e6e6-a38a-4308-9365-1a05b129016a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:42.553744 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc1e6e6-a38a-4308-9365-1a05b129016a None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:42.564824 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 308/621] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:15:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:15:42.570464 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc1e6e6-a38a-4308-9365-1a05b129016a None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:42.662860 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d445d58-647d-44d7-87a2-79f52d92421f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:42.665046 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d445d58-647d-44d7-87a2-79f52d92421f None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:42.673547 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc1e6e6-a38a-4308-9365-1a05b129016a None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:42.740671 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba71edb-3bdd-4994-a3b5-5e91f0c2b03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:42.741389 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba71edb-3bdd-4994-a3b5-5e91f0c2b03e None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:42.741671 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba71edb-3bdd-4994-a3b5-5e91f0c2b03e None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:42.741946 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba71edb-3bdd-4994-a3b5-5e91f0c2b03e None admin] PATH_INFO: `/v3/users/swift` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:42.752556 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba71edb-3bdd-4994-a3b5-5e91f0c2b03e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:42.754060 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba71edb-3bdd-4994-a3b5-5e91f0c2b03e None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:42.776932 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-0ba71edb-3bdd-4994-a3b5-5e91f0c2b03e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 30 01:15:42.778432 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 309/622] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Mar 30 01:15:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 01:15:42.784047 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba71edb-3bdd-4994-a3b5-5e91f0c2b03e None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:42.863530 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 314/623] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Mar 30 01:15:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 599 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 30 01:15:42.865975 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4529b466-90ff-43b3-a1ac-22de3ef26d66 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:42.866253 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4529b466-90ff-43b3-a1ac-22de3ef26d66 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:42.866527 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4529b466-90ff-43b3-a1ac-22de3ef26d66 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:42.868363 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 315/624] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:15:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:15:42.875671 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4529b466-90ff-43b3-a1ac-22de3ef26d66 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:42.888054 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba71edb-3bdd-4994-a3b5-5e91f0c2b03e None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:42.923390 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eb4a65-c831-4ea3-b1b1-b52864e0d049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:42.924299 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb4a65-c831-4ea3-b1b1-b52864e0d049 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:42.924723 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb4a65-c831-4ea3-b1b1-b52864e0d049 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:42.925194 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb4a65-c831-4ea3-b1b1-b52864e0d049 None admin] PATH_INFO: `/v3/users` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:42.926464 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eb4a65-c831-4ea3-b1b1-b52864e0d049 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:42.927003 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eb4a65-c831-4ea3-b1b1-b52864e0d049 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:42.928635 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eb4a65-c831-4ea3-b1b1-b52864e0d049 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:42.947702 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 310/625] 10.222.0.30 () {56 vars in 1135 bytes} [Wed Mar 30 01:15:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:42.949425 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd920938-8817-448a-8f77-a2a5d670163b None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:42.949947 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd920938-8817-448a-8f77-a2a5d670163b None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:42.950420 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd920938-8817-448a-8f77-a2a5d670163b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:42.974906 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-bd920938-8817-448a-8f77-a2a5d670163b None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:15:42.976991 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-bd920938-8817-448a-8f77-a2a5d670163b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:15:42.979087 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4529b466-90ff-43b3-a1ac-22de3ef26d66 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:43.014042 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198f6b8c-ffe5-4cc2-ad10-7f4955b6fcbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:43.014691 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f6b8c-ffe5-4cc2-ad10-7f4955b6fcbe None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:43.015007 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f6b8c-ffe5-4cc2-ad10-7f4955b6fcbe None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:43.015276 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f6b8c-ffe5-4cc2-ad10-7f4955b6fcbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:43.025596 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198f6b8c-ffe5-4cc2-ad10-7f4955b6fcbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:43.027127 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198f6b8c-ffe5-4cc2-ad10-7f4955b6fcbe None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:43.045021 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-198f6b8c-ffe5-4cc2-ad10-7f4955b6fcbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:15:43.050914 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 316/626] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:15:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:43.051845 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198f6b8c-ffe5-4cc2-ad10-7f4955b6fcbe None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:43.071364 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 311/627] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:15:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 01:15:43.073990 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd920938-8817-448a-8f77-a2a5d670163b None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:43.181357 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198f6b8c-ffe5-4cc2-ad10-7f4955b6fcbe None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:43.191206 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd920938-8817-448a-8f77-a2a5d670163b None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:43.223617 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beaf6cc-7e33-49c8-8871-ce0112f5b305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:43.224993 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beaf6cc-7e33-49c8-8871-ce0112f5b305 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:43.225283 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beaf6cc-7e33-49c8-8871-ce0112f5b305 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:43.225564 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beaf6cc-7e33-49c8-8871-ce0112f5b305 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:43.231883 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2225a262-8a79-4a7a-aff9-d2b9a323d6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:43.232619 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2225a262-8a79-4a7a-aff9-d2b9a323d6d2 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:43.233382 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2225a262-8a79-4a7a-aff9-d2b9a323d6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:43.233736 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2225a262-8a79-4a7a-aff9-d2b9a323d6d2 None admin] PATH_INFO: `/v3/domains` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:43.234950 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2225a262-8a79-4a7a-aff9-d2b9a323d6d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:43.235332 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2225a262-8a79-4a7a-aff9-d2b9a323d6d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:43.236556 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beaf6cc-7e33-49c8-8871-ce0112f5b305 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:43.237109 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2225a262-8a79-4a7a-aff9-d2b9a323d6d2 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:43.238603 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beaf6cc-7e33-49c8-8871-ce0112f5b305 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:43.251454 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 312/628] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:15:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:43.252370 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2225a262-8a79-4a7a-aff9-d2b9a323d6d2 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:43.258635 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-5beaf6cc-7e33-49c8-8871-ce0112f5b305 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:15:43.262795 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 317/629] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:15:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:43.263629 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beaf6cc-7e33-49c8-8871-ce0112f5b305 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:43.362302 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2225a262-8a79-4a7a-aff9-d2b9a323d6d2 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:43.390889 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beaf6cc-7e33-49c8-8871-ce0112f5b305 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:43.397460 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e566ac3d-87f9-4d58-baee-114db68413cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:43.398262 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566ac3d-87f9-4d58-baee-114db68413cf None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:43.398544 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566ac3d-87f9-4d58-baee-114db68413cf None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:43.398853 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566ac3d-87f9-4d58-baee-114db68413cf None admin] PATH_INFO: `/v3/roles/service` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:43.410312 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e566ac3d-87f9-4d58-baee-114db68413cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:15:43.417325 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-e566ac3d-87f9-4d58-baee-114db68413cf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 30 01:15:43.418847 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 313/630] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Mar 30 01:15:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:43.419632 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e566ac3d-87f9-4d58-baee-114db68413cf None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:43.431142 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21c2123-a8d2-4ece-ac13-c4c732c070db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:43.432527 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c2123-a8d2-4ece-ac13-c4c732c070db None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:43.432645 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c2123-a8d2-4ece-ac13-c4c732c070db None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:43.432914 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c2123-a8d2-4ece-ac13-c4c732c070db None admin] PATH_INFO: `/v3/projects/service` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:43.441038 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21c2123-a8d2-4ece-ac13-c4c732c070db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:43.442500 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21c2123-a8d2-4ece-ac13-c4c732c070db None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:43.455375 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-d21c2123-a8d2-4ece-ac13-c4c732c070db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 30 01:15:43.457323 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 318/631] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Mar 30 01:15:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:43.458153 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21c2123-a8d2-4ece-ac13-c4c732c070db None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:43.526242 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e566ac3d-87f9-4d58-baee-114db68413cf None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:43.560136 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21c2123-a8d2-4ece-ac13-c4c732c070db None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:43.560661 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88c37ae-cc20-4a76-82d5-46ea4f9e6f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:43.560906 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c37ae-cc20-4a76-82d5-46ea4f9e6f6a None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:43.561062 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c37ae-cc20-4a76-82d5-46ea4f9e6f6a None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:43.561329 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c37ae-cc20-4a76-82d5-46ea4f9e6f6a None admin] PATH_INFO: `/v3/domains` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:43.562038 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88c37ae-cc20-4a76-82d5-46ea4f9e6f6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:43.562344 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88c37ae-cc20-4a76-82d5-46ea4f9e6f6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:43.563734 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88c37ae-cc20-4a76-82d5-46ea4f9e6f6a None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:43.576427 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 314/632] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:15:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:43.577773 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318dcb5-7fc7-4f4d-9115-0b9b807c0904 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:43.578062 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318dcb5-7fc7-4f4d-9115-0b9b807c0904 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:43.578335 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318dcb5-7fc7-4f4d-9115-0b9b807c0904 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:43.584173 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 315/633] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:15:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:15:43.585013 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0318dcb5-7fc7-4f4d-9115-0b9b807c0904 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:43.596467 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdd6fcf-3c3d-4ed3-95e9-d37969546024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:43.597407 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd6fcf-3c3d-4ed3-95e9-d37969546024 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:43.597734 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd6fcf-3c3d-4ed3-95e9-d37969546024 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:43.597983 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd6fcf-3c3d-4ed3-95e9-d37969546024 None admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:43.598792 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdd6fcf-3c3d-4ed3-95e9-d37969546024 None admin] RBAC: Adding query filter params (name=service) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:43.599107 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdd6fcf-3c3d-4ed3-95e9-d37969546024 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:43.600571 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdd6fcf-3c3d-4ed3-95e9-d37969546024 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:43.609642 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 319/634] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Mar 30 01:15:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:43.610420 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdd6fcf-3c3d-4ed3-95e9-d37969546024 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:43.699324 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0318dcb5-7fc7-4f4d-9115-0b9b807c0904 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:43.712500 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdd6fcf-3c3d-4ed3-95e9-d37969546024 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:43.734140 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1401b39d-032b-4aed-86ff-a90d128f5417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:43.734840 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401b39d-032b-4aed-86ff-a90d128f5417 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:43.735131 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401b39d-032b-4aed-86ff-a90d128f5417 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:43.735407 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401b39d-032b-4aed-86ff-a90d128f5417 None admin] PATH_INFO: `/v3/projects` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:43.736182 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1401b39d-032b-4aed-86ff-a90d128f5417 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:43.736491 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1401b39d-032b-4aed-86ff-a90d128f5417 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:43.738312 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1401b39d-032b-4aed-86ff-a90d128f5417 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:43.747874 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78835ff0-9c95-4572-8883-df9fff0afc16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:43.748656 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78835ff0-9c95-4572-8883-df9fff0afc16 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:43.748939 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78835ff0-9c95-4572-8883-df9fff0afc16 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:43.749213 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78835ff0-9c95-4572-8883-df9fff0afc16 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:43.754998 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 316/635] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Mar 30 01:15:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:43.754998 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48856fbf-a783-41c2-98eb-597e55016042 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:43.754998 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48856fbf-a783-41c2-98eb-597e55016042 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:43.754998 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48856fbf-a783-41c2-98eb-597e55016042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:43.761702 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78835ff0-9c95-4572-8883-df9fff0afc16 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:43.763169 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78835ff0-9c95-4572-8883-df9fff0afc16 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:43.770138 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-48856fbf-a783-41c2-98eb-597e55016042 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:15:43.771344 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-48856fbf-a783-41c2-98eb-597e55016042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:15:43.776407 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-78835ff0-9c95-4572-8883-df9fff0afc16 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 30 01:15:43.782421 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 320/636] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Mar 30 01:15:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:43.782421 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78835ff0-9c95-4572-8883-df9fff0afc16 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:43.847251 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 317/637] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:15:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 01:15:43.847251 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48856fbf-a783-41c2-98eb-597e55016042 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:43.889037 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78835ff0-9c95-4572-8883-df9fff0afc16 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:43.921793 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d951183e-6ff0-446d-b5e4-5e58a11f8c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:43.922840 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951183e-6ff0-446d-b5e4-5e58a11f8c79 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:43.923259 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951183e-6ff0-446d-b5e4-5e58a11f8c79 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:43.923696 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951183e-6ff0-446d-b5e4-5e58a11f8c79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:43.934552 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d951183e-6ff0-446d-b5e4-5e58a11f8c79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:43.936213 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d951183e-6ff0-446d-b5e4-5e58a11f8c79 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:43.943322 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48856fbf-a783-41c2-98eb-597e55016042 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:43.953028 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-d951183e-6ff0-446d-b5e4-5e58a11f8c79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:15:43.958971 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 321/638] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:15:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:43.959732 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d951183e-6ff0-446d-b5e4-5e58a11f8c79 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:43.977838 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ad2ccb-3e04-4d30-b19e-96f922127cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:43.978497 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad2ccb-3e04-4d30-b19e-96f922127cbb None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:43.978814 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad2ccb-3e04-4d30-b19e-96f922127cbb None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:43.979089 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad2ccb-3e04-4d30-b19e-96f922127cbb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:43.979912 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ad2ccb-3e04-4d30-b19e-96f922127cbb None admin] RBAC: Adding query filter params (role.id=4121aef9b31c4671aebb65fda1c11185, scope.project.id=0c9a4444228d4be89a4ba8aa53099531, user.id=140c6d1a20e94192bde06e72040f162d) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:43.980221 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ad2ccb-3e04-4d30-b19e-96f922127cbb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:43.981656 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ad2ccb-3e04-4d30-b19e-96f922127cbb None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:43.988022 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 318/639] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Mar 30 01:15:43 2022] GET /identity/v3/role_assignments?user.id=140c6d1a20e94192bde06e72040f162d&scope.project.id=0c9a4444228d4be89a4ba8aa53099531&role.id=4121aef9b31c4671aebb65fda1c11185 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:43.988738 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ad2ccb-3e04-4d30-b19e-96f922127cbb None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:44.062774 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d951183e-6ff0-446d-b5e4-5e58a11f8c79 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:44.098465 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ad2ccb-3e04-4d30-b19e-96f922127cbb None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:44.102014 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60185bc2-e5e6-49b8-a910-4f05db6d10a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:44.102692 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60185bc2-e5e6-49b8-a910-4f05db6d10a1 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:44.103003 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60185bc2-e5e6-49b8-a910-4f05db6d10a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:44.103279 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60185bc2-e5e6-49b8-a910-4f05db6d10a1 None admin] PATH_INFO: `/v3/projects` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:44.104081 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60185bc2-e5e6-49b8-a910-4f05db6d10a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:44.104390 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60185bc2-e5e6-49b8-a910-4f05db6d10a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:44.105852 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60185bc2-e5e6-49b8-a910-4f05db6d10a1 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:44.125472 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 322/640] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Mar 30 01:15:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:44.125472 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60185bc2-e5e6-49b8-a910-4f05db6d10a1 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:44.135390 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbdd4d0-1c0a-45ea-bf35-a74344672d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:44.136190 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbdd4d0-1c0a-45ea-bf35-a74344672d95 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:44.136473 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbdd4d0-1c0a-45ea-bf35-a74344672d95 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:44.136743 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbdd4d0-1c0a-45ea-bf35-a74344672d95 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:44.148091 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbdd4d0-1c0a-45ea-bf35-a74344672d95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:15:44.155386 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-0dbdd4d0-1c0a-45ea-bf35-a74344672d95 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 30 01:15:44.162975 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 319/641] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Mar 30 01:15:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:44.162975 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33442b3-a32e-4c46-95bb-523a412bdb68 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:44.162975 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33442b3-a32e-4c46-95bb-523a412bdb68 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:44.162975 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33442b3-a32e-4c46-95bb-523a412bdb68 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:44.162975 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 320/642] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:15:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:15:44.162975 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33442b3-a32e-4c46-95bb-523a412bdb68 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:44.232949 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60185bc2-e5e6-49b8-a910-4f05db6d10a1 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:44.265993 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67333df-aa80-49f7-b5a0-bca2ff9bfd2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:44.266682 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67333df-aa80-49f7-b5a0-bca2ff9bfd2a None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:44.266994 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67333df-aa80-49f7-b5a0-bca2ff9bfd2a None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:44.267091 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33442b3-a32e-4c46-95bb-523a412bdb68 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:44.267268 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67333df-aa80-49f7-b5a0-bca2ff9bfd2a None admin] PATH_INFO: `/v3/domains` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:44.267978 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67333df-aa80-49f7-b5a0-bca2ff9bfd2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:44.268279 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67333df-aa80-49f7-b5a0-bca2ff9bfd2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:44.270434 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67333df-aa80-49f7-b5a0-bca2ff9bfd2a None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:44.282199 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 323/643] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:15:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:44.283616 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f98b2d-09cf-410b-86f8-86c1abaa4745 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:44.283909 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f98b2d-09cf-410b-86f8-86c1abaa4745 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:44.284184 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f98b2d-09cf-410b-86f8-86c1abaa4745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:44.302847 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3661be84-845f-45cf-a0a4-4cdb73152436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:44.303339 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-69f98b2d-09cf-410b-86f8-86c1abaa4745 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:15:44.303729 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3661be84-845f-45cf-a0a4-4cdb73152436 None admin] REQUEST_METHOD: `PUT` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:44.304009 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3661be84-845f-45cf-a0a4-4cdb73152436 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:44.304277 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3661be84-845f-45cf-a0a4-4cdb73152436 None admin] PATH_INFO: `/v3/projects/0c9a4444228d4be89a4ba8aa53099531/users/76f16de81dfb4c14b027cd6cd1e6ff2c/roles/4121aef9b31c4671aebb65fda1c11185` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:44.304533 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-69f98b2d-09cf-410b-86f8-86c1abaa4745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:15:44.320660 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3661be84-845f-45cf-a0a4-4cdb73152436 None admin] RBAC: Authorizing `identity:create_grant(project_id=0c9a4444228d4be89a4ba8aa53099531, user_id=76f16de81dfb4c14b027cd6cd1e6ff2c, role_id=4121aef9b31c4671aebb65fda1c11185)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:44.322091 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3661be84-845f-45cf-a0a4-4cdb73152436 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:44.343078 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 321/644] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Mar 30 01:15:44 2022] PUT /identity/v3/projects/0c9a4444228d4be89a4ba8aa53099531/users/76f16de81dfb4c14b027cd6cd1e6ff2c/roles/4121aef9b31c4671aebb65fda1c11185 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:15:44.343078 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3661be84-845f-45cf-a0a4-4cdb73152436 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:44.383701 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 324/645] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:15:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 01:15:44.384649 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f98b2d-09cf-410b-86f8-86c1abaa4745 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:44.477939 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3661be84-845f-45cf-a0a4-4cdb73152436 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:44.491683 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f98b2d-09cf-410b-86f8-86c1abaa4745 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:44.514780 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19712e02-1e6b-41bb-bff7-5f6fc9f54ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:44.515459 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19712e02-1e6b-41bb-bff7-5f6fc9f54ac4 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:44.515740 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19712e02-1e6b-41bb-bff7-5f6fc9f54ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:44.516015 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19712e02-1e6b-41bb-bff7-5f6fc9f54ac4 None admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:44.516767 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19712e02-1e6b-41bb-bff7-5f6fc9f54ac4 None admin] RBAC: Adding query filter params (name=service) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:44.517072 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19712e02-1e6b-41bb-bff7-5f6fc9f54ac4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:44.518519 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19712e02-1e6b-41bb-bff7-5f6fc9f54ac4 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:44.529630 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802ca606-3974-4a36-bc9e-52fca1f88c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:44.529630 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ca606-3974-4a36-bc9e-52fca1f88c0b None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:44.530137 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ca606-3974-4a36-bc9e-52fca1f88c0b None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:44.530373 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ca606-3974-4a36-bc9e-52fca1f88c0b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:44.530858 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 322/646] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Mar 30 01:15:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:44.531916 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19712e02-1e6b-41bb-bff7-5f6fc9f54ac4 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:44.539657 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802ca606-3974-4a36-bc9e-52fca1f88c0b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:44.541129 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802ca606-3974-4a36-bc9e-52fca1f88c0b None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:44.557171 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-802ca606-3974-4a36-bc9e-52fca1f88c0b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Mar 30 01:15:44.558676 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 325/647] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Mar 30 01:15:44 2022] GET /identity/v3/users/neutron => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:44.559477 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802ca606-3974-4a36-bc9e-52fca1f88c0b None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:44.642084 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19712e02-1e6b-41bb-bff7-5f6fc9f54ac4 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:44.681855 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802ca606-3974-4a36-bc9e-52fca1f88c0b None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:44.685202 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c72fd2-d19d-41e9-bbdd-608610beb78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:44.685993 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c72fd2-d19d-41e9-bbdd-608610beb78c None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:44.686273 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c72fd2-d19d-41e9-bbdd-608610beb78c None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:44.686544 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c72fd2-d19d-41e9-bbdd-608610beb78c None admin] PATH_INFO: `/v3/roles/service` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:44.699876 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c72fd2-d19d-41e9-bbdd-608610beb78c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:15:44.708759 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-c7c72fd2-d19d-41e9-bbdd-608610beb78c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 30 01:15:44.714785 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 323/648] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Mar 30 01:15:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:44.716229 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c72fd2-d19d-41e9-bbdd-608610beb78c None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:44.720883 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c121e3-85db-46a6-ba09-f2bf8318549d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:44.721698 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c121e3-85db-46a6-ba09-f2bf8318549d None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:44.722581 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c121e3-85db-46a6-ba09-f2bf8318549d None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:44.722901 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c121e3-85db-46a6-ba09-f2bf8318549d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:44.733385 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c121e3-85db-46a6-ba09-f2bf8318549d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:44.734859 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c121e3-85db-46a6-ba09-f2bf8318549d None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:44.752262 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-a5c121e3-85db-46a6-ba09-f2bf8318549d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:15:44.753557 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 326/649] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:15:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:44.754412 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c121e3-85db-46a6-ba09-f2bf8318549d None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:44.832773 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c72fd2-d19d-41e9-bbdd-608610beb78c None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:44.863412 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c121e3-85db-46a6-ba09-f2bf8318549d None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:44.879532 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab57bf-e7ad-4943-b1b2-df58a664728e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:44.880203 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab57bf-e7ad-4943-b1b2-df58a664728e None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:44.880484 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab57bf-e7ad-4943-b1b2-df58a664728e None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:44.880759 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab57bf-e7ad-4943-b1b2-df58a664728e None admin] PATH_INFO: `/v3/users` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:44.881753 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab57bf-e7ad-4943-b1b2-df58a664728e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:44.882060 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab57bf-e7ad-4943-b1b2-df58a664728e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:44.884148 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab57bf-e7ad-4943-b1b2-df58a664728e None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:44.900773 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c344e74-5712-42cd-b7db-6eaac6e60366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:44.901741 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c344e74-5712-42cd-b7db-6eaac6e60366 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:44.902248 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c344e74-5712-42cd-b7db-6eaac6e60366 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:44.902762 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c344e74-5712-42cd-b7db-6eaac6e60366 None admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:44.903751 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c344e74-5712-42cd-b7db-6eaac6e60366 None admin] RBAC: Adding query filter params (name=service) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:44.904241 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c344e74-5712-42cd-b7db-6eaac6e60366 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:44.905344 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 324/650] 10.222.0.30 () {56 vars in 1139 bytes} [Wed Mar 30 01:15:44 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:44.906289 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab57bf-e7ad-4943-b1b2-df58a664728e None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:44.906524 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c344e74-5712-42cd-b7db-6eaac6e60366 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:44.920185 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 327/651] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Mar 30 01:15:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:44.921317 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c344e74-5712-42cd-b7db-6eaac6e60366 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:45.011750 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab57bf-e7ad-4943-b1b2-df58a664728e None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:45.041002 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c344e74-5712-42cd-b7db-6eaac6e60366 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:45.045632 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff961d2-14e9-40be-8a28-3218936c6170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:45.046520 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff961d2-14e9-40be-8a28-3218936c6170 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:45.047010 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff961d2-14e9-40be-8a28-3218936c6170 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:45.047453 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff961d2-14e9-40be-8a28-3218936c6170 None admin] PATH_INFO: `/v3/domains` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:45.048356 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff961d2-14e9-40be-8a28-3218936c6170 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:45.048857 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff961d2-14e9-40be-8a28-3218936c6170 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:45.051075 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff961d2-14e9-40be-8a28-3218936c6170 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:45.062937 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 325/652] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:15:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:45.064151 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff961d2-14e9-40be-8a28-3218936c6170 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:45.079839 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91e39a0-95e3-429e-ab8b-4ab0902637d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:45.080488 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e39a0-95e3-429e-ab8b-4ab0902637d2 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:45.080769 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e39a0-95e3-429e-ab8b-4ab0902637d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:45.081627 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e39a0-95e3-429e-ab8b-4ab0902637d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:45.167529 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff961d2-14e9-40be-8a28-3218936c6170 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:45.169196 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91e39a0-95e3-429e-ab8b-4ab0902637d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:45.171535 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91e39a0-95e3-429e-ab8b-4ab0902637d2 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:45.204207 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c389a83-4321-491d-9d97-c27a779dd6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:45.205053 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c389a83-4321-491d-9d97-c27a779dd6f5 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:45.205335 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c389a83-4321-491d-9d97-c27a779dd6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:45.205629 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c389a83-4321-491d-9d97-c27a779dd6f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:45.222783 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c389a83-4321-491d-9d97-c27a779dd6f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:45.224633 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c389a83-4321-491d-9d97-c27a779dd6f5 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:45.246979 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-2c389a83-4321-491d-9d97-c27a779dd6f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:15:45.250858 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 326/653] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:15:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:45.251687 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c389a83-4321-491d-9d97-c27a779dd6f5 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:45.290954 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 328/654] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Mar 30 01:15:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 30 01:15:45.291867 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91e39a0-95e3-429e-ab8b-4ab0902637d2 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:45.374635 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c389a83-4321-491d-9d97-c27a779dd6f5 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:45.392877 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91e39a0-95e3-429e-ab8b-4ab0902637d2 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:45.417228 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94ae6a9-354a-431f-bd3b-d9755e23b432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:45.418020 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ae6a9-354a-431f-bd3b-d9755e23b432 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:45.418303 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ae6a9-354a-431f-bd3b-d9755e23b432 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:45.418578 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ae6a9-354a-431f-bd3b-d9755e23b432 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:45.429202 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94ae6a9-354a-431f-bd3b-d9755e23b432 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:45.430632 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94ae6a9-354a-431f-bd3b-d9755e23b432 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:45.436419 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d5e7af-9d4a-4328-b221-498b14de5d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:45.437538 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5e7af-9d4a-4328-b221-498b14de5d21 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:45.437988 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5e7af-9d4a-4328-b221-498b14de5d21 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:45.438460 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5e7af-9d4a-4328-b221-498b14de5d21 None admin] PATH_INFO: `/v3/domains` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:45.439364 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d5e7af-9d4a-4328-b221-498b14de5d21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:45.439839 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d5e7af-9d4a-4328-b221-498b14de5d21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:45.442132 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d5e7af-9d4a-4328-b221-498b14de5d21 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:45.445170 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-c94ae6a9-354a-431f-bd3b-d9755e23b432 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Mar 30 01:15:45.451087 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 327/655] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Mar 30 01:15:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:45.452044 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94ae6a9-354a-431f-bd3b-d9755e23b432 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:45.455008 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 329/656] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:15:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:45.456002 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d5e7af-9d4a-4328-b221-498b14de5d21 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:45.558443 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94ae6a9-354a-431f-bd3b-d9755e23b432 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:45.587590 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d5e7af-9d4a-4328-b221-498b14de5d21 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:45.598538 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4110df63-e7be-492e-bb89-98e103b78e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:45.599861 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4110df63-e7be-492e-bb89-98e103b78e47 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:45.600662 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4110df63-e7be-492e-bb89-98e103b78e47 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:45.601461 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4110df63-e7be-492e-bb89-98e103b78e47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:45.615671 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4110df63-e7be-492e-bb89-98e103b78e47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:45.618139 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4110df63-e7be-492e-bb89-98e103b78e47 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:45.622106 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dad9f6-9f20-4fe6-b618-1c9e3cadc867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:45.622888 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dad9f6-9f20-4fe6-b618-1c9e3cadc867 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:45.623245 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dad9f6-9f20-4fe6-b618-1c9e3cadc867 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:45.623780 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dad9f6-9f20-4fe6-b618-1c9e3cadc867 None admin] PATH_INFO: `/v3/users` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:45.624482 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dad9f6-9f20-4fe6-b618-1c9e3cadc867 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:45.624874 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dad9f6-9f20-4fe6-b618-1c9e3cadc867 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:45.626376 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dad9f6-9f20-4fe6-b618-1c9e3cadc867 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:45.641665 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-4110df63-e7be-492e-bb89-98e103b78e47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:15:45.644183 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 328/657] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:15:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:45.644972 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4110df63-e7be-492e-bb89-98e103b78e47 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:45.657082 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 330/658] 10.222.0.30 () {56 vars in 1137 bytes} [Wed Mar 30 01:15:45 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:45.657082 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dad9f6-9f20-4fe6-b618-1c9e3cadc867 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:45.758081 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dad9f6-9f20-4fe6-b618-1c9e3cadc867 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:45.770884 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4110df63-e7be-492e-bb89-98e103b78e47 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:45.801280 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a94a29-d3c7-4014-a5df-ea95ad44534f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:45.801936 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a94a29-d3c7-4014-a5df-ea95ad44534f None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:45.802565 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a94a29-d3c7-4014-a5df-ea95ad44534f None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:45.802879 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a94a29-d3c7-4014-a5df-ea95ad44534f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:45.810761 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538884b4-b4fa-4606-a9fa-224dd5784991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:45.811566 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538884b4-b4fa-4606-a9fa-224dd5784991 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:45.812247 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538884b4-b4fa-4606-a9fa-224dd5784991 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:45.812534 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538884b4-b4fa-4606-a9fa-224dd5784991 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:45.822296 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538884b4-b4fa-4606-a9fa-224dd5784991 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:45.824768 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538884b4-b4fa-4606-a9fa-224dd5784991 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:45.843710 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-538884b4-b4fa-4606-a9fa-224dd5784991 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Mar 30 01:15:45.845609 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 329/659] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Mar 30 01:15:45 2022] GET /identity/v3/users/glance => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:45.847431 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538884b4-b4fa-4606-a9fa-224dd5784991 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:45.881814 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a94a29-d3c7-4014-a5df-ea95ad44534f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:45.883936 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a94a29-d3c7-4014-a5df-ea95ad44534f None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:45.967432 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538884b4-b4fa-4606-a9fa-224dd5784991 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:46.001458 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 331/660] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Mar 30 01:15:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 30 01:15:46.001767 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a76e0d-f567-47fe-bf92-0b0a515d21ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:46.002311 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a76e0d-f567-47fe-bf92-0b0a515d21ce None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:46.002480 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a94a29-d3c7-4014-a5df-ea95ad44534f None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:46.002634 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a76e0d-f567-47fe-bf92-0b0a515d21ce None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:46.003402 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a76e0d-f567-47fe-bf92-0b0a515d21ce None admin] PATH_INFO: `/v3/domains` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:46.004148 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a76e0d-f567-47fe-bf92-0b0a515d21ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:46.004554 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a76e0d-f567-47fe-bf92-0b0a515d21ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:46.005916 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a76e0d-f567-47fe-bf92-0b0a515d21ce None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:46.022478 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 330/661] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:15:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:46.023422 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a76e0d-f567-47fe-bf92-0b0a515d21ce None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:46.105698 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a94a29-d3c7-4014-a5df-ea95ad44534f None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:46.134001 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a76e0d-f567-47fe-bf92-0b0a515d21ce None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:46.140070 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ee9dd-d5ee-42ca-8040-7b126d9cb7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:46.140741 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ee9dd-d5ee-42ca-8040-7b126d9cb7a2 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:46.141025 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ee9dd-d5ee-42ca-8040-7b126d9cb7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:46.141302 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ee9dd-d5ee-42ca-8040-7b126d9cb7a2 None admin] PATH_INFO: `/v3/users` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:46.142140 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8ee9dd-d5ee-42ca-8040-7b126d9cb7a2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:46.142446 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8ee9dd-d5ee-42ca-8040-7b126d9cb7a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:46.144096 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8ee9dd-d5ee-42ca-8040-7b126d9cb7a2 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:46.166625 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 332/662] 10.222.0.30 () {56 vars in 1137 bytes} [Wed Mar 30 01:15:46 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:46.167524 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ee9dd-d5ee-42ca-8040-7b126d9cb7a2 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:46.169938 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b6e5c3-fa10-4cda-82db-656eb4b15d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:46.170807 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6e5c3-fa10-4cda-82db-656eb4b15d0f None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:46.171089 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6e5c3-fa10-4cda-82db-656eb4b15d0f None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:46.171362 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6e5c3-fa10-4cda-82db-656eb4b15d0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:46.182272 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b6e5c3-fa10-4cda-82db-656eb4b15d0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:46.183756 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b6e5c3-fa10-4cda-82db-656eb4b15d0f None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:46.201582 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-c4b6e5c3-fa10-4cda-82db-656eb4b15d0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:15:46.203159 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 331/663] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:15:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:46.203993 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b6e5c3-fa10-4cda-82db-656eb4b15d0f None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:46.272880 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ee9dd-d5ee-42ca-8040-7b126d9cb7a2 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:46.306043 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b6e5c3-fa10-4cda-82db-656eb4b15d0f None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:46.308242 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1067f20f-a525-4ec3-a77c-4a894eb353fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:46.309040 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1067f20f-a525-4ec3-a77c-4a894eb353fb None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:46.309325 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1067f20f-a525-4ec3-a77c-4a894eb353fb None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:46.309599 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1067f20f-a525-4ec3-a77c-4a894eb353fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:46.316860 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1067f20f-a525-4ec3-a77c-4a894eb353fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:46.318320 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1067f20f-a525-4ec3-a77c-4a894eb353fb None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:46.332040 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-1067f20f-a525-4ec3-a77c-4a894eb353fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 30 01:15:46.333545 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 333/664] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Mar 30 01:15:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:46.334400 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1067f20f-a525-4ec3-a77c-4a894eb353fb None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:46.341259 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d44a182-a112-4e2e-89ae-12c90d3bb093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:46.341914 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d44a182-a112-4e2e-89ae-12c90d3bb093 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:46.342198 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d44a182-a112-4e2e-89ae-12c90d3bb093 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:46.342472 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d44a182-a112-4e2e-89ae-12c90d3bb093 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:46.423660 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d44a182-a112-4e2e-89ae-12c90d3bb093 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:46.425065 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d44a182-a112-4e2e-89ae-12c90d3bb093 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:46.460073 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1067f20f-a525-4ec3-a77c-4a894eb353fb None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:46.494541 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e59e4c-9039-4efa-aac0-51db17797795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:46.495245 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e59e4c-9039-4efa-aac0-51db17797795 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:46.495517 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e59e4c-9039-4efa-aac0-51db17797795 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:46.495793 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e59e4c-9039-4efa-aac0-51db17797795 None admin] PATH_INFO: `/v3/domains` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:46.496517 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e59e4c-9039-4efa-aac0-51db17797795 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:46.496825 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e59e4c-9039-4efa-aac0-51db17797795 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:46.498193 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e59e4c-9039-4efa-aac0-51db17797795 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:46.510395 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 334/665] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:15:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:46.511252 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e59e4c-9039-4efa-aac0-51db17797795 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:46.528305 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 332/666] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Mar 30 01:15:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 30 01:15:46.529700 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1cc7f-5a4a-40d5-8d76-ff97ca12042d None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:46.530250 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1cc7f-5a4a-40d5-8d76-ff97ca12042d None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:46.530529 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1cc7f-5a4a-40d5-8d76-ff97ca12042d None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:46.532364 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 333/667] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:15:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:15:46.532946 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1cc7f-5a4a-40d5-8d76-ff97ca12042d None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:46.622640 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e59e4c-9039-4efa-aac0-51db17797795 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:46.636029 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1cc7f-5a4a-40d5-8d76-ff97ca12042d None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:46.661842 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7abe26-ec03-4217-bc41-0efccd9f444d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:46.662597 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7abe26-ec03-4217-bc41-0efccd9f444d None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:46.662911 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7abe26-ec03-4217-bc41-0efccd9f444d None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:46.663190 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7abe26-ec03-4217-bc41-0efccd9f444d None admin] PATH_INFO: `/v3/projects` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:46.663967 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7abe26-ec03-4217-bc41-0efccd9f444d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:46.664276 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7abe26-ec03-4217-bc41-0efccd9f444d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:46.665706 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7abe26-ec03-4217-bc41-0efccd9f444d None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:46.672423 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5bca9f-2e38-492d-a2c2-f4917b418f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:46.673205 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5bca9f-2e38-492d-a2c2-f4917b418f4b None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:46.673482 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5bca9f-2e38-492d-a2c2-f4917b418f4b None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:46.673804 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5bca9f-2e38-492d-a2c2-f4917b418f4b None admin] PATH_INFO: `/v3/projects/service` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:46.682423 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 335/668] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Mar 30 01:15:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:46.682423 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7abe26-ec03-4217-bc41-0efccd9f444d None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:46.683909 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5bca9f-2e38-492d-a2c2-f4917b418f4b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:46.685352 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5bca9f-2e38-492d-a2c2-f4917b418f4b None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:46.699406 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-3f5bca9f-2e38-492d-a2c2-f4917b418f4b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 30 01:15:46.705342 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 334/669] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Mar 30 01:15:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:46.706979 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb1464-b4a5-4ecc-bebf-58741a57b44f None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:46.707262 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb1464-b4a5-4ecc-bebf-58741a57b44f None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:46.707537 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb1464-b4a5-4ecc-bebf-58741a57b44f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:46.724329 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-3ccb1464-b4a5-4ecc-bebf-58741a57b44f None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:15:46.725513 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-3ccb1464-b4a5-4ecc-bebf-58741a57b44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:15:46.778798 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7abe26-ec03-4217-bc41-0efccd9f444d None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:46.790499 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 335/670] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:15:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 01:15:46.791371 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccb1464-b4a5-4ecc-bebf-58741a57b44f None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:46.820833 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a45ca60-7c61-4f0d-ad89-3bae8aaf12d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:46.821616 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45ca60-7c61-4f0d-ad89-3bae8aaf12d3 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:46.821897 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45ca60-7c61-4f0d-ad89-3bae8aaf12d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:46.822170 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45ca60-7c61-4f0d-ad89-3bae8aaf12d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:46.832605 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a45ca60-7c61-4f0d-ad89-3bae8aaf12d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:46.834040 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a45ca60-7c61-4f0d-ad89-3bae8aaf12d3 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:46.850467 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-4a45ca60-7c61-4f0d-ad89-3bae8aaf12d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:15:46.851655 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 336/671] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:15:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:46.852423 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a45ca60-7c61-4f0d-ad89-3bae8aaf12d3 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:46.884682 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccb1464-b4a5-4ecc-bebf-58741a57b44f None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:46.916487 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866d7ad6-62b4-4f17-a465-d05067ec63e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:46.917132 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d7ad6-62b4-4f17-a465-d05067ec63e7 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:46.917414 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d7ad6-62b4-4f17-a465-d05067ec63e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:46.917688 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d7ad6-62b4-4f17-a465-d05067ec63e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:46.918506 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866d7ad6-62b4-4f17-a465-d05067ec63e7 None admin] RBAC: Adding query filter params (role.id=4121aef9b31c4671aebb65fda1c11185, scope.project.id=0c9a4444228d4be89a4ba8aa53099531, user.id=41745b7f8a804e75b490a0a34977b23b) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:46.918851 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866d7ad6-62b4-4f17-a465-d05067ec63e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:46.920312 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866d7ad6-62b4-4f17-a465-d05067ec63e7 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:46.926669 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 336/672] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Mar 30 01:15:46 2022] GET /identity/v3/role_assignments?user.id=41745b7f8a804e75b490a0a34977b23b&scope.project.id=0c9a4444228d4be89a4ba8aa53099531&role.id=4121aef9b31c4671aebb65fda1c11185 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:46.927857 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2478225-be4f-4fa8-a015-db1c218793ac None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:46.928127 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2478225-be4f-4fa8-a015-db1c218793ac None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:46.928404 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2478225-be4f-4fa8-a015-db1c218793ac None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:46.930151 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 337/673] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:15:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:15:46.930868 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2478225-be4f-4fa8-a015-db1c218793ac None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:46.953656 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a45ca60-7c61-4f0d-ad89-3bae8aaf12d3 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:46.991411 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be618b11-27bc-439d-9041-f674ed5830ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:46.992099 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be618b11-27bc-439d-9041-f674ed5830ba None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:46.992385 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be618b11-27bc-439d-9041-f674ed5830ba None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:46.992663 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be618b11-27bc-439d-9041-f674ed5830ba None admin] PATH_INFO: `/v3/projects` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:46.993476 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be618b11-27bc-439d-9041-f674ed5830ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:46.993793 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be618b11-27bc-439d-9041-f674ed5830ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:46.995313 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be618b11-27bc-439d-9041-f674ed5830ba None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:47.008305 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 337/674] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Mar 30 01:15:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:47.009483 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be618b11-27bc-439d-9041-f674ed5830ba None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:47.057753 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2478225-be4f-4fa8-a015-db1c218793ac None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:47.093934 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ca2c61-b6d5-4521-9876-02d71b1f6211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:47.095037 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ca2c61-b6d5-4521-9876-02d71b1f6211 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:47.095314 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ca2c61-b6d5-4521-9876-02d71b1f6211 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:47.095584 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ca2c61-b6d5-4521-9876-02d71b1f6211 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:47.107034 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ca2c61-b6d5-4521-9876-02d71b1f6211 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:15:47.113174 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be618b11-27bc-439d-9041-f674ed5830ba None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:47.114403 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-c6ca2c61-b6d5-4521-9876-02d71b1f6211 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 30 01:15:47.115971 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 338/675] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Mar 30 01:15:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:47.117179 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882e85d-e3f1-4473-b172-62e21eeccc28 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:47.117462 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882e85d-e3f1-4473-b172-62e21eeccc28 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:47.118186 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882e85d-e3f1-4473-b172-62e21eeccc28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:47.138980 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-d882e85d-e3f1-4473-b172-62e21eeccc28 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:15:47.140149 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-d882e85d-e3f1-4473-b172-62e21eeccc28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:15:47.151145 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5d94f0-444a-47a8-9709-02bbc137c505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:47.151814 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d94f0-444a-47a8-9709-02bbc137c505 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:47.152098 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d94f0-444a-47a8-9709-02bbc137c505 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:47.152375 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d94f0-444a-47a8-9709-02bbc137c505 None admin] PATH_INFO: `/v3/domains` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:47.153501 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5d94f0-444a-47a8-9709-02bbc137c505 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:47.153501 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5d94f0-444a-47a8-9709-02bbc137c505 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:47.155217 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5d94f0-444a-47a8-9709-02bbc137c505 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:47.166663 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 338/676] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:15:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:47.167980 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5d94f0-444a-47a8-9709-02bbc137c505 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:47.214812 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 339/677] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:15:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 01:15:47.214812 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d882e85d-e3f1-4473-b172-62e21eeccc28 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:47.265266 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5d94f0-444a-47a8-9709-02bbc137c505 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:47.298857 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac58473-3b50-4f9b-b3c9-c352fd454ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:47.299604 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac58473-3b50-4f9b-b3c9-c352fd454ec0 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:47.299927 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac58473-3b50-4f9b-b3c9-c352fd454ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:47.300189 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac58473-3b50-4f9b-b3c9-c352fd454ec0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:47.301005 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac58473-3b50-4f9b-b3c9-c352fd454ec0 None admin] RBAC: Adding query filter params (role.id=4121aef9b31c4671aebb65fda1c11185, scope.project.id=0c9a4444228d4be89a4ba8aa53099531, user.id=45219f386f0147b6bd380efe4ab62812) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:47.301314 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac58473-3b50-4f9b-b3c9-c352fd454ec0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:47.302757 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac58473-3b50-4f9b-b3c9-c352fd454ec0 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:47.319093 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 339/678] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Mar 30 01:15:47 2022] GET /identity/v3/role_assignments?user.id=45219f386f0147b6bd380efe4ab62812&scope.project.id=0c9a4444228d4be89a4ba8aa53099531&role.id=4121aef9b31c4671aebb65fda1c11185 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:47.319093 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac58473-3b50-4f9b-b3c9-c352fd454ec0 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:47.330567 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d882e85d-e3f1-4473-b172-62e21eeccc28 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:47.368114 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39caf1ee-46f0-4801-99c5-bc8b84026846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:47.368789 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39caf1ee-46f0-4801-99c5-bc8b84026846 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:47.369124 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39caf1ee-46f0-4801-99c5-bc8b84026846 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:47.369404 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39caf1ee-46f0-4801-99c5-bc8b84026846 None admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:47.370152 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39caf1ee-46f0-4801-99c5-bc8b84026846 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:47.370458 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39caf1ee-46f0-4801-99c5-bc8b84026846 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:47.371885 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39caf1ee-46f0-4801-99c5-bc8b84026846 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:47.384089 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 340/679] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Mar 30 01:15:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:47.385040 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39caf1ee-46f0-4801-99c5-bc8b84026846 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:47.440925 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac58473-3b50-4f9b-b3c9-c352fd454ec0 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:47.479492 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab464b-ed34-40af-88be-dcad4437f295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:47.480210 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab464b-ed34-40af-88be-dcad4437f295 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:47.480492 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab464b-ed34-40af-88be-dcad4437f295 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:47.480765 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab464b-ed34-40af-88be-dcad4437f295 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:47.488727 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faab464b-ed34-40af-88be-dcad4437f295 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:47.490230 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faab464b-ed34-40af-88be-dcad4437f295 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:47.491301 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39caf1ee-46f0-4801-99c5-bc8b84026846 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:47.506168 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-faab464b-ed34-40af-88be-dcad4437f295 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 30 01:15:47.512388 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 340/680] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Mar 30 01:15:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:47.513265 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab464b-ed34-40af-88be-dcad4437f295 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:47.527198 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f778a4d7-d692-4ed1-973f-2a33851a4614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:47.528220 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f778a4d7-d692-4ed1-973f-2a33851a4614 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:47.528499 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f778a4d7-d692-4ed1-973f-2a33851a4614 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:47.528772 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f778a4d7-d692-4ed1-973f-2a33851a4614 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:47.541693 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f778a4d7-d692-4ed1-973f-2a33851a4614 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:15:47.549293 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-f778a4d7-d692-4ed1-973f-2a33851a4614 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 30 01:15:47.551220 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 341/681] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Mar 30 01:15:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:47.552195 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f778a4d7-d692-4ed1-973f-2a33851a4614 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:47.648839 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab464b-ed34-40af-88be-dcad4437f295 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:47.663223 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f778a4d7-d692-4ed1-973f-2a33851a4614 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:47.693264 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5cadf0-6d03-4c54-9337-e4f6905cee45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:47.694214 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5cadf0-6d03-4c54-9337-e4f6905cee45 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:47.694802 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5cadf0-6d03-4c54-9337-e4f6905cee45 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:47.695096 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5cadf0-6d03-4c54-9337-e4f6905cee45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:47.699338 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f6796-8098-47fe-a9a6-8de5c0d2cb7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:47.700090 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f6796-8098-47fe-a9a6-8de5c0d2cb7d None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:47.700449 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f6796-8098-47fe-a9a6-8de5c0d2cb7d None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:47.700803 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f6796-8098-47fe-a9a6-8de5c0d2cb7d None admin] PATH_INFO: `/v3/projects` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:47.701657 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642f6796-8098-47fe-a9a6-8de5c0d2cb7d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:47.702083 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642f6796-8098-47fe-a9a6-8de5c0d2cb7d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:47.703708 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642f6796-8098-47fe-a9a6-8de5c0d2cb7d None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:47.705886 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5cadf0-6d03-4c54-9337-e4f6905cee45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:47.707999 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5cadf0-6d03-4c54-9337-e4f6905cee45 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:47.721567 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 342/682] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Mar 30 01:15:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:47.723366 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f6796-8098-47fe-a9a6-8de5c0d2cb7d None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:47.727810 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-0b5cadf0-6d03-4c54-9337-e4f6905cee45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:15:47.729346 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 341/683] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:15:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:47.730188 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5cadf0-6d03-4c54-9337-e4f6905cee45 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:47.833594 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f6796-8098-47fe-a9a6-8de5c0d2cb7d None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:47.848883 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5cadf0-6d03-4c54-9337-e4f6905cee45 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:47.880754 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c0d862-4673-4acf-b306-0f466d224660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:47.882049 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c0d862-4673-4acf-b306-0f466d224660 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:47.882338 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c0d862-4673-4acf-b306-0f466d224660 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:47.882724 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c0d862-4673-4acf-b306-0f466d224660 None admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:47.883483 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c0d862-4673-4acf-b306-0f466d224660 None admin] RBAC: Adding query filter params (name=service) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:47.883788 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c0d862-4673-4acf-b306-0f466d224660 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:47.885406 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c0d862-4673-4acf-b306-0f466d224660 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:47.886137 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bcb14e-3a21-4993-8acf-8ace5c4deecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:47.886894 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bcb14e-3a21-4993-8acf-8ace5c4deecb None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:47.887246 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bcb14e-3a21-4993-8acf-8ace5c4deecb None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:47.887593 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bcb14e-3a21-4993-8acf-8ace5c4deecb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:47.888493 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bcb14e-3a21-4993-8acf-8ace5c4deecb None admin] RBAC: Adding query filter params (role.id=4121aef9b31c4671aebb65fda1c11185, scope.project.id=0c9a4444228d4be89a4ba8aa53099531, user.id=ebf28c0ec3d94fb99bcd573dd8dd0e30) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:47.888885 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bcb14e-3a21-4993-8acf-8ace5c4deecb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:47.890370 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bcb14e-3a21-4993-8acf-8ace5c4deecb None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:47.895637 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 343/684] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Mar 30 01:15:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:47.896565 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c0d862-4673-4acf-b306-0f466d224660 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:47.900715 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 342/685] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Mar 30 01:15:47 2022] GET /identity/v3/role_assignments?user.id=ebf28c0ec3d94fb99bcd573dd8dd0e30&scope.project.id=0c9a4444228d4be89a4ba8aa53099531&role.id=4121aef9b31c4671aebb65fda1c11185 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:47.908611 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bcb14e-3a21-4993-8acf-8ace5c4deecb None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:48.010971 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c0d862-4673-4acf-b306-0f466d224660 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:48.050616 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14a11ef-9a04-44cc-850a-34561830aef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:48.051350 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a11ef-9a04-44cc-850a-34561830aef7 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:48.051805 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a11ef-9a04-44cc-850a-34561830aef7 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:48.052211 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a11ef-9a04-44cc-850a-34561830aef7 None admin] PATH_INFO: `/v3/domains` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:48.052940 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14a11ef-9a04-44cc-850a-34561830aef7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:48.053415 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14a11ef-9a04-44cc-850a-34561830aef7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:48.054856 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14a11ef-9a04-44cc-850a-34561830aef7 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:48.068956 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 344/686] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:15:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:48.075046 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14a11ef-9a04-44cc-850a-34561830aef7 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:48.171076 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bcb14e-3a21-4993-8acf-8ace5c4deecb None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:48.205799 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbd3798-5842-485a-82ae-7f6de0ca0292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:48.206651 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd3798-5842-485a-82ae-7f6de0ca0292 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:48.207134 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd3798-5842-485a-82ae-7f6de0ca0292 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:48.207416 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd3798-5842-485a-82ae-7f6de0ca0292 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:48.217736 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbd3798-5842-485a-82ae-7f6de0ca0292 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:48.219226 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbd3798-5842-485a-82ae-7f6de0ca0292 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:48.236613 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14a11ef-9a04-44cc-850a-34561830aef7 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:48.237400 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-edbd3798-5842-485a-82ae-7f6de0ca0292 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:15:48.239013 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 343/687] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:15:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 01:15:48.248909 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbd3798-5842-485a-82ae-7f6de0ca0292 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:48.282542 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a790ba-9b56-4901-8eff-3a72d58323d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:48.283645 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a790ba-9b56-4901-8eff-3a72d58323d3 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:48.284724 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a790ba-9b56-4901-8eff-3a72d58323d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:48.285011 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a790ba-9b56-4901-8eff-3a72d58323d3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:48.293886 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a790ba-9b56-4901-8eff-3a72d58323d3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:48.296127 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a790ba-9b56-4901-8eff-3a72d58323d3 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:48.317070 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-c9a790ba-9b56-4901-8eff-3a72d58323d3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 30 01:15:48.318907 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 345/688] 10.222.0.30 () {56 vars in 1093 bytes} [Wed Mar 30 01:15:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 01:15:48.325807 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a790ba-9b56-4901-8eff-3a72d58323d3 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:48.382977 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbd3798-5842-485a-82ae-7f6de0ca0292 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:48.421922 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecc4a42-3468-40e0-bd88-74cb228efd07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:48.422658 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc4a42-3468-40e0-bd88-74cb228efd07 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:48.422969 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc4a42-3468-40e0-bd88-74cb228efd07 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:48.423244 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc4a42-3468-40e0-bd88-74cb228efd07 None admin] PATH_INFO: `/v3/domains` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:48.424003 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecc4a42-3468-40e0-bd88-74cb228efd07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:48.424309 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecc4a42-3468-40e0-bd88-74cb228efd07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:48.426223 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecc4a42-3468-40e0-bd88-74cb228efd07 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:48.437487 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a790ba-9b56-4901-8eff-3a72d58323d3 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:48.437803 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 344/689] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:15:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:48.445255 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecc4a42-3468-40e0-bd88-74cb228efd07 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:48.483563 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad771170-41b6-4c3c-a072-28282f5ff8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:48.484242 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad771170-41b6-4c3c-a072-28282f5ff8cd None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:48.484529 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad771170-41b6-4c3c-a072-28282f5ff8cd None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:48.484808 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad771170-41b6-4c3c-a072-28282f5ff8cd None admin] PATH_INFO: `/v3/users` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:48.485657 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad771170-41b6-4c3c-a072-28282f5ff8cd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:48.486062 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad771170-41b6-4c3c-a072-28282f5ff8cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:48.488061 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad771170-41b6-4c3c-a072-28282f5ff8cd None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:48.508408 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 346/690] 10.222.0.30 () {56 vars in 1133 bytes} [Wed Mar 30 01:15:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:48.513789 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad771170-41b6-4c3c-a072-28282f5ff8cd None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:48.560167 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecc4a42-3468-40e0-bd88-74cb228efd07 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:48.598434 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb160b4-7a00-4c96-8c66-ace5cb76b53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:48.600129 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb160b4-7a00-4c96-8c66-ace5cb76b53f None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:48.600647 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb160b4-7a00-4c96-8c66-ace5cb76b53f None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:48.601122 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb160b4-7a00-4c96-8c66-ace5cb76b53f None admin] PATH_INFO: `/v3/users/swift` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:48.612732 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb160b4-7a00-4c96-8c66-ace5cb76b53f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:48.616629 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb160b4-7a00-4c96-8c66-ace5cb76b53f None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:48.628441 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad771170-41b6-4c3c-a072-28282f5ff8cd None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:48.633151 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-feb160b4-7a00-4c96-8c66-ace5cb76b53f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 30 01:15:48.634690 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 345/691] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Mar 30 01:15:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 01:15:48.640129 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb160b4-7a00-4c96-8c66-ace5cb76b53f None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:48.672977 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfcad39-1132-4309-a397-5da1a5070b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:48.675284 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfcad39-1132-4309-a397-5da1a5070b8e None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:48.675794 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfcad39-1132-4309-a397-5da1a5070b8e None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:48.676313 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfcad39-1132-4309-a397-5da1a5070b8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:48.759694 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb160b4-7a00-4c96-8c66-ace5cb76b53f None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:48.763411 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfcad39-1132-4309-a397-5da1a5070b8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:48.765043 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfcad39-1132-4309-a397-5da1a5070b8e None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:48.795316 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b330e22-3f5c-4d30-a399-2d39c72e0739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:48.796518 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b330e22-3f5c-4d30-a399-2d39c72e0739 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:48.797088 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b330e22-3f5c-4d30-a399-2d39c72e0739 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:48.797675 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b330e22-3f5c-4d30-a399-2d39c72e0739 None admin] PATH_INFO: `/v3/users` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:48.799118 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b330e22-3f5c-4d30-a399-2d39c72e0739 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:48.799529 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b330e22-3f5c-4d30-a399-2d39c72e0739 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:48.802192 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b330e22-3f5c-4d30-a399-2d39c72e0739 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:48.820244 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 346/692] 10.222.0.30 () {56 vars in 1135 bytes} [Wed Mar 30 01:15:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:48.826274 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b330e22-3f5c-4d30-a399-2d39c72e0739 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:48.895589 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 347/693] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Mar 30 01:15:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 30 01:15:48.906745 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfcad39-1132-4309-a397-5da1a5070b8e None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:49.022107 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfcad39-1132-4309-a397-5da1a5070b8e None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:49.031225 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b330e22-3f5c-4d30-a399-2d39c72e0739 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:49.063393 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e919771-7df8-418d-85d5-35289dc8a1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:49.065088 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e919771-7df8-418d-85d5-35289dc8a1a7 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:49.066121 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e919771-7df8-418d-85d5-35289dc8a1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:49.066606 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e919771-7df8-418d-85d5-35289dc8a1a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:49.079280 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e919771-7df8-418d-85d5-35289dc8a1a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:49.082098 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e919771-7df8-418d-85d5-35289dc8a1a7 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:49.103461 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-1e919771-7df8-418d-85d5-35289dc8a1a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:15:49.105361 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 348/694] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:15:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:49.111600 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a255f78-87f9-4cc4-b5bc-f0dc563ba331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:49.111600 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a255f78-87f9-4cc4-b5bc-f0dc563ba331 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:49.111600 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a255f78-87f9-4cc4-b5bc-f0dc563ba331 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:49.111600 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a255f78-87f9-4cc4-b5bc-f0dc563ba331 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:49.117127 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e919771-7df8-418d-85d5-35289dc8a1a7 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:49.243669 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a255f78-87f9-4cc4-b5bc-f0dc563ba331 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:49.245130 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a255f78-87f9-4cc4-b5bc-f0dc563ba331 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:49.331936 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e919771-7df8-418d-85d5-35289dc8a1a7 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:49.400636 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc1ba42-976c-4a09-9fb5-15047d4ff7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:49.401722 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1ba42-976c-4a09-9fb5-15047d4ff7f8 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:49.402217 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1ba42-976c-4a09-9fb5-15047d4ff7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:49.402720 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1ba42-976c-4a09-9fb5-15047d4ff7f8 None admin] PATH_INFO: `/v3/domains` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:49.403672 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc1ba42-976c-4a09-9fb5-15047d4ff7f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:49.404181 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc1ba42-976c-4a09-9fb5-15047d4ff7f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:49.406031 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc1ba42-976c-4a09-9fb5-15047d4ff7f8 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:49.408405 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 347/695] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Mar 30 01:15:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 582 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 30 01:15:49.414725 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a255f78-87f9-4cc4-b5bc-f0dc563ba331 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:49.436064 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 349/696] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:15:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:15:49.444729 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc1ba42-976c-4a09-9fb5-15047d4ff7f8 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:49.610231 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a255f78-87f9-4cc4-b5bc-f0dc563ba331 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:49.651969 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fd58ed-9b04-4ca9-9572-21c7e1a672eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:49.653746 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd58ed-9b04-4ca9-9572-21c7e1a672eb None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:49.654234 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd58ed-9b04-4ca9-9572-21c7e1a672eb None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:49.654766 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd58ed-9b04-4ca9-9572-21c7e1a672eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:49.655661 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc1ba42-976c-4a09-9fb5-15047d4ff7f8 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:49.681367 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fd58ed-9b04-4ca9-9572-21c7e1a672eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:49.682927 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fd58ed-9b04-4ca9-9572-21c7e1a672eb None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:49.700372 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-97fd58ed-9b04-4ca9-9572-21c7e1a672eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:15:49.702100 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 348/697] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:15:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:49.702824 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e0c4c0-40d9-463a-90ad-db2e5cc0731b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:49.703465 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01fcbe9-2d62-4915-80ec-80a82b7cdcc0 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:49.703753 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01fcbe9-2d62-4915-80ec-80a82b7cdcc0 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:49.704031 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01fcbe9-2d62-4915-80ec-80a82b7cdcc0 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:49.704780 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e0c4c0-40d9-463a-90ad-db2e5cc0731b None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:49.705253 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e0c4c0-40d9-463a-90ad-db2e5cc0731b None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:49.705717 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e0c4c0-40d9-463a-90ad-db2e5cc0731b None admin] PATH_INFO: `/v3/projects/service` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:49.709828 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 349/698] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:15:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:15:49.710611 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01fcbe9-2d62-4915-80ec-80a82b7cdcc0 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:49.714032 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e0c4c0-40d9-463a-90ad-db2e5cc0731b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:49.715707 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e0c4c0-40d9-463a-90ad-db2e5cc0731b None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:49.729605 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-e6e0c4c0-40d9-463a-90ad-db2e5cc0731b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 30 01:15:49.731425 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 350/699] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Mar 30 01:15:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:49.734748 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bbb507-6d68-48d0-9b59-a77300bea4fb None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:49.738182 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bbb507-6d68-48d0-9b59-a77300bea4fb None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:49.738567 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bbb507-6d68-48d0-9b59-a77300bea4fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:49.755941 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-63bbb507-6d68-48d0-9b59-a77300bea4fb None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:15:49.757290 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-63bbb507-6d68-48d0-9b59-a77300bea4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:15:49.816655 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01fcbe9-2d62-4915-80ec-80a82b7cdcc0 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:49.826126 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 351/700] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:15:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 01:15:49.827145 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bbb507-6d68-48d0-9b59-a77300bea4fb None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:49.871435 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2b26f4-9d2c-4f6a-bcb1-d8739c795ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:49.872440 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b26f4-9d2c-4f6a-bcb1-d8739c795ffa None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:49.872939 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b26f4-9d2c-4f6a-bcb1-d8739c795ffa None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:49.873400 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b26f4-9d2c-4f6a-bcb1-d8739c795ffa None admin] PATH_INFO: `/v3/domains` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:49.874339 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2b26f4-9d2c-4f6a-bcb1-d8739c795ffa None admin] RBAC: Adding query filter params (name=Default) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:49.874908 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2b26f4-9d2c-4f6a-bcb1-d8739c795ffa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:49.876554 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2b26f4-9d2c-4f6a-bcb1-d8739c795ffa None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:49.892531 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 350/701] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:15:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:49.894596 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2b26f4-9d2c-4f6a-bcb1-d8739c795ffa None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:49.938538 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bbb507-6d68-48d0-9b59-a77300bea4fb None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:49.975277 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9faec8-374a-4e49-93b2-03c04a20c009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:49.975937 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9faec8-374a-4e49-93b2-03c04a20c009 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:49.976229 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9faec8-374a-4e49-93b2-03c04a20c009 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:49.976506 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9faec8-374a-4e49-93b2-03c04a20c009 None admin] PATH_INFO: `/v3/projects` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:49.977288 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9faec8-374a-4e49-93b2-03c04a20c009 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:49.977599 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9faec8-374a-4e49-93b2-03c04a20c009 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:49.979066 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9faec8-374a-4e49-93b2-03c04a20c009 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:49.991285 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 352/702] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Mar 30 01:15:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:49.992111 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9faec8-374a-4e49-93b2-03c04a20c009 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:50.002626 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2b26f4-9d2c-4f6a-bcb1-d8739c795ffa None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:50.035501 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fed49d-a7f4-4f8f-88a2-859d0936b35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:50.036383 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fed49d-a7f4-4f8f-88a2-859d0936b35c None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:50.036757 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fed49d-a7f4-4f8f-88a2-859d0936b35c None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:50.037040 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fed49d-a7f4-4f8f-88a2-859d0936b35c None admin] PATH_INFO: `/v3/services/network` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:50.037695 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fed49d-a7f4-4f8f-88a2-859d0936b35c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:50.039086 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fed49d-a7f4-4f8f-88a2-859d0936b35c None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:50.052104 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-e4fed49d-a7f4-4f8f-88a2-859d0936b35c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Mar 30 01:15:50.053288 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 351/703] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Mar 30 01:15:49 2022] GET /identity/v3/services/network => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:50.054488 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98d378-c190-4734-b516-6b4345e7b7ce None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:50.054794 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98d378-c190-4734-b516-6b4345e7b7ce None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:50.055072 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98d378-c190-4734-b516-6b4345e7b7ce None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:50.056881 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 352/704] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:15:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:15:50.057397 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe98d378-c190-4734-b516-6b4345e7b7ce None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:50.109946 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9faec8-374a-4e49-93b2-03c04a20c009 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:50.141696 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16925a74-798c-42f6-aa18-a050659a50a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:50.142743 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16925a74-798c-42f6-aa18-a050659a50a4 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:50.144128 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16925a74-798c-42f6-aa18-a050659a50a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:50.144770 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16925a74-798c-42f6-aa18-a050659a50a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:50.153654 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16925a74-798c-42f6-aa18-a050659a50a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:50.155602 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16925a74-798c-42f6-aa18-a050659a50a4 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:50.156105 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe98d378-c190-4734-b516-6b4345e7b7ce None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:50.169910 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-16925a74-798c-42f6-aa18-a050659a50a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 30 01:15:50.176252 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 353/705] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Mar 30 01:15:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:50.176252 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16925a74-798c-42f6-aa18-a050659a50a4 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:50.194685 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a2099e-b5af-4399-a57d-82267251c0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:50.195711 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2099e-b5af-4399-a57d-82267251c0c1 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:50.196134 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2099e-b5af-4399-a57d-82267251c0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:50.196830 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2099e-b5af-4399-a57d-82267251c0c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:50.198075 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a2099e-b5af-4399-a57d-82267251c0c1 None admin] RBAC: Adding query filter params (role.id=36909bbf31d04993bb2a9fe587b572dc, scope.project.id=0c9a4444228d4be89a4ba8aa53099531, user.id=140c6d1a20e94192bde06e72040f162d) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:50.198677 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a2099e-b5af-4399-a57d-82267251c0c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:50.200898 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a2099e-b5af-4399-a57d-82267251c0c1 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:50.208388 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 353/706] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Mar 30 01:15:50 2022] GET /identity/v3/role_assignments?user.id=140c6d1a20e94192bde06e72040f162d&scope.project.id=0c9a4444228d4be89a4ba8aa53099531&role.id=36909bbf31d04993bb2a9fe587b572dc => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:50.209808 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7656f59-56ff-48c5-961a-211ec8f302d7 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:50.210243 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7656f59-56ff-48c5-961a-211ec8f302d7 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:50.210642 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7656f59-56ff-48c5-961a-211ec8f302d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:50.240783 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-c7656f59-56ff-48c5-961a-211ec8f302d7 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:15:50.242530 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-c7656f59-56ff-48c5-961a-211ec8f302d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:15:50.282246 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16925a74-798c-42f6-aa18-a050659a50a4 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:50.325213 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 354/707] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:15:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 01:15:50.325703 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efda07dc-bb8a-4d78-b29d-f9632798ce9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:50.326102 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7656f59-56ff-48c5-961a-211ec8f302d7 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:50.326774 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda07dc-bb8a-4d78-b29d-f9632798ce9a None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:50.327192 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda07dc-bb8a-4d78-b29d-f9632798ce9a None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:50.327625 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda07dc-bb8a-4d78-b29d-f9632798ce9a None admin] PATH_INFO: `/v3/services` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:50.328683 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efda07dc-bb8a-4d78-b29d-f9632798ce9a None admin] RBAC: Adding query filter params (name=network) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:50.330014 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efda07dc-bb8a-4d78-b29d-f9632798ce9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:50.332159 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efda07dc-bb8a-4d78-b29d-f9632798ce9a None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:50.338184 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 354/708] 10.222.0.30 () {56 vars in 1112 bytes} [Wed Mar 30 01:15:50 2022] GET /identity/v3/services?name=network => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:50.343901 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efda07dc-bb8a-4d78-b29d-f9632798ce9a None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:50.448128 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7656f59-56ff-48c5-961a-211ec8f302d7 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:50.486023 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efda07dc-bb8a-4d78-b29d-f9632798ce9a None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:50.490149 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfa8669-2c30-4de4-a22c-5e5a622bc24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:50.491235 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa8669-2c30-4de4-a22c-5e5a622bc24a None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:50.492656 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa8669-2c30-4de4-a22c-5e5a622bc24a None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:50.492656 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa8669-2c30-4de4-a22c-5e5a622bc24a None admin] PATH_INFO: `/v3/projects` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:50.493179 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfa8669-2c30-4de4-a22c-5e5a622bc24a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:50.493689 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfa8669-2c30-4de4-a22c-5e5a622bc24a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:50.495808 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfa8669-2c30-4de4-a22c-5e5a622bc24a None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:50.517883 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 355/709] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Mar 30 01:15:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:50.517883 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfa8669-2c30-4de4-a22c-5e5a622bc24a None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:50.531407 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9dbaca-3602-46f7-a9e6-a0694bd92ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:50.532921 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9dbaca-3602-46f7-a9e6-a0694bd92ba7 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:50.533406 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9dbaca-3602-46f7-a9e6-a0694bd92ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:50.534855 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9dbaca-3602-46f7-a9e6-a0694bd92ba7 None admin] PATH_INFO: `/v3/services` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:50.536063 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9dbaca-3602-46f7-a9e6-a0694bd92ba7 None admin] RBAC: Adding query filter params (type=network) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:50.536586 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9dbaca-3602-46f7-a9e6-a0694bd92ba7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:50.538447 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9dbaca-3602-46f7-a9e6-a0694bd92ba7 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:50.546752 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 355/710] 10.222.0.30 () {56 vars in 1112 bytes} [Wed Mar 30 01:15:50 2022] GET /identity/v3/services?type=network => generated 124 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:15:50.547930 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9dbaca-3602-46f7-a9e6-a0694bd92ba7 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:50.667799 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9dbaca-3602-46f7-a9e6-a0694bd92ba7 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:50.707328 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e401e584-b803-491b-8705-9f828b9d9edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:50.709379 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401e584-b803-491b-8705-9f828b9d9edb None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:50.709927 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401e584-b803-491b-8705-9f828b9d9edb None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:50.710600 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401e584-b803-491b-8705-9f828b9d9edb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:50.711701 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e401e584-b803-491b-8705-9f828b9d9edb None admin] RBAC: Adding query filter params (role.id=4121aef9b31c4671aebb65fda1c11185, scope.project.id=0c9a4444228d4be89a4ba8aa53099531, user.id=76f16de81dfb4c14b027cd6cd1e6ff2c) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:50.712222 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e401e584-b803-491b-8705-9f828b9d9edb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:50.714035 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e401e584-b803-491b-8705-9f828b9d9edb None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:50.720416 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfa8669-2c30-4de4-a22c-5e5a622bc24a None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:50.727109 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 356/711] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Mar 30 01:15:50 2022] GET /identity/v3/role_assignments?user.id=76f16de81dfb4c14b027cd6cd1e6ff2c&scope.project.id=0c9a4444228d4be89a4ba8aa53099531&role.id=4121aef9b31c4671aebb65fda1c11185 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:50.793052 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94de6edb-c192-4196-8a5c-f91eae2f7e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:50.793894 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de6edb-c192-4196-8a5c-f91eae2f7e49 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:50.794180 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de6edb-c192-4196-8a5c-f91eae2f7e49 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:50.794459 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de6edb-c192-4196-8a5c-f91eae2f7e49 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:50.795196 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94de6edb-c192-4196-8a5c-f91eae2f7e49 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:50.796642 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94de6edb-c192-4196-8a5c-f91eae2f7e49 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:50.814857 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-94de6edb-c192-4196-8a5c-f91eae2f7e49 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Mar 30 01:15:50.816570 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 356/712] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Mar 30 01:15:50 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:50.822271 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e401e584-b803-491b-8705-9f828b9d9edb None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:50.941737 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e401e584-b803-491b-8705-9f828b9d9edb None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:50.978262 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829f75f0-e03d-49d1-9d8b-ead02db46fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:50.979294 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f75f0-e03d-49d1-9d8b-ead02db46fbc None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:50.979788 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f75f0-e03d-49d1-9d8b-ead02db46fbc None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:50.980258 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f75f0-e03d-49d1-9d8b-ead02db46fbc None admin] PATH_INFO: `/v3/services` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:50.981147 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829f75f0-e03d-49d1-9d8b-ead02db46fbc None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:50.981656 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829f75f0-e03d-49d1-9d8b-ead02db46fbc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:50.983257 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829f75f0-e03d-49d1-9d8b-ead02db46fbc None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:50.988994 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 357/713] 10.222.0.30 () {56 vars in 1124 bytes} [Wed Mar 30 01:15:50 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:50.994288 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94de6edb-c192-4196-8a5c-f91eae2f7e49 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:51.098586 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94de6edb-c192-4196-8a5c-f91eae2f7e49 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:51.108198 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28da642-a626-4ebe-9b9b-e82f1c4572c5 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:51.108794 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28da642-a626-4ebe-9b9b-e82f1c4572c5 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:51.109266 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28da642-a626-4ebe-9b9b-e82f1c4572c5 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:51.113025 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 358/714] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:15:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:15:51.117661 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f5a51-1065-4260-bb20-1e29faad71f6 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:51.117947 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f5a51-1065-4260-bb20-1e29faad71f6 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:51.118219 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f5a51-1065-4260-bb20-1e29faad71f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:51.142115 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-876f5a51-1065-4260-bb20-1e29faad71f6 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:15:51.143400 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-876f5a51-1065-4260-bb20-1e29faad71f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:15:51.149201 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b879b8b5-116d-4423-b029-3a5834504192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:51.150179 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b879b8b5-116d-4423-b029-3a5834504192 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:51.150654 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b879b8b5-116d-4423-b029-3a5834504192 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:51.151157 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b879b8b5-116d-4423-b029-3a5834504192 None admin] PATH_INFO: `/v3/services` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:51.152508 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b879b8b5-116d-4423-b029-3a5834504192 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:51.153020 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b879b8b5-116d-4423-b029-3a5834504192 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:51.155227 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b879b8b5-116d-4423-b029-3a5834504192 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:51.163616 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 357/715] 10.222.0.30 () {56 vars in 1124 bytes} [Wed Mar 30 01:15:50 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:15:51.228227 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 359/716] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:15:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 30 01:15:51.253987 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b879b8b5-116d-4423-b029-3a5834504192 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:51.362844 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b879b8b5-116d-4423-b029-3a5834504192 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:51.401412 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a13cdb0-57b4-4e6c-a25f-33a9b8e7bcf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:51.402450 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13cdb0-57b4-4e6c-a25f-33a9b8e7bcf6 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:51.402906 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13cdb0-57b4-4e6c-a25f-33a9b8e7bcf6 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:51.403459 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13cdb0-57b4-4e6c-a25f-33a9b8e7bcf6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:51.416335 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a13cdb0-57b4-4e6c-a25f-33a9b8e7bcf6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:51.418481 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a13cdb0-57b4-4e6c-a25f-33a9b8e7bcf6 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:51.436887 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-4a13cdb0-57b4-4e6c-a25f-33a9b8e7bcf6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:15:51.438598 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 358/717] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:15:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:51.447686 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876f5a51-1065-4260-bb20-1e29faad71f6 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:51.610806 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876f5a51-1065-4260-bb20-1e29faad71f6 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:51.673227 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec89ea3-ea01-48fd-9442-9da8b26556c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:51.673903 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec89ea3-ea01-48fd-9442-9da8b26556c3 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:51.674188 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec89ea3-ea01-48fd-9442-9da8b26556c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:51.674466 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec89ea3-ea01-48fd-9442-9da8b26556c3 None admin] PATH_INFO: `/v3/domains` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:51.675840 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec89ea3-ea01-48fd-9442-9da8b26556c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:51.676150 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec89ea3-ea01-48fd-9442-9da8b26556c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:51.677508 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec89ea3-ea01-48fd-9442-9da8b26556c3 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:51.695874 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 360/718] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:15:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:51.701536 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a13cdb0-57b4-4e6c-a25f-33a9b8e7bcf6 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:51.862426 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a13cdb0-57b4-4e6c-a25f-33a9b8e7bcf6 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:51.908307 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844509f5-0221-4307-b04a-102f9b76e5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:51.909077 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844509f5-0221-4307-b04a-102f9b76e5c4 None admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:51.909409 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844509f5-0221-4307-b04a-102f9b76e5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:51.909691 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844509f5-0221-4307-b04a-102f9b76e5c4 None admin] PATH_INFO: `/v3/users` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:51.910406 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844509f5-0221-4307-b04a-102f9b76e5c4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:51.911878 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844509f5-0221-4307-b04a-102f9b76e5c4 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:51.948721 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 359/719] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Mar 30 01:15:51 2022] POST /identity/v3/users => generated 254 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:15:52.854295 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b83c355-37ad-4ba5-85ea-4d767fe527a7 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:52.855338 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b83c355-37ad-4ba5-85ea-4d767fe527a7 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:52.855842 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b83c355-37ad-4ba5-85ea-4d767fe527a7 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:52.858015 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 361/720] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:15:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:15:52.864142 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfbeabc-f6a3-42c0-9b5c-3719766e3469 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:52.864958 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfbeabc-f6a3-42c0-9b5c-3719766e3469 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:52.865448 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfbeabc-f6a3-42c0-9b5c-3719766e3469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:52.889786 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-bbfbeabc-f6a3-42c0-9b5c-3719766e3469 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:15:52.891255 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-bbfbeabc-f6a3-42c0-9b5c-3719766e3469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:15:52.996562 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 360/721] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:15:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 01:15:53.035043 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b83c355-37ad-4ba5-85ea-4d767fe527a7 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:53.171203 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b83c355-37ad-4ba5-85ea-4d767fe527a7 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:53.214182 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc23827-9a61-40af-9123-1b9421dba7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:53.215000 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc23827-9a61-40af-9123-1b9421dba7bb None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:53.215273 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc23827-9a61-40af-9123-1b9421dba7bb None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:53.215547 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc23827-9a61-40af-9123-1b9421dba7bb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:53.225842 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc23827-9a61-40af-9123-1b9421dba7bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:15:53.238178 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-4cc23827-9a61-40af-9123-1b9421dba7bb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 30 01:15:53.239721 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 362/722] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Mar 30 01:15:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:53.247802 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfbeabc-f6a3-42c0-9b5c-3719766e3469 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:53.418422 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfbeabc-f6a3-42c0-9b5c-3719766e3469 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:53.464845 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dd930a-af0d-4d5c-9480-e689c1109768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:53.465856 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd930a-af0d-4d5c-9480-e689c1109768 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:53.466356 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd930a-af0d-4d5c-9480-e689c1109768 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:53.466863 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd930a-af0d-4d5c-9480-e689c1109768 None admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:53.467840 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dd930a-af0d-4d5c-9480-e689c1109768 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:53.468339 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dd930a-af0d-4d5c-9480-e689c1109768 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:53.469933 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dd930a-af0d-4d5c-9480-e689c1109768 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:53.482007 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 361/723] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Mar 30 01:15:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:53.488524 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc23827-9a61-40af-9123-1b9421dba7bb None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:53.490919 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c30c0-e643-4601-8645-ca800ad1757b None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:53.491225 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c30c0-e643-4601-8645-ca800ad1757b None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:53.491522 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c30c0-e643-4601-8645-ca800ad1757b None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:53.493449 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 362/724] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:15:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 01:15:53.498798 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10330201-ff7b-44a5-a8f3-aafc4714f31d None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:53.499086 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10330201-ff7b-44a5-a8f3-aafc4714f31d None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:53.499367 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10330201-ff7b-44a5-a8f3-aafc4714f31d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:53.520381 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-10330201-ff7b-44a5-a8f3-aafc4714f31d None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:15:53.521577 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-10330201-ff7b-44a5-a8f3-aafc4714f31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:15:53.598615 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 363/725] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:15:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 30 01:15:53.652274 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc23827-9a61-40af-9123-1b9421dba7bb None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:53.662730 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10330201-ff7b-44a5-a8f3-aafc4714f31d None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:53.730480 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf8a20b-a834-41d3-9a38-0b813006cc35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:53.731553 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8a20b-a834-41d3-9a38-0b813006cc35 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:53.732446 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8a20b-a834-41d3-9a38-0b813006cc35 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:53.732876 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8a20b-a834-41d3-9a38-0b813006cc35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:53.747421 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf8a20b-a834-41d3-9a38-0b813006cc35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:53.749740 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf8a20b-a834-41d3-9a38-0b813006cc35 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:53.778258 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-6cf8a20b-a834-41d3-9a38-0b813006cc35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:15:53.780353 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 363/726] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:15:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:53.782253 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976d87f-4b1d-4a30-b7ab-8694832fe942 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:53.783007 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976d87f-4b1d-4a30-b7ab-8694832fe942 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:53.783436 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976d87f-4b1d-4a30-b7ab-8694832fe942 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:53.786886 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 364/727] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:15:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:15:53.787851 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8976d87f-4b1d-4a30-b7ab-8694832fe942 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:53.798664 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10330201-ff7b-44a5-a8f3-aafc4714f31d None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:53.837139 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cda137c-6542-44f2-a912-f622df7a6263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:53.837874 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda137c-6542-44f2-a912-f622df7a6263 None admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:53.838157 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda137c-6542-44f2-a912-f622df7a6263 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:53.838482 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda137c-6542-44f2-a912-f622df7a6263 None admin] PATH_INFO: `/v3/services` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:53.839247 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cda137c-6542-44f2-a912-f622df7a6263 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:53.840635 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cda137c-6542-44f2-a912-f622df7a6263 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:53.860943 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 364/728] 10.222.0.30 () {60 vars in 1141 bytes} [Wed Mar 30 01:15:53 2022] POST /identity/v3/services => generated 240 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 01:15:53.862760 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8345fc-1e55-44e2-82af-2c65cb6a3eab None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:53.863053 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8345fc-1e55-44e2-82af-2c65cb6a3eab None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:53.863387 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8345fc-1e55-44e2-82af-2c65cb6a3eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:53.885215 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-6f8345fc-1e55-44e2-82af-2c65cb6a3eab None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:15:53.886440 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-6f8345fc-1e55-44e2-82af-2c65cb6a3eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:15:53.921330 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8976d87f-4b1d-4a30-b7ab-8694832fe942 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:53.961813 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d15af3-011a-4042-a1c9-fa0f2b19a896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:53.962825 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d15af3-011a-4042-a1c9-fa0f2b19a896 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:53.963422 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d15af3-011a-4042-a1c9-fa0f2b19a896 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:53.963951 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d15af3-011a-4042-a1c9-fa0f2b19a896 None admin] PATH_INFO: `/v3/domains` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:53.964951 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d15af3-011a-4042-a1c9-fa0f2b19a896 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:53.965492 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d15af3-011a-4042-a1c9-fa0f2b19a896 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:53.967277 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d15af3-011a-4042-a1c9-fa0f2b19a896 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:53.980994 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 365/730] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:15:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:53.982775 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 365/730] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:15:53 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 01:15:53.985799 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d15af3-011a-4042-a1c9-fa0f2b19a896 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:54.007453 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8345fc-1e55-44e2-82af-2c65cb6a3eab None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:54.167928 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8345fc-1e55-44e2-82af-2c65cb6a3eab None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:54.168678 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d15af3-011a-4042-a1c9-fa0f2b19a896 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:54.203783 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c097ca81-0b22-427b-bb85-8ca545afdf63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:54.204381 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e485dec-a64b-4d41-9537-c2f501bb167a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:54.205176 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e485dec-a64b-4d41-9537-c2f501bb167a None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:54.205459 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e485dec-a64b-4d41-9537-c2f501bb167a None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:54.205626 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c097ca81-0b22-427b-bb85-8ca545afdf63 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:54.205789 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e485dec-a64b-4d41-9537-c2f501bb167a None admin] PATH_INFO: `/v3/users/nova` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:54.206056 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c097ca81-0b22-427b-bb85-8ca545afdf63 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:54.206341 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c097ca81-0b22-427b-bb85-8ca545afdf63 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:54.215522 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e485dec-a64b-4d41-9537-c2f501bb167a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:54.216960 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e485dec-a64b-4d41-9537-c2f501bb167a None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:54.218182 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c097ca81-0b22-427b-bb85-8ca545afdf63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:15:54.227096 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-c097ca81-0b22-427b-bb85-8ca545afdf63 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 30 01:15:54.228607 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 366/731] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Mar 30 01:15:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 01:15:54.229838 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6e330-5daa-45a2-9c69-999cb1c88077 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:54.230125 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6e330-5daa-45a2-9c69-999cb1c88077 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:54.230402 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6e330-5daa-45a2-9c69-999cb1c88077 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:54.232373 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 367/732] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:15:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:15:54.232990 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-0e485dec-a64b-4d41-9537-c2f501bb167a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 30 01:15:54.234540 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 366/733] 10.222.0.30 () {56 vars in 1093 bytes} [Wed Mar 30 01:15:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 01:15:54.236949 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f6e330-5daa-45a2-9c69-999cb1c88077 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:54.237987 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9cf277-2ab1-4488-aa26-df627f38d813 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:54.238275 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9cf277-2ab1-4488-aa26-df627f38d813 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:54.238550 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9cf277-2ab1-4488-aa26-df627f38d813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:54.259019 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-5b9cf277-2ab1-4488-aa26-df627f38d813 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:15:54.260213 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-5b9cf277-2ab1-4488-aa26-df627f38d813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:15:54.330808 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 367/734] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:15:54 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 01:15:54.331670 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9cf277-2ab1-4488-aa26-df627f38d813 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:54.375194 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f6e330-5daa-45a2-9c69-999cb1c88077 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:54.417870 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd9ccd-4884-4320-a706-9e462872b81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:54.418542 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd9ccd-4884-4320-a706-9e462872b81d None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:54.418888 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd9ccd-4884-4320-a706-9e462872b81d None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:54.419167 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd9ccd-4884-4320-a706-9e462872b81d None admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:54.420091 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bd9ccd-4884-4320-a706-9e462872b81d None admin] RBAC: Adding query filter params (name=admin) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:54.420877 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bd9ccd-4884-4320-a706-9e462872b81d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:54.422573 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bd9ccd-4884-4320-a706-9e462872b81d None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:54.434679 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 368/735] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Mar 30 01:15:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:15:54.436101 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd9ccd-4884-4320-a706-9e462872b81d None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:54.464722 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9cf277-2ab1-4488-aa26-df627f38d813 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:54.501329 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f8fb9d-a931-4d63-8da3-bb0e601594b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:54.501921 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8fb9d-a931-4d63-8da3-bb0e601594b0 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:54.502300 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8fb9d-a931-4d63-8da3-bb0e601594b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:54.502612 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8fb9d-a931-4d63-8da3-bb0e601594b0 None admin] PATH_INFO: `/v3/users` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:54.504171 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f8fb9d-a931-4d63-8da3-bb0e601594b0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:54.504392 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f8fb9d-a931-4d63-8da3-bb0e601594b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:54.505828 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f8fb9d-a931-4d63-8da3-bb0e601594b0 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:54.524997 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 368/736] 10.222.0.30 () {56 vars in 1133 bytes} [Wed Mar 30 01:15:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:54.525737 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f8fb9d-a931-4d63-8da3-bb0e601594b0 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:54.547180 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd9ccd-4884-4320-a706-9e462872b81d None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:54.582521 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415fe374-2399-4bcd-94ec-038676d02d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:54.583603 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415fe374-2399-4bcd-94ec-038676d02d27 None admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:54.584089 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415fe374-2399-4bcd-94ec-038676d02d27 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:54.584563 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415fe374-2399-4bcd-94ec-038676d02d27 None admin] PATH_INFO: `/v3/services` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:54.585498 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415fe374-2399-4bcd-94ec-038676d02d27 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:54.587117 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415fe374-2399-4bcd-94ec-038676d02d27 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:54.604457 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 369/737] 10.222.0.30 () {60 vars in 1141 bytes} [Wed Mar 30 01:15:54 2022] POST /identity/v3/services => generated 251 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:15:54.605622 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415fe374-2399-4bcd-94ec-038676d02d27 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:54.652306 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f8fb9d-a931-4d63-8da3-bb0e601594b0 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:54.724121 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429d6a99-7d56-48a5-bb57-7138d74fc31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:54.724629 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415fe374-2399-4bcd-94ec-038676d02d27 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:54.724975 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d6a99-7d56-48a5-bb57-7138d74fc31a None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:54.725262 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d6a99-7d56-48a5-bb57-7138d74fc31a None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:54.725539 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d6a99-7d56-48a5-bb57-7138d74fc31a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:54.748222 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429d6a99-7d56-48a5-bb57-7138d74fc31a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:54.749704 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429d6a99-7d56-48a5-bb57-7138d74fc31a None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:54.762902 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d91992d-ea94-447c-870a-c8d61bb87d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:54.764146 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d91992d-ea94-447c-870a-c8d61bb87d43 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:54.764647 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d91992d-ea94-447c-870a-c8d61bb87d43 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:54.765120 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d91992d-ea94-447c-870a-c8d61bb87d43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:54.777756 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d91992d-ea94-447c-870a-c8d61bb87d43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:54.779650 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d91992d-ea94-447c-870a-c8d61bb87d43 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:54.782953 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-429d6a99-7d56-48a5-bb57-7138d74fc31a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:15:54.785072 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 369/738] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:15:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:54.790390 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429d6a99-7d56-48a5-bb57-7138d74fc31a None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:54.801153 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-0d91992d-ea94-447c-870a-c8d61bb87d43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:15:54.803361 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 370/739] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:15:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:54.810096 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d91992d-ea94-447c-870a-c8d61bb87d43 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:54.962866 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429d6a99-7d56-48a5-bb57-7138d74fc31a None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:54.999680 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d91992d-ea94-447c-870a-c8d61bb87d43 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:55.000191 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f6660c-705d-4744-af5b-68ca07c48293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:55.000472 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f6660c-705d-4744-af5b-68ca07c48293 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:55.000638 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f6660c-705d-4744-af5b-68ca07c48293 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:55.000888 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f6660c-705d-4744-af5b-68ca07c48293 None admin] PATH_INFO: `/v3/domains` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:55.001610 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f6660c-705d-4744-af5b-68ca07c48293 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:55.001914 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f6660c-705d-4744-af5b-68ca07c48293 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:55.004189 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f6660c-705d-4744-af5b-68ca07c48293 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:55.016019 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 370/740] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:15:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:55.024642 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f6660c-705d-4744-af5b-68ca07c48293 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:55.039396 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcb8564-15d4-45b4-a60e-cf4d6585075a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:55.040065 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb8564-15d4-45b4-a60e-cf4d6585075a None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:55.040347 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb8564-15d4-45b4-a60e-cf4d6585075a None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:55.040794 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb8564-15d4-45b4-a60e-cf4d6585075a None admin] PATH_INFO: `/v3/domains` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:55.041888 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcb8564-15d4-45b4-a60e-cf4d6585075a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:55.042197 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcb8564-15d4-45b4-a60e-cf4d6585075a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:55.044020 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcb8564-15d4-45b4-a60e-cf4d6585075a None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:55.059431 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 371/741] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:15:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:55.064436 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcb8564-15d4-45b4-a60e-cf4d6585075a None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:55.134450 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f6660c-705d-4744-af5b-68ca07c48293 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:55.182208 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6800cfb0-e9f9-43bb-bb62-9b057304ee12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:55.182575 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcb8564-15d4-45b4-a60e-cf4d6585075a None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:55.183037 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800cfb0-e9f9-43bb-bb62-9b057304ee12 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:55.183313 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800cfb0-e9f9-43bb-bb62-9b057304ee12 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:55.183586 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800cfb0-e9f9-43bb-bb62-9b057304ee12 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:55.193064 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6800cfb0-e9f9-43bb-bb62-9b057304ee12 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:55.195150 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6800cfb0-e9f9-43bb-bb62-9b057304ee12 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:55.212745 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-6800cfb0-e9f9-43bb-bb62-9b057304ee12 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 30 01:15:55.214612 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 371/742] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Mar 30 01:15:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 01:15:55.215850 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda75d76-5037-4ee8-b1ed-c208eefdf687 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:55.216131 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda75d76-5037-4ee8-b1ed-c208eefdf687 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:55.216402 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda75d76-5037-4ee8-b1ed-c208eefdf687 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:55.218264 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 372/743] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:15:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:15:55.220663 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda75d76-5037-4ee8-b1ed-c208eefdf687 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:55.222637 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bf16a1-d707-4889-b868-9c5f21671b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:55.223514 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bf16a1-d707-4889-b868-9c5f21671b2a None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:55.223800 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bf16a1-d707-4889-b868-9c5f21671b2a None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:55.224080 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bf16a1-d707-4889-b868-9c5f21671b2a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:55.231367 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bf16a1-d707-4889-b868-9c5f21671b2a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:55.232825 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bf16a1-d707-4889-b868-9c5f21671b2a None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:55.247394 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-f8bf16a1-d707-4889-b868-9c5f21671b2a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 30 01:15:55.248907 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 372/744] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Mar 30 01:15:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:55.250094 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea2e3b-1836-40a1-9e47-206cb29fd656 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:55.250380 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea2e3b-1836-40a1-9e47-206cb29fd656 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:55.250655 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea2e3b-1836-40a1-9e47-206cb29fd656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:55.268050 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-0eea2e3b-1836-40a1-9e47-206cb29fd656 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:15:55.270224 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-0eea2e3b-1836-40a1-9e47-206cb29fd656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:15:55.346025 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 373/745] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:15:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 01:15:55.347243 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea2e3b-1836-40a1-9e47-206cb29fd656 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:55.348725 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda75d76-5037-4ee8-b1ed-c208eefdf687 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:55.394487 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f11a62-47a0-4bbb-91e0-d2c55d42cfbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:55.395433 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f11a62-47a0-4bbb-91e0-d2c55d42cfbe None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:55.395716 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f11a62-47a0-4bbb-91e0-d2c55d42cfbe None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:55.396148 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f11a62-47a0-4bbb-91e0-d2c55d42cfbe None admin] PATH_INFO: `/v3/users` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:55.397281 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f11a62-47a0-4bbb-91e0-d2c55d42cfbe None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:55.397595 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f11a62-47a0-4bbb-91e0-d2c55d42cfbe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:55.399039 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f11a62-47a0-4bbb-91e0-d2c55d42cfbe None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:55.422033 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 373/746] 10.222.0.30 () {56 vars in 1135 bytes} [Wed Mar 30 01:15:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:15:55.422905 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f11a62-47a0-4bbb-91e0-d2c55d42cfbe None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:55.452074 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea2e3b-1836-40a1-9e47-206cb29fd656 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:55.492391 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee686b2-2d8c-4844-a036-312fac1fc5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:55.493356 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee686b2-2d8c-4844-a036-312fac1fc5a7 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:55.493895 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee686b2-2d8c-4844-a036-312fac1fc5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:55.494201 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee686b2-2d8c-4844-a036-312fac1fc5a7 None admin] PATH_INFO: `/v3/projects` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:55.495260 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee686b2-2d8c-4844-a036-312fac1fc5a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:55.495633 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee686b2-2d8c-4844-a036-312fac1fc5a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:55.497719 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee686b2-2d8c-4844-a036-312fac1fc5a7 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:55.512150 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 374/747] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Mar 30 01:15:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:55.513291 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee686b2-2d8c-4844-a036-312fac1fc5a7 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:55.542065 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f11a62-47a0-4bbb-91e0-d2c55d42cfbe None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:55.583110 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6a4e11-cc78-43ae-abcf-b68fa397eaee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:55.584060 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a4e11-cc78-43ae-abcf-b68fa397eaee None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:55.584555 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a4e11-cc78-43ae-abcf-b68fa397eaee None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:55.584855 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a4e11-cc78-43ae-abcf-b68fa397eaee None admin] PATH_INFO: `/v3/roles/service` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:55.598417 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6a4e11-cc78-43ae-abcf-b68fa397eaee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:15:55.606764 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-db6a4e11-cc78-43ae-abcf-b68fa397eaee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 30 01:15:55.613355 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 374/748] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Mar 30 01:15:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:55.614505 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6a4e11-cc78-43ae-abcf-b68fa397eaee None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:55.646457 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee686b2-2d8c-4844-a036-312fac1fc5a7 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:55.683785 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27f5297-4ece-41a7-b1c9-1fd5445e33c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:55.684588 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27f5297-4ece-41a7-b1c9-1fd5445e33c5 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:55.684947 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27f5297-4ece-41a7-b1c9-1fd5445e33c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:55.685300 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27f5297-4ece-41a7-b1c9-1fd5445e33c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:55.733183 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6a4e11-cc78-43ae-abcf-b68fa397eaee None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:55.759363 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27f5297-4ece-41a7-b1c9-1fd5445e33c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:55.761122 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27f5297-4ece-41a7-b1c9-1fd5445e33c5 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:55.769184 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d968654a-0811-4bff-8570-bb7b0964beb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:55.770332 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d968654a-0811-4bff-8570-bb7b0964beb5 None admin] REQUEST_METHOD: `PUT` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:55.770805 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d968654a-0811-4bff-8570-bb7b0964beb5 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:55.771315 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d968654a-0811-4bff-8570-bb7b0964beb5 None admin] PATH_INFO: `/v3/projects/0c9a4444228d4be89a4ba8aa53099531/users/140c6d1a20e94192bde06e72040f162d/roles/36909bbf31d04993bb2a9fe587b572dc` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:55.773519 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d968654a-0811-4bff-8570-bb7b0964beb5 None admin] RBAC: Authorizing `identity:create_grant(project_id=0c9a4444228d4be89a4ba8aa53099531, user_id=140c6d1a20e94192bde06e72040f162d, role_id=36909bbf31d04993bb2a9fe587b572dc)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:55.775167 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d968654a-0811-4bff-8570-bb7b0964beb5 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:55.794821 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 375/749] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Mar 30 01:15:55 2022] PUT /identity/v3/projects/0c9a4444228d4be89a4ba8aa53099531/users/140c6d1a20e94192bde06e72040f162d/roles/36909bbf31d04993bb2a9fe587b572dc => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:15:55.798826 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d968654a-0811-4bff-8570-bb7b0964beb5 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:55.880005 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 375/750] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Mar 30 01:15:55 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 30 01:15:55.881967 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27f5297-4ece-41a7-b1c9-1fd5445e33c5 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:55.994108 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27f5297-4ece-41a7-b1c9-1fd5445e33c5 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:56.002351 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d968654a-0811-4bff-8570-bb7b0964beb5 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:56.039136 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e2990-6229-4c8b-ae87-a6e424433304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:56.041267 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e2990-6229-4c8b-ae87-a6e424433304 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:56.041901 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e2990-6229-4c8b-ae87-a6e424433304 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:56.042575 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e2990-6229-4c8b-ae87-a6e424433304 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:56.060032 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44e2990-6229-4c8b-ae87-a6e424433304 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:56.062795 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44e2990-6229-4c8b-ae87-a6e424433304 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:56.084728 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-c44e2990-6229-4c8b-ae87-a6e424433304 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:15:56.090873 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 376/751] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:15:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:56.092286 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e2990-6229-4c8b-ae87-a6e424433304 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:56.108436 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646da553-e687-4ae4-8084-19df58c6e069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:56.109048 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646da553-e687-4ae4-8084-19df58c6e069 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:56.109336 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646da553-e687-4ae4-8084-19df58c6e069 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:56.109613 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646da553-e687-4ae4-8084-19df58c6e069 None admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:56.110367 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646da553-e687-4ae4-8084-19df58c6e069 None admin] RBAC: Adding query filter params (name=service) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:56.110668 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646da553-e687-4ae4-8084-19df58c6e069 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:56.112106 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646da553-e687-4ae4-8084-19df58c6e069 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:56.124934 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 376/752] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Mar 30 01:15:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:56.134429 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646da553-e687-4ae4-8084-19df58c6e069 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:56.206441 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e2990-6229-4c8b-ae87-a6e424433304 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:56.242683 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c73f67b-d60f-4481-a453-ac0bc6012d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:56.243388 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73f67b-d60f-4481-a453-ac0bc6012d80 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:56.243676 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73f67b-d60f-4481-a453-ac0bc6012d80 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:56.243954 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73f67b-d60f-4481-a453-ac0bc6012d80 None admin] PATH_INFO: `/v3/domains` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:56.244700 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c73f67b-d60f-4481-a453-ac0bc6012d80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:56.245005 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c73f67b-d60f-4481-a453-ac0bc6012d80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:56.250743 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c73f67b-d60f-4481-a453-ac0bc6012d80 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:56.262817 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 377/753] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:15:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:56.264635 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c73f67b-d60f-4481-a453-ac0bc6012d80 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:56.337618 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646da553-e687-4ae4-8084-19df58c6e069 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:56.371772 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c73f67b-d60f-4481-a453-ac0bc6012d80 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:56.406852 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff9b5d-564b-40f5-b515-fad8a296c98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:56.407647 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff9b5d-564b-40f5-b515-fad8a296c98a None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:56.407929 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff9b5d-564b-40f5-b515-fad8a296c98a None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:56.408208 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff9b5d-564b-40f5-b515-fad8a296c98a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:56.415308 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ff9b5d-564b-40f5-b515-fad8a296c98a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:56.416782 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ff9b5d-564b-40f5-b515-fad8a296c98a None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:56.424336 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4398d351-2824-4560-bce0-04bacffb72af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:56.425394 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398d351-2824-4560-bce0-04bacffb72af None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:56.425684 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398d351-2824-4560-bce0-04bacffb72af None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:56.425966 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398d351-2824-4560-bce0-04bacffb72af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:56.431446 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-44ff9b5d-564b-40f5-b515-fad8a296c98a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 30 01:15:56.437324 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 378/754] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Mar 30 01:15:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 01:15:56.438502 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff9b5d-564b-40f5-b515-fad8a296c98a None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:56.446649 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4398d351-2824-4560-bce0-04bacffb72af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:56.448134 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4398d351-2824-4560-bce0-04bacffb72af None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:56.475163 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-4398d351-2824-4560-bce0-04bacffb72af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:15:56.476381 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 377/755] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:15:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 01:15:56.487630 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4398d351-2824-4560-bce0-04bacffb72af None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:56.578565 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff9b5d-564b-40f5-b515-fad8a296c98a None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:56.621851 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dda2952-856b-454f-838f-6adbfbcc67d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:56.623164 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda2952-856b-454f-838f-6adbfbcc67d2 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:56.623790 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda2952-856b-454f-838f-6adbfbcc67d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:56.624344 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda2952-856b-454f-838f-6adbfbcc67d2 None admin] PATH_INFO: `/v3/projects` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:56.625317 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dda2952-856b-454f-838f-6adbfbcc67d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:56.625954 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dda2952-856b-454f-838f-6adbfbcc67d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:56.628883 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dda2952-856b-454f-838f-6adbfbcc67d2 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:56.645806 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4398d351-2824-4560-bce0-04bacffb72af None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:56.646580 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 379/756] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Mar 30 01:15:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:56.648108 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd993a2-3fc5-4a2b-997d-606abfb0e5e2 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:56.648581 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd993a2-3fc5-4a2b-997d-606abfb0e5e2 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:56.649019 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd993a2-3fc5-4a2b-997d-606abfb0e5e2 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:56.651117 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 380/757] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:15:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:15:56.657447 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8106b633-1883-4b2e-ba16-789b18c3301d None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:56.658392 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8106b633-1883-4b2e-ba16-789b18c3301d None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:56.660184 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8106b633-1883-4b2e-ba16-789b18c3301d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:56.681026 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-8106b633-1883-4b2e-ba16-789b18c3301d None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:15:56.682919 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-8106b633-1883-4b2e-ba16-789b18c3301d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:15:56.692804 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe77845-a1b3-440f-aade-157fe939d2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:56.693473 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe77845-a1b3-440f-aade-157fe939d2f0 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:56.693756 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe77845-a1b3-440f-aade-157fe939d2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:56.694031 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe77845-a1b3-440f-aade-157fe939d2f0 None admin] PATH_INFO: `/v3/domains` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:56.694785 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe77845-a1b3-440f-aade-157fe939d2f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:56.695094 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe77845-a1b3-440f-aade-157fe939d2f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:56.696462 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe77845-a1b3-440f-aade-157fe939d2f0 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:56.712122 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 378/758] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:15:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:56.712968 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe77845-a1b3-440f-aade-157fe939d2f0 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:56.774729 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 381/759] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:15:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 30 01:15:56.774729 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8106b633-1883-4b2e-ba16-789b18c3301d None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:56.849336 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe77845-a1b3-440f-aade-157fe939d2f0 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:56.898804 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db1996-664f-4b64-b1c5-95e629f2f8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:56.898804 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db1996-664f-4b64-b1c5-95e629f2f8f3 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:56.898804 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db1996-664f-4b64-b1c5-95e629f2f8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:56.898804 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db1996-664f-4b64-b1c5-95e629f2f8f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:56.899197 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1db1996-664f-4b64-b1c5-95e629f2f8f3 None admin] RBAC: Adding query filter params (role.id=36909bbf31d04993bb2a9fe587b572dc, scope.project.id=0c9a4444228d4be89a4ba8aa53099531, user.id=76f16de81dfb4c14b027cd6cd1e6ff2c) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:56.899197 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1db1996-664f-4b64-b1c5-95e629f2f8f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:56.899197 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1db1996-664f-4b64-b1c5-95e629f2f8f3 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:56.900463 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8106b633-1883-4b2e-ba16-789b18c3301d None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:56.903706 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 379/760] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Mar 30 01:15:56 2022] GET /identity/v3/role_assignments?user.id=76f16de81dfb4c14b027cd6cd1e6ff2c&scope.project.id=0c9a4444228d4be89a4ba8aa53099531&role.id=36909bbf31d04993bb2a9fe587b572dc => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:56.904715 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db1996-664f-4b64-b1c5-95e629f2f8f3 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:56.936236 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a73615-afe7-45a2-8622-f735c9d7e3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:56.937078 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a73615-afe7-45a2-8622-f735c9d7e3f9 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:56.937359 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a73615-afe7-45a2-8622-f735c9d7e3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:56.937632 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a73615-afe7-45a2-8622-f735c9d7e3f9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:56.945456 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a73615-afe7-45a2-8622-f735c9d7e3f9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:56.946941 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a73615-afe7-45a2-8622-f735c9d7e3f9 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:56.962131 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-70a73615-afe7-45a2-8622-f735c9d7e3f9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 30 01:15:56.963720 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 382/761] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Mar 30 01:15:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:56.969427 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a73615-afe7-45a2-8622-f735c9d7e3f9 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:57.077016 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db1996-664f-4b64-b1c5-95e629f2f8f3 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:57.082256 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a73615-afe7-45a2-8622-f735c9d7e3f9 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:57.141155 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b92034-8b21-4e6e-b58c-8a56ed148f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:57.142323 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b92034-8b21-4e6e-b58c-8a56ed148f22 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:57.142843 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b92034-8b21-4e6e-b58c-8a56ed148f22 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:57.143484 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b92034-8b21-4e6e-b58c-8a56ed148f22 None admin] PATH_INFO: `/v3/services/network` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:57.144352 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b92034-8b21-4e6e-b58c-8a56ed148f22 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:57.145944 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b92034-8b21-4e6e-b58c-8a56ed148f22 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:57.156873 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c8e6a2-288c-4ee0-bbb2-5ffdf7ad1613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:57.157927 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c8e6a2-288c-4ee0-bbb2-5ffdf7ad1613 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:57.158429 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c8e6a2-288c-4ee0-bbb2-5ffdf7ad1613 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:57.159536 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c8e6a2-288c-4ee0-bbb2-5ffdf7ad1613 None admin] PATH_INFO: `/v3/users` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:57.163971 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c8e6a2-288c-4ee0-bbb2-5ffdf7ad1613 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:57.164287 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c8e6a2-288c-4ee0-bbb2-5ffdf7ad1613 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:57.165855 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c8e6a2-288c-4ee0-bbb2-5ffdf7ad1613 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:57.170151 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-a2b92034-8b21-4e6e-b58c-8a56ed148f22 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Mar 30 01:15:57.177889 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 380/762] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Mar 30 01:15:56 2022] GET /identity/v3/services/network => generated 88 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:57.179070 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b92034-8b21-4e6e-b58c-8a56ed148f22 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:57.200136 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 383/763] 10.222.0.30 () {56 vars in 1149 bytes} [Wed Mar 30 01:15:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:15:57.205149 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c8e6a2-288c-4ee0-bbb2-5ffdf7ad1613 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:57.367458 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c8e6a2-288c-4ee0-bbb2-5ffdf7ad1613 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:57.404205 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b92034-8b21-4e6e-b58c-8a56ed148f22 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:57.415601 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73751a45-d0a4-4f51-b3a8-f1cfa7f6ee2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:57.416187 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73751a45-d0a4-4f51-b3a8-f1cfa7f6ee2b None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:57.416464 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73751a45-d0a4-4f51-b3a8-f1cfa7f6ee2b None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:57.416732 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73751a45-d0a4-4f51-b3a8-f1cfa7f6ee2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:57.490615 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fbe546-0636-4157-bee2-278361fc794d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:57.491486 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fbe546-0636-4157-bee2-278361fc794d None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:57.491859 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fbe546-0636-4157-bee2-278361fc794d None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:57.492143 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fbe546-0636-4157-bee2-278361fc794d None admin] PATH_INFO: `/v3/services` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:57.492902 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fbe546-0636-4157-bee2-278361fc794d None admin] RBAC: Adding query filter params (name=network) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:57.493212 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fbe546-0636-4157-bee2-278361fc794d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:57.494630 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fbe546-0636-4157-bee2-278361fc794d None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:57.498891 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73751a45-d0a4-4f51-b3a8-f1cfa7f6ee2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:57.500683 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73751a45-d0a4-4f51-b3a8-f1cfa7f6ee2b None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:57.505251 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 381/764] 10.222.0.30 () {56 vars in 1112 bytes} [Wed Mar 30 01:15:57 2022] GET /identity/v3/services?name=network => generated 124 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:57.510590 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fbe546-0636-4157-bee2-278361fc794d None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:57.605931 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 384/765] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Mar 30 01:15:57 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Mar 30 01:15:57.607361 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b36e982-4849-4c34-ad56-50c7882dd08e None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:57.607645 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b36e982-4849-4c34-ad56-50c7882dd08e None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:57.607917 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b36e982-4849-4c34-ad56-50c7882dd08e None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:57.609835 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 385/766] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:15:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:15:57.610540 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b36e982-4849-4c34-ad56-50c7882dd08e None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:57.644411 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fbe546-0636-4157-bee2-278361fc794d None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:57.685815 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064071af-8f15-4a7b-b4ff-590da23bc58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:57.686746 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064071af-8f15-4a7b-b4ff-590da23bc58f None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:57.687177 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064071af-8f15-4a7b-b4ff-590da23bc58f None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:57.687633 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064071af-8f15-4a7b-b4ff-590da23bc58f None admin] PATH_INFO: `/v3/services` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:57.688511 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064071af-8f15-4a7b-b4ff-590da23bc58f None admin] RBAC: Adding query filter params (type=network) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:57.688962 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064071af-8f15-4a7b-b4ff-590da23bc58f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:57.691122 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064071af-8f15-4a7b-b4ff-590da23bc58f None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:57.696719 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 382/767] 10.222.0.30 () {56 vars in 1112 bytes} [Wed Mar 30 01:15:57 2022] GET /identity/v3/services?type=network => generated 350 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:15:57.698261 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62f3f7-a49a-4939-8f03-8dd74875e5a7 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:57.698792 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62f3f7-a49a-4939-8f03-8dd74875e5a7 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:57.699292 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62f3f7-a49a-4939-8f03-8dd74875e5a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:57.713070 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b36e982-4849-4c34-ad56-50c7882dd08e None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:57.717727 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-6d62f3f7-a49a-4939-8f03-8dd74875e5a7 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:15:57.719229 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-6d62f3f7-a49a-4939-8f03-8dd74875e5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:15:57.746896 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630f1fcd-5269-44db-898e-2691dce04f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:57.747705 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f1fcd-5269-44db-898e-2691dce04f90 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:57.748163 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f1fcd-5269-44db-898e-2691dce04f90 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:57.748271 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f1fcd-5269-44db-898e-2691dce04f90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:57.760041 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630f1fcd-5269-44db-898e-2691dce04f90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:57.761493 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630f1fcd-5269-44db-898e-2691dce04f90 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:57.777984 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-630f1fcd-5269-44db-898e-2691dce04f90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:15:57.784345 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 386/768] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:15:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:57.785348 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630f1fcd-5269-44db-898e-2691dce04f90 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:57.792736 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 383/769] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:15:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 01:15:57.793894 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62f3f7-a49a-4939-8f03-8dd74875e5a7 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:57.885824 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630f1fcd-5269-44db-898e-2691dce04f90 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:57.911541 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62f3f7-a49a-4939-8f03-8dd74875e5a7 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:57.920278 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a743e9-1961-4c39-b20c-4fa4ff876903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:57.921426 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a743e9-1961-4c39-b20c-4fa4ff876903 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:57.921426 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a743e9-1961-4c39-b20c-4fa4ff876903 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:57.921599 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a743e9-1961-4c39-b20c-4fa4ff876903 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:57.922477 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a743e9-1961-4c39-b20c-4fa4ff876903 None admin] RBAC: Adding query filter params (interface=public, service_id=cfe7c7cc530e4e34a670fa85871a3717, region_id=RegionOne) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:57.922884 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a743e9-1961-4c39-b20c-4fa4ff876903 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:57.924319 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a743e9-1961-4c39-b20c-4fa4ff876903 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:57.932637 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 387/770] 10.222.0.30 () {56 vars in 1251 bytes} [Wed Mar 30 01:15:57 2022] GET /identity/v3/endpoints?service_id=cfe7c7cc530e4e34a670fa85871a3717&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:57.933680 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a743e9-1961-4c39-b20c-4fa4ff876903 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:57.954519 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd5bde3-c649-4210-9f70-5ba7f21c146d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:57.955476 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd5bde3-c649-4210-9f70-5ba7f21c146d None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:57.956151 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd5bde3-c649-4210-9f70-5ba7f21c146d None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:57.957288 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd5bde3-c649-4210-9f70-5ba7f21c146d None admin] PATH_INFO: `/v3/domains` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:57.958580 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd5bde3-c649-4210-9f70-5ba7f21c146d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:57.959095 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd5bde3-c649-4210-9f70-5ba7f21c146d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:57.961187 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd5bde3-c649-4210-9f70-5ba7f21c146d None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:57.977372 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 384/771] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:15:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:57.979040 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd5bde3-c649-4210-9f70-5ba7f21c146d None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:58.051955 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a743e9-1961-4c39-b20c-4fa4ff876903 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:58.087765 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd5bde3-c649-4210-9f70-5ba7f21c146d None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:58.095147 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd38cec-2b33-4e54-9a9b-7cf064e5f6b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:58.097501 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd38cec-2b33-4e54-9a9b-7cf064e5f6b1 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:58.097939 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd38cec-2b33-4e54-9a9b-7cf064e5f6b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:58.098738 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd38cec-2b33-4e54-9a9b-7cf064e5f6b1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:58.099565 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd38cec-2b33-4e54-9a9b-7cf064e5f6b1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:58.101840 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd38cec-2b33-4e54-9a9b-7cf064e5f6b1 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:58.117982 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-8dd38cec-2b33-4e54-9a9b-7cf064e5f6b1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Mar 30 01:15:58.120452 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 388/772] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Mar 30 01:15:57 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:58.121899 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd38cec-2b33-4e54-9a9b-7cf064e5f6b1 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:58.125623 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c6923-2f27-4593-9d4c-ffb0b050eaed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:58.126975 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c6923-2f27-4593-9d4c-ffb0b050eaed None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:58.126975 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c6923-2f27-4593-9d4c-ffb0b050eaed None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:58.126975 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c6923-2f27-4593-9d4c-ffb0b050eaed None admin] PATH_INFO: `/v3/services` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:58.128444 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6c6923-2f27-4593-9d4c-ffb0b050eaed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:58.130034 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6c6923-2f27-4593-9d4c-ffb0b050eaed None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:58.136338 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 385/773] 10.222.0.30 () {56 vars in 1087 bytes} [Wed Mar 30 01:15:57 2022] GET /identity/v3/services => generated 772 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:58.137343 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c6923-2f27-4593-9d4c-ffb0b050eaed None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:58.296968 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd38cec-2b33-4e54-9a9b-7cf064e5f6b1 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:58.309392 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c6923-2f27-4593-9d4c-ffb0b050eaed None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:58.369878 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9111ef96-6cf1-4f92-9138-dd47a1475d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:58.369878 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111ef96-6cf1-4f92-9138-dd47a1475d15 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:58.369878 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111ef96-6cf1-4f92-9138-dd47a1475d15 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:58.369878 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111ef96-6cf1-4f92-9138-dd47a1475d15 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:58.379867 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9111ef96-6cf1-4f92-9138-dd47a1475d15 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:58.381353 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9111ef96-6cf1-4f92-9138-dd47a1475d15 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:58.382144 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d240c2-71b2-48d8-bd6c-620cc9b470ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:58.386027 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d240c2-71b2-48d8-bd6c-620cc9b470ca None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:58.386027 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d240c2-71b2-48d8-bd6c-620cc9b470ca None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:58.386027 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d240c2-71b2-48d8-bd6c-620cc9b470ca None admin] PATH_INFO: `/v3/services` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:58.386027 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d240c2-71b2-48d8-bd6c-620cc9b470ca None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:58.386027 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d240c2-71b2-48d8-bd6c-620cc9b470ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:58.386403 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d240c2-71b2-48d8-bd6c-620cc9b470ca None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:58.391814 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 386/774] 10.222.0.30 () {56 vars in 1124 bytes} [Wed Mar 30 01:15:58 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:58.400130 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d240c2-71b2-48d8-bd6c-620cc9b470ca None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:58.401143 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-9111ef96-6cf1-4f92-9138-dd47a1475d15 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 30 01:15:58.402620 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 389/775] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Mar 30 01:15:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:58.415361 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9111ef96-6cf1-4f92-9138-dd47a1475d15 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:58.543415 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d240c2-71b2-48d8-bd6c-620cc9b470ca None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:58.558611 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9111ef96-6cf1-4f92-9138-dd47a1475d15 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:58.583946 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30672eb7-b1a9-4645-b6d5-47f17b18d7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:58.584752 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30672eb7-b1a9-4645-b6d5-47f17b18d7e7 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:58.585167 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30672eb7-b1a9-4645-b6d5-47f17b18d7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:58.585443 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30672eb7-b1a9-4645-b6d5-47f17b18d7e7 None admin] PATH_INFO: `/v3/services` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:58.586355 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30672eb7-b1a9-4645-b6d5-47f17b18d7e7 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:58.587035 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30672eb7-b1a9-4645-b6d5-47f17b18d7e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:58.588806 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30672eb7-b1a9-4645-b6d5-47f17b18d7e7 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:58.596261 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 387/776] 10.222.0.30 () {56 vars in 1124 bytes} [Wed Mar 30 01:15:58 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:15:58.597712 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e8d55-2705-4d56-868b-78d0c392202c None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:58.597999 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e8d55-2705-4d56-868b-78d0c392202c None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:58.598275 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e8d55-2705-4d56-868b-78d0c392202c None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:58.600188 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 388/777] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:15:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:15:58.601865 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e8d55-2705-4d56-868b-78d0c392202c None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:58.606166 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b423e665-ede0-415c-9d53-048850edd78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:58.606884 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b423e665-ede0-415c-9d53-048850edd78d None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:58.607171 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b423e665-ede0-415c-9d53-048850edd78d None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:58.607448 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b423e665-ede0-415c-9d53-048850edd78d None admin] PATH_INFO: `/v3/projects` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:58.608251 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b423e665-ede0-415c-9d53-048850edd78d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:58.608556 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b423e665-ede0-415c-9d53-048850edd78d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:58.609997 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b423e665-ede0-415c-9d53-048850edd78d None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:58.626786 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 390/778] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Mar 30 01:15:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:58.628328 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa13f4-2f6e-4d27-81b6-d0226708c25e None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:58.628711 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa13f4-2f6e-4d27-81b6-d0226708c25e None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:58.629081 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa13f4-2f6e-4d27-81b6-d0226708c25e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:58.649723 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-50fa13f4-2f6e-4d27-81b6-d0226708c25e None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:15:58.653120 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-50fa13f4-2f6e-4d27-81b6-d0226708c25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:15:58.713678 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e8d55-2705-4d56-868b-78d0c392202c None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:58.723952 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 391/779] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:15:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 01:15:58.724895 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa13f4-2f6e-4d27-81b6-d0226708c25e None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:58.772122 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245351ab-a0f0-4b3a-a0b0-f44a72bd88ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:58.772789 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245351ab-a0f0-4b3a-a0b0-f44a72bd88ab None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:58.773075 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245351ab-a0f0-4b3a-a0b0-f44a72bd88ab None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:58.773358 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245351ab-a0f0-4b3a-a0b0-f44a72bd88ab None admin] PATH_INFO: `/v3/endpoints` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:58.774151 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245351ab-a0f0-4b3a-a0b0-f44a72bd88ab None admin] RBAC: Adding query filter params (interface=public, service_id=15a1c2244c184e60ad3f83145708f6e4, region_id=RegionOne) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:58.774467 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245351ab-a0f0-4b3a-a0b0-f44a72bd88ab None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:58.775886 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245351ab-a0f0-4b3a-a0b0-f44a72bd88ab None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:58.788424 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 389/780] 10.222.0.30 () {56 vars in 1251 bytes} [Wed Mar 30 01:15:58 2022] GET /identity/v3/endpoints?service_id=15a1c2244c184e60ad3f83145708f6e4&interface=public®ion_id=RegionOne => generated 194 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:15:58.789318 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245351ab-a0f0-4b3a-a0b0-f44a72bd88ab None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:58.825163 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa13f4-2f6e-4d27-81b6-d0226708c25e None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:58.861539 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4198b88-0386-4577-93bf-1d1dd137a075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:58.862345 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4198b88-0386-4577-93bf-1d1dd137a075 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:58.862664 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4198b88-0386-4577-93bf-1d1dd137a075 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:58.862987 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4198b88-0386-4577-93bf-1d1dd137a075 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:58.863820 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4198b88-0386-4577-93bf-1d1dd137a075 None admin] RBAC: Adding query filter params (role.id=4121aef9b31c4671aebb65fda1c11185, scope.project.id=0c9a4444228d4be89a4ba8aa53099531, user.id=0503fdca7f834ef0a81422804dc74812) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:58.864570 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4198b88-0386-4577-93bf-1d1dd137a075 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:58.866474 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4198b88-0386-4577-93bf-1d1dd137a075 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:58.873486 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 392/781] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Mar 30 01:15:58 2022] GET /identity/v3/role_assignments?user.id=0503fdca7f834ef0a81422804dc74812&scope.project.id=0c9a4444228d4be89a4ba8aa53099531&role.id=4121aef9b31c4671aebb65fda1c11185 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:58.874587 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4198b88-0386-4577-93bf-1d1dd137a075 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:58.894386 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245351ab-a0f0-4b3a-a0b0-f44a72bd88ab None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:58.938399 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0bff28-042d-46c5-8eff-ecc2d9cdb418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:58.939886 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0bff28-042d-46c5-8eff-ecc2d9cdb418 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:58.940795 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0bff28-042d-46c5-8eff-ecc2d9cdb418 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:58.941176 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0bff28-042d-46c5-8eff-ecc2d9cdb418 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:58.955948 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0bff28-042d-46c5-8eff-ecc2d9cdb418 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:15:58.963869 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-fc0bff28-042d-46c5-8eff-ecc2d9cdb418 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 30 01:15:58.965532 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 390/782] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Mar 30 01:15:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:58.979796 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0bff28-042d-46c5-8eff-ecc2d9cdb418 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:59.011300 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4198b88-0386-4577-93bf-1d1dd137a075 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:59.052437 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ac874-54f6-4975-8856-63580e1cf405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:59.053175 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ac874-54f6-4975-8856-63580e1cf405 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:59.053466 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ac874-54f6-4975-8856-63580e1cf405 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:59.053748 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ac874-54f6-4975-8856-63580e1cf405 None admin] PATH_INFO: `/v3/services` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:59.054441 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69ac874-54f6-4975-8856-63580e1cf405 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:59.056321 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69ac874-54f6-4975-8856-63580e1cf405 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:59.062667 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 393/783] 10.222.0.30 () {56 vars in 1087 bytes} [Wed Mar 30 01:15:58 2022] GET /identity/v3/services => generated 772 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:59.162184 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0bff28-042d-46c5-8eff-ecc2d9cdb418 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:59.201811 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef6c39-9ebd-4cd5-9b64-5169a1e8a3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:59.202494 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef6c39-9ebd-4cd5-9b64-5169a1e8a3d8 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:59.202807 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef6c39-9ebd-4cd5-9b64-5169a1e8a3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:59.203090 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef6c39-9ebd-4cd5-9b64-5169a1e8a3d8 None admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:59.203850 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ef6c39-9ebd-4cd5-9b64-5169a1e8a3d8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:59.204156 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ef6c39-9ebd-4cd5-9b64-5169a1e8a3d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:59.205539 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ef6c39-9ebd-4cd5-9b64-5169a1e8a3d8 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:59.215997 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 391/784] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Mar 30 01:15:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:59.222212 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ac874-54f6-4975-8856-63580e1cf405 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:59.331714 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ac874-54f6-4975-8856-63580e1cf405 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:59.367966 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7e92a-4c6b-49ec-abb0-6f239f594e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:59.368763 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7e92a-4c6b-49ec-abb0-6f239f594e96 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:59.369040 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7e92a-4c6b-49ec-abb0-6f239f594e96 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:59.369312 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7e92a-4c6b-49ec-abb0-6f239f594e96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:59.380203 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae7e92a-4c6b-49ec-abb0-6f239f594e96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:59.381692 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae7e92a-4c6b-49ec-abb0-6f239f594e96 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:59.398766 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-1ae7e92a-4c6b-49ec-abb0-6f239f594e96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:15:59.400356 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 394/785] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:15:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:15:59.406131 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef6c39-9ebd-4cd5-9b64-5169a1e8a3d8 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:59.519387 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef6c39-9ebd-4cd5-9b64-5169a1e8a3d8 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:59.558983 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d6989d-d5b7-424f-9305-a3685444b99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:59.559641 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6989d-d5b7-424f-9305-a3685444b99e None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:59.559922 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6989d-d5b7-424f-9305-a3685444b99e None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:59.560196 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6989d-d5b7-424f-9305-a3685444b99e None admin] PATH_INFO: `/v3/domains` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:59.560910 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d6989d-d5b7-424f-9305-a3685444b99e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:15:59.561210 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d6989d-d5b7-424f-9305-a3685444b99e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:59.562559 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d6989d-d5b7-424f-9305-a3685444b99e None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:59.574722 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 392/786] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:15:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:15:59.579720 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7e92a-4c6b-49ec-abb0-6f239f594e96 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:59.592480 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214e2b1-80b3-4932-9bd3-acd0ad7dbcdc None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:59.592750 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214e2b1-80b3-4932-9bd3-acd0ad7dbcdc None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:59.593020 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214e2b1-80b3-4932-9bd3-acd0ad7dbcdc None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:59.599322 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 393/787] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:15:59 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:15:59.600460 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee749a14-35cf-4f09-8035-fcca31d6bf21 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:59.600746 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee749a14-35cf-4f09-8035-fcca31d6bf21 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:59.601019 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee749a14-35cf-4f09-8035-fcca31d6bf21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:59.637494 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-ee749a14-35cf-4f09-8035-fcca31d6bf21 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:15:59.638712 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-ee749a14-35cf-4f09-8035-fcca31d6bf21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:15:59.714402 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7e92a-4c6b-49ec-abb0-6f239f594e96 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:59.728885 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 394/788] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:15:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 01:15:59.767304 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa6bd2e-6331-42fa-a9de-78bd7f518ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:59.768626 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa6bd2e-6331-42fa-a9de-78bd7f518ad7 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:59.768916 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa6bd2e-6331-42fa-a9de-78bd7f518ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:59.769190 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa6bd2e-6331-42fa-a9de-78bd7f518ad7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:59.775506 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee749a14-35cf-4f09-8035-fcca31d6bf21 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:59.788704 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa6bd2e-6331-42fa-a9de-78bd7f518ad7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:15:59.790190 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa6bd2e-6331-42fa-a9de-78bd7f518ad7 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:15:59.814264 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-1aa6bd2e-6331-42fa-a9de-78bd7f518ad7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 30 01:15:59.823910 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 395/789] 10.222.0.30 () {56 vars in 1093 bytes} [Wed Mar 30 01:15:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 01:15:59.832687 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa6bd2e-6331-42fa-a9de-78bd7f518ad7 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:15:59.891982 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee749a14-35cf-4f09-8035-fcca31d6bf21 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:15:59.928083 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734beb83-7f4a-4022-bb82-0d6a2db7c1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:15:59.928884 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734beb83-7f4a-4022-bb82-0d6a2db7c1f5 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:15:59.929168 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734beb83-7f4a-4022-bb82-0d6a2db7c1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:15:59.929445 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734beb83-7f4a-4022-bb82-0d6a2db7c1f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:15:59.939842 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734beb83-7f4a-4022-bb82-0d6a2db7c1f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:15:59.946838 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-734beb83-7f4a-4022-bb82-0d6a2db7c1f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 30 01:15:59.953929 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 395/790] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Mar 30 01:15:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 01:15:59.955047 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734beb83-7f4a-4022-bb82-0d6a2db7c1f5 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:00.006319 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa6bd2e-6331-42fa-a9de-78bd7f518ad7 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:00.044625 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a5156d-5d1e-4827-9f61-b90246a4b462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:00.045299 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a5156d-5d1e-4827-9f61-b90246a4b462 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:00.045579 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a5156d-5d1e-4827-9f61-b90246a4b462 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:00.045850 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a5156d-5d1e-4827-9f61-b90246a4b462 None admin] PATH_INFO: `/v3/users` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:00.046677 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a5156d-5d1e-4827-9f61-b90246a4b462 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:00.047006 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a5156d-5d1e-4827-9f61-b90246a4b462 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:00.050740 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a5156d-5d1e-4827-9f61-b90246a4b462 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:00.068040 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 396/791] 10.222.0.30 () {56 vars in 1133 bytes} [Wed Mar 30 01:15:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:00.075697 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a5156d-5d1e-4827-9f61-b90246a4b462 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:00.145853 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734beb83-7f4a-4022-bb82-0d6a2db7c1f5 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:00.216329 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdec25b-dd48-423b-8825-e62b2ec9617f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:00.217007 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdec25b-dd48-423b-8825-e62b2ec9617f None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:00.217264 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdec25b-dd48-423b-8825-e62b2ec9617f None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:00.217537 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdec25b-dd48-423b-8825-e62b2ec9617f None admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:00.218281 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdec25b-dd48-423b-8825-e62b2ec9617f None admin] RBAC: Adding query filter params (name=admin) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:00.218584 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdec25b-dd48-423b-8825-e62b2ec9617f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:00.220015 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdec25b-dd48-423b-8825-e62b2ec9617f None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:00.222833 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a5156d-5d1e-4827-9f61-b90246a4b462 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:00.238848 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 396/792] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Mar 30 01:15:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:16:00.244711 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdec25b-dd48-423b-8825-e62b2ec9617f None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:00.259273 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eaa976-3f5d-4963-8bf1-1d9c820e1652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:00.260238 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eaa976-3f5d-4963-8bf1-1d9c820e1652 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:00.260669 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eaa976-3f5d-4963-8bf1-1d9c820e1652 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:00.261115 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eaa976-3f5d-4963-8bf1-1d9c820e1652 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:00.332688 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eaa976-3f5d-4963-8bf1-1d9c820e1652 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:00.334411 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eaa976-3f5d-4963-8bf1-1d9c820e1652 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:00.419615 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdec25b-dd48-423b-8825-e62b2ec9617f None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:00.437971 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 397/793] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Mar 30 01:16:00 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 30 01:16:00.444460 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eaa976-3f5d-4963-8bf1-1d9c820e1652 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:00.453197 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036df0cd-6157-49e1-9cfd-e46a8b59e1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:00.453987 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036df0cd-6157-49e1-9cfd-e46a8b59e1e3 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:00.454264 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036df0cd-6157-49e1-9cfd-e46a8b59e1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:00.454550 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036df0cd-6157-49e1-9cfd-e46a8b59e1e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:00.482265 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036df0cd-6157-49e1-9cfd-e46a8b59e1e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:00.483760 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036df0cd-6157-49e1-9cfd-e46a8b59e1e3 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:00.506414 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-036df0cd-6157-49e1-9cfd-e46a8b59e1e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:16:00.514928 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 397/794] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:16:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:16:00.515804 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036df0cd-6157-49e1-9cfd-e46a8b59e1e3 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:00.548817 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eaa976-3f5d-4963-8bf1-1d9c820e1652 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:00.627571 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d6fe0a-ebb9-4304-88c1-fa836ac4e382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:00.628396 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d6fe0a-ebb9-4304-88c1-fa836ac4e382 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:00.628673 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d6fe0a-ebb9-4304-88c1-fa836ac4e382 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:00.628938 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d6fe0a-ebb9-4304-88c1-fa836ac4e382 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:00.653549 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d6fe0a-ebb9-4304-88c1-fa836ac4e382 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:00.655291 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d6fe0a-ebb9-4304-88c1-fa836ac4e382 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:00.665526 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036df0cd-6157-49e1-9cfd-e46a8b59e1e3 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:00.687168 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-69d6fe0a-ebb9-4304-88c1-fa836ac4e382 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:16:00.693268 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 398/795] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:16:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 01:16:00.699613 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d6fe0a-ebb9-4304-88c1-fa836ac4e382 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:00.701322 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0a8baf-a5a6-4f39-abe9-62b28fab0f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:00.701982 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a8baf-a5a6-4f39-abe9-62b28fab0f1f None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:00.702282 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a8baf-a5a6-4f39-abe9-62b28fab0f1f None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:00.702533 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a8baf-a5a6-4f39-abe9-62b28fab0f1f None admin] PATH_INFO: `/v3/domains` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:00.703281 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0a8baf-a5a6-4f39-abe9-62b28fab0f1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:00.703583 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0a8baf-a5a6-4f39-abe9-62b28fab0f1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:00.704948 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0a8baf-a5a6-4f39-abe9-62b28fab0f1f None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:00.717583 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 398/796] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:16:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:00.723234 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0a8baf-a5a6-4f39-abe9-62b28fab0f1f None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:00.852055 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d6fe0a-ebb9-4304-88c1-fa836ac4e382 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:00.916949 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0a8baf-a5a6-4f39-abe9-62b28fab0f1f None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:00.918840 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6fb433-bd83-4373-bf42-69e1421bf55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:00.919503 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6fb433-bd83-4373-bf42-69e1421bf55d None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:00.919781 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6fb433-bd83-4373-bf42-69e1421bf55d None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:00.920051 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6fb433-bd83-4373-bf42-69e1421bf55d None admin] PATH_INFO: `/v3/domains` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:00.920767 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6fb433-bd83-4373-bf42-69e1421bf55d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:00.921067 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6fb433-bd83-4373-bf42-69e1421bf55d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:00.922439 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6fb433-bd83-4373-bf42-69e1421bf55d None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:00.944538 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 399/797] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:16:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:00.945755 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6fb433-bd83-4373-bf42-69e1421bf55d None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:00.996808 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c87e3e2-c1cd-42dc-b643-d437a5323740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:00.997606 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87e3e2-c1cd-42dc-b643-d437a5323740 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:00.997886 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87e3e2-c1cd-42dc-b643-d437a5323740 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:00.998156 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87e3e2-c1cd-42dc-b643-d437a5323740 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:01.009774 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c87e3e2-c1cd-42dc-b643-d437a5323740 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:01.011252 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c87e3e2-c1cd-42dc-b643-d437a5323740 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:01.040837 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-7c87e3e2-c1cd-42dc-b643-d437a5323740 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 30 01:16:01.042366 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 399/798] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Mar 30 01:16:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:16:01.049127 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6fb433-bd83-4373-bf42-69e1421bf55d None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:01.059009 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce6ff76-878e-4687-972f-e393b6df4e17 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:01.059293 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce6ff76-878e-4687-972f-e393b6df4e17 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:01.059573 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce6ff76-878e-4687-972f-e393b6df4e17 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:01.061565 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 400/799] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:16:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 01:16:01.062263 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce6ff76-878e-4687-972f-e393b6df4e17 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:01.084646 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a996f-5043-4fa9-82b9-02a157ada6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:01.085501 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a996f-5043-4fa9-82b9-02a157ada6bb None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:01.085785 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a996f-5043-4fa9-82b9-02a157ada6bb None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:01.086056 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a996f-5043-4fa9-82b9-02a157ada6bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:01.093079 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261a996f-5043-4fa9-82b9-02a157ada6bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:01.094564 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261a996f-5043-4fa9-82b9-02a157ada6bb None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:01.108879 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-261a996f-5043-4fa9-82b9-02a157ada6bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 30 01:16:01.114891 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 400/800] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Mar 30 01:16:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:16:01.116258 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63f884-7bea-4fd3-a4ac-ca666069eeb8 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:01.116541 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63f884-7bea-4fd3-a4ac-ca666069eeb8 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:01.116820 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63f884-7bea-4fd3-a4ac-ca666069eeb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:01.134422 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-7a63f884-7bea-4fd3-a4ac-ca666069eeb8 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:16:01.135651 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-7a63f884-7bea-4fd3-a4ac-ca666069eeb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:16:01.170060 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce6ff76-878e-4687-972f-e393b6df4e17 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:01.204813 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c638f8-1c34-4770-9768-9c9aa03f875a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:01.205272 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 401/801] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:16:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 01:16:01.205513 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c638f8-1c34-4770-9768-9c9aa03f875a None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:01.205805 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c638f8-1c34-4770-9768-9c9aa03f875a None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:01.206080 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c638f8-1c34-4770-9768-9c9aa03f875a None admin] PATH_INFO: `/v3/users` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:01.206366 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a63f884-7bea-4fd3-a4ac-ca666069eeb8 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:01.206937 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c638f8-1c34-4770-9768-9c9aa03f875a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:01.207246 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c638f8-1c34-4770-9768-9c9aa03f875a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:01.208668 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c638f8-1c34-4770-9768-9c9aa03f875a None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:01.234808 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 401/802] 10.222.0.30 () {56 vars in 1135 bytes} [Wed Mar 30 01:16:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:01.241033 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c638f8-1c34-4770-9768-9c9aa03f875a None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:01.320101 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a63f884-7bea-4fd3-a4ac-ca666069eeb8 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:01.353108 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c638f8-1c34-4770-9768-9c9aa03f875a None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:01.357432 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b0990a-d94d-4804-a429-1cce35afb5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:01.358454 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b0990a-d94d-4804-a429-1cce35afb5e7 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:01.358993 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b0990a-d94d-4804-a429-1cce35afb5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:01.359464 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b0990a-d94d-4804-a429-1cce35afb5e7 None admin] PATH_INFO: `/v3/projects` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:01.360457 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b0990a-d94d-4804-a429-1cce35afb5e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:01.361000 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b0990a-d94d-4804-a429-1cce35afb5e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:01.363475 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b0990a-d94d-4804-a429-1cce35afb5e7 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:01.381096 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 402/803] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Mar 30 01:16:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:01.382334 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b0990a-d94d-4804-a429-1cce35afb5e7 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:01.392747 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d1ec14-acea-4203-b192-97b8b3d876e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:01.395154 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d1ec14-acea-4203-b192-97b8b3d876e2 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:01.395655 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d1ec14-acea-4203-b192-97b8b3d876e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:01.396447 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d1ec14-acea-4203-b192-97b8b3d876e2 None admin] PATH_INFO: `/v3/services/network` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:01.397590 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d1ec14-acea-4203-b192-97b8b3d876e2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:01.399730 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d1ec14-acea-4203-b192-97b8b3d876e2 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:01.414310 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-28d1ec14-acea-4203-b192-97b8b3d876e2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Mar 30 01:16:01.416839 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 402/804] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Mar 30 01:16:01 2022] GET /identity/v3/services/network => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:16:01.417795 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d1ec14-acea-4203-b192-97b8b3d876e2 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:01.505026 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b0990a-d94d-4804-a429-1cce35afb5e7 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:01.546399 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f2ed3f-ec2f-492f-8d8b-cf5550e7a1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:01.547247 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f2ed3f-ec2f-492f-8d8b-cf5550e7a1a3 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:01.547529 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f2ed3f-ec2f-492f-8d8b-cf5550e7a1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:01.547804 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f2ed3f-ec2f-492f-8d8b-cf5550e7a1a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:01.549899 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d1ec14-acea-4203-b192-97b8b3d876e2 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:01.560498 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f2ed3f-ec2f-492f-8d8b-cf5550e7a1a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:01.562632 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f2ed3f-ec2f-492f-8d8b-cf5550e7a1a3 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:01.583949 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-26f2ed3f-ec2f-492f-8d8b-cf5550e7a1a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:16:01.589659 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 403/805] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:16:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:16:01.589659 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f2ed3f-ec2f-492f-8d8b-cf5550e7a1a3 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:01.593545 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd501ab-860f-49e5-9443-5543965fdee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:01.594471 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd501ab-860f-49e5-9443-5543965fdee0 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:01.594973 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd501ab-860f-49e5-9443-5543965fdee0 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:01.595457 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd501ab-860f-49e5-9443-5543965fdee0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:01.597056 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd501ab-860f-49e5-9443-5543965fdee0 None admin] RBAC: Adding query filter params (role.id=36909bbf31d04993bb2a9fe587b572dc, scope.project.id=0c9a4444228d4be89a4ba8aa53099531, user.id=140c6d1a20e94192bde06e72040f162d) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:01.597571 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd501ab-860f-49e5-9443-5543965fdee0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:01.600066 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd501ab-860f-49e5-9443-5543965fdee0 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:01.613709 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 403/806] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Mar 30 01:16:01 2022] GET /identity/v3/role_assignments?user.id=140c6d1a20e94192bde06e72040f162d&scope.project.id=0c9a4444228d4be89a4ba8aa53099531&role.id=36909bbf31d04993bb2a9fe587b572dc => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:01.613709 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd501ab-860f-49e5-9443-5543965fdee0 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:01.749710 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f2ed3f-ec2f-492f-8d8b-cf5550e7a1a3 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:01.790098 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd501ab-860f-49e5-9443-5543965fdee0 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:01.793841 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f997483-1433-4a91-9628-6313b23c49e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:01.794542 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f997483-1433-4a91-9628-6313b23c49e0 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:01.794862 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f997483-1433-4a91-9628-6313b23c49e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:01.795144 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f997483-1433-4a91-9628-6313b23c49e0 None admin] PATH_INFO: `/v3/services` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:01.795864 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f997483-1433-4a91-9628-6313b23c49e0 None admin] RBAC: Adding query filter params (name=network) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:01.796173 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f997483-1433-4a91-9628-6313b23c49e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:01.797579 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f997483-1433-4a91-9628-6313b23c49e0 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:01.805318 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 404/807] 10.222.0.30 () {56 vars in 1112 bytes} [Wed Mar 30 01:16:01 2022] GET /identity/v3/services?name=network => generated 124 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:01.806731 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942491f-d50f-497e-8a9a-f7e68ba62937 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:01.807035 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942491f-d50f-497e-8a9a-f7e68ba62937 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:01.807317 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942491f-d50f-497e-8a9a-f7e68ba62937 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:01.810800 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 405/808] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:16:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:16:01.811661 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a942491f-d50f-497e-8a9a-f7e68ba62937 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:01.835681 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41300100-cb8a-4c27-9170-50f61ca1a556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:01.836342 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41300100-cb8a-4c27-9170-50f61ca1a556 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:01.836622 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41300100-cb8a-4c27-9170-50f61ca1a556 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:01.836898 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41300100-cb8a-4c27-9170-50f61ca1a556 None admin] PATH_INFO: `/v3/domains` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:01.837611 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41300100-cb8a-4c27-9170-50f61ca1a556 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:01.837910 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41300100-cb8a-4c27-9170-50f61ca1a556 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:01.839371 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41300100-cb8a-4c27-9170-50f61ca1a556 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:01.852138 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 404/809] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:16:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:01.853410 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106a4dac-e109-49ef-b6b8-09d2c1016431 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:01.853696 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106a4dac-e109-49ef-b6b8-09d2c1016431 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:01.853969 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106a4dac-e109-49ef-b6b8-09d2c1016431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:01.871013 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-106a4dac-e109-49ef-b6b8-09d2c1016431 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:16:01.872217 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-106a4dac-e109-49ef-b6b8-09d2c1016431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:16:01.931931 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a942491f-d50f-497e-8a9a-f7e68ba62937 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:01.942543 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 405/810] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:16:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 01:16:01.943956 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268031e6-766f-4d43-bf9c-8b59852eb336 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:01.944251 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268031e6-766f-4d43-bf9c-8b59852eb336 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:01.944530 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268031e6-766f-4d43-bf9c-8b59852eb336 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:01.946337 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 406/811] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:16:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:16:01.947517 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268031e6-766f-4d43-bf9c-8b59852eb336 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:01.978569 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710cc0e2-9e2d-4e24-9791-d4fa7c22867e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:01.979263 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710cc0e2-9e2d-4e24-9791-d4fa7c22867e None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:01.979551 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710cc0e2-9e2d-4e24-9791-d4fa7c22867e None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:01.979827 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710cc0e2-9e2d-4e24-9791-d4fa7c22867e None admin] PATH_INFO: `/v3/services` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:01.980536 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710cc0e2-9e2d-4e24-9791-d4fa7c22867e None admin] RBAC: Adding query filter params (type=network) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:01.980833 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710cc0e2-9e2d-4e24-9791-d4fa7c22867e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:01.982198 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710cc0e2-9e2d-4e24-9791-d4fa7c22867e None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:01.987911 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 406/812] 10.222.0.30 () {56 vars in 1112 bytes} [Wed Mar 30 01:16:01 2022] GET /identity/v3/services?type=network => generated 350 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:01.992588 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4c875-c034-4240-be0a-f594c75aa287 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:01.992588 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4c875-c034-4240-be0a-f594c75aa287 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:01.992588 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4c875-c034-4240-be0a-f594c75aa287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:02.007645 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-9ed4c875-c034-4240-be0a-f594c75aa287 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:16:02.008811 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-9ed4c875-c034-4240-be0a-f594c75aa287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:16:02.054315 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268031e6-766f-4d43-bf9c-8b59852eb336 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:02.078731 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 407/813] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:16:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 01:16:02.078731 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed4c875-c034-4240-be0a-f594c75aa287 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:02.101218 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8254e3-7617-4262-bd01-6c2ef5c4cf0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:02.102060 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8254e3-7617-4262-bd01-6c2ef5c4cf0f None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:02.102371 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8254e3-7617-4262-bd01-6c2ef5c4cf0f None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:02.102658 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8254e3-7617-4262-bd01-6c2ef5c4cf0f None admin] PATH_INFO: `/v3/projects/service` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:02.109527 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8254e3-7617-4262-bd01-6c2ef5c4cf0f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:02.111034 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8254e3-7617-4262-bd01-6c2ef5c4cf0f None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:02.124547 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-5e8254e3-7617-4262-bd01-6c2ef5c4cf0f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 30 01:16:02.125752 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 407/814] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Mar 30 01:16:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:16:02.126489 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8254e3-7617-4262-bd01-6c2ef5c4cf0f None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:02.180768 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed4c875-c034-4240-be0a-f594c75aa287 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:02.221134 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c4887-504f-4d85-9ffa-569eca3028a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:02.221715 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8254e3-7617-4262-bd01-6c2ef5c4cf0f None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:02.221961 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c4887-504f-4d85-9ffa-569eca3028a7 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:02.222238 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c4887-504f-4d85-9ffa-569eca3028a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:02.222507 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c4887-504f-4d85-9ffa-569eca3028a7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:02.232429 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0c4887-504f-4d85-9ffa-569eca3028a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:16:02.239788 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-5c0c4887-504f-4d85-9ffa-569eca3028a7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 30 01:16:02.241160 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 408/815] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Mar 30 01:16:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:16:02.241723 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c4887-504f-4d85-9ffa-569eca3028a7 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:02.256866 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e894f19-0f4e-4ad2-90db-a20217cdc83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:02.257512 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e894f19-0f4e-4ad2-90db-a20217cdc83d None admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:02.258000 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e894f19-0f4e-4ad2-90db-a20217cdc83d None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:02.258108 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e894f19-0f4e-4ad2-90db-a20217cdc83d None admin] PATH_INFO: `/v3/endpoints` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:02.258781 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e894f19-0f4e-4ad2-90db-a20217cdc83d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:02.260163 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e894f19-0f4e-4ad2-90db-a20217cdc83d None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:02.282919 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 408/816] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Mar 30 01:16:02 2022] POST /identity/v3/endpoints => generated 327 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:16:02.284301 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e894f19-0f4e-4ad2-90db-a20217cdc83d None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:02.360963 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c4887-504f-4d85-9ffa-569eca3028a7 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:02.407027 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c4e96-87fc-4b68-83bb-d9f6367a948d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:02.408301 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c4e96-87fc-4b68-83bb-d9f6367a948d None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:02.409443 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c4e96-87fc-4b68-83bb-d9f6367a948d None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:02.409962 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c4e96-87fc-4b68-83bb-d9f6367a948d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:02.410893 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3c4e96-87fc-4b68-83bb-d9f6367a948d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:02.412542 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3c4e96-87fc-4b68-83bb-d9f6367a948d None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:02.419145 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e894f19-0f4e-4ad2-90db-a20217cdc83d None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:02.425679 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-ae3c4e96-87fc-4b68-83bb-d9f6367a948d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Mar 30 01:16:02.427672 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 409/817] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Mar 30 01:16:02 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:16:02.428747 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c4e96-87fc-4b68-83bb-d9f6367a948d None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:02.465144 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a6a5dc-b6ee-4950-9bc6-1e3d479cadb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:02.466172 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6a5dc-b6ee-4950-9bc6-1e3d479cadb2 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:02.466685 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6a5dc-b6ee-4950-9bc6-1e3d479cadb2 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:02.467258 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6a5dc-b6ee-4950-9bc6-1e3d479cadb2 None admin] PATH_INFO: `/v3/projects` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:02.468317 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a6a5dc-b6ee-4950-9bc6-1e3d479cadb2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:02.468838 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a6a5dc-b6ee-4950-9bc6-1e3d479cadb2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:02.470498 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a6a5dc-b6ee-4950-9bc6-1e3d479cadb2 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:02.486159 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 409/818] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Mar 30 01:16:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:02.487632 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a6a5dc-b6ee-4950-9bc6-1e3d479cadb2 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:02.557468 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c4e96-87fc-4b68-83bb-d9f6367a948d None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:02.602102 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073f9c8c-afc2-4730-bc81-a212212d9a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:02.603204 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f9c8c-afc2-4730-bc81-a212212d9a4c None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:02.603724 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f9c8c-afc2-4730-bc81-a212212d9a4c None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:02.604188 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f9c8c-afc2-4730-bc81-a212212d9a4c None admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:02.605134 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073f9c8c-afc2-4730-bc81-a212212d9a4c None admin] RBAC: Adding query filter params (name=service) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:02.605600 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073f9c8c-afc2-4730-bc81-a212212d9a4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:02.607138 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073f9c8c-afc2-4730-bc81-a212212d9a4c None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:02.607948 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a6a5dc-b6ee-4950-9bc6-1e3d479cadb2 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:02.617065 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 410/819] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Mar 30 01:16:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:02.617718 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073f9c8c-afc2-4730-bc81-a212212d9a4c None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:02.648189 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdba6896-562b-495e-8964-bfb499020463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:02.648853 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba6896-562b-495e-8964-bfb499020463 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:02.649138 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba6896-562b-495e-8964-bfb499020463 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:02.649417 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba6896-562b-495e-8964-bfb499020463 None admin] PATH_INFO: `/v3/services` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:02.650126 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdba6896-562b-495e-8964-bfb499020463 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:02.650433 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdba6896-562b-495e-8964-bfb499020463 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:02.651842 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdba6896-562b-495e-8964-bfb499020463 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:02.656799 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 410/820] 10.222.0.30 () {56 vars in 1124 bytes} [Wed Mar 30 01:16:02 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:02.657579 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdba6896-562b-495e-8964-bfb499020463 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:02.725546 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073f9c8c-afc2-4730-bc81-a212212d9a4c None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:02.754927 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdba6896-562b-495e-8964-bfb499020463 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:02.758420 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749e01cb-09f2-4067-8806-bf622ee6dbfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:02.759347 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e01cb-09f2-4067-8806-bf622ee6dbfc None admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:02.759623 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e01cb-09f2-4067-8806-bf622ee6dbfc None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:02.759899 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e01cb-09f2-4067-8806-bf622ee6dbfc None admin] PATH_INFO: `/v3/projects/0c9a4444228d4be89a4ba8aa53099531/users/76f16de81dfb4c14b027cd6cd1e6ff2c/roles/36909bbf31d04993bb2a9fe587b572dc` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:02.761854 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749e01cb-09f2-4067-8806-bf622ee6dbfc None admin] RBAC: Authorizing `identity:create_grant(project_id=0c9a4444228d4be89a4ba8aa53099531, user_id=76f16de81dfb4c14b027cd6cd1e6ff2c, role_id=36909bbf31d04993bb2a9fe587b572dc)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:02.763318 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749e01cb-09f2-4067-8806-bf622ee6dbfc None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:02.777433 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 411/821] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Mar 30 01:16:02 2022] PUT /identity/v3/projects/0c9a4444228d4be89a4ba8aa53099531/users/76f16de81dfb4c14b027cd6cd1e6ff2c/roles/36909bbf31d04993bb2a9fe587b572dc => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:16:02.778050 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749e01cb-09f2-4067-8806-bf622ee6dbfc None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:02.800200 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f00ac6-bf49-4c69-ad92-3a5427d8f52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:02.801477 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f00ac6-bf49-4c69-ad92-3a5427d8f52a None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:02.801951 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f00ac6-bf49-4c69-ad92-3a5427d8f52a None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:02.802488 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f00ac6-bf49-4c69-ad92-3a5427d8f52a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:02.818924 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f00ac6-bf49-4c69-ad92-3a5427d8f52a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:02.820833 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f00ac6-bf49-4c69-ad92-3a5427d8f52a None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:02.844756 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-96f00ac6-bf49-4c69-ad92-3a5427d8f52a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:16:02.847020 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 411/822] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:16:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:16:02.852419 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f00ac6-bf49-4c69-ad92-3a5427d8f52a None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:02.904372 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749e01cb-09f2-4067-8806-bf622ee6dbfc None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:02.941125 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7159e5-321d-4e01-9c61-ade50209ed2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:02.942101 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7159e5-321d-4e01-9c61-ade50209ed2b None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:02.942527 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7159e5-321d-4e01-9c61-ade50209ed2b None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:02.942968 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7159e5-321d-4e01-9c61-ade50209ed2b None admin] PATH_INFO: `/v3/services` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:02.943870 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7159e5-321d-4e01-9c61-ade50209ed2b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:02.944349 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7159e5-321d-4e01-9c61-ade50209ed2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:02.945934 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7159e5-321d-4e01-9c61-ade50209ed2b None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:02.953633 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 412/823] 10.222.0.30 () {56 vars in 1124 bytes} [Wed Mar 30 01:16:02 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:02.959958 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7159e5-321d-4e01-9c61-ade50209ed2b None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:02.984044 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f00ac6-bf49-4c69-ad92-3a5427d8f52a None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:03.034397 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d732e9b3-3a5b-4f35-bd11-780973345a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:03.035660 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732e9b3-3a5b-4f35-bd11-780973345a50 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:03.036146 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732e9b3-3a5b-4f35-bd11-780973345a50 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:03.037376 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732e9b3-3a5b-4f35-bd11-780973345a50 None admin] PATH_INFO: `/v3/domains` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:03.038308 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d732e9b3-3a5b-4f35-bd11-780973345a50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:03.038865 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d732e9b3-3a5b-4f35-bd11-780973345a50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:03.040504 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d732e9b3-3a5b-4f35-bd11-780973345a50 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:03.054443 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 412/824] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:16:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:03.060058 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d732e9b3-3a5b-4f35-bd11-780973345a50 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:03.066357 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7159e5-321d-4e01-9c61-ade50209ed2b None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:03.099588 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6407885-7d71-4307-9cb5-b0a7a857434b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:03.100251 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6407885-7d71-4307-9cb5-b0a7a857434b None admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:03.100530 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6407885-7d71-4307-9cb5-b0a7a857434b None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:03.100802 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6407885-7d71-4307-9cb5-b0a7a857434b None admin] PATH_INFO: `/v3/endpoints` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:03.101540 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6407885-7d71-4307-9cb5-b0a7a857434b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:03.102927 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6407885-7d71-4307-9cb5-b0a7a857434b None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:03.134745 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 413/825] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Mar 30 01:16:02 2022] POST /identity/v3/endpoints => generated 346 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:16:03.177447 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d732e9b3-3a5b-4f35-bd11-780973345a50 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:03.219757 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ea7181-ffe7-4a68-9457-fea0d651392a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:03.220575 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea7181-ffe7-4a68-9457-fea0d651392a None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:03.220855 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea7181-ffe7-4a68-9457-fea0d651392a None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:03.221717 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea7181-ffe7-4a68-9457-fea0d651392a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:03.231208 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ea7181-ffe7-4a68-9457-fea0d651392a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:03.232746 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ea7181-ffe7-4a68-9457-fea0d651392a None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:03.248467 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-70ea7181-ffe7-4a68-9457-fea0d651392a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 30 01:16:03.250108 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 413/826] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Mar 30 01:16:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:16:03.259863 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6407885-7d71-4307-9cb5-b0a7a857434b None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:03.368533 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6407885-7d71-4307-9cb5-b0a7a857434b None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:03.402330 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b0504-5554-46e8-90cb-f5320d0ea652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:03.403027 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b0504-5554-46e8-90cb-f5320d0ea652 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:03.403307 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b0504-5554-46e8-90cb-f5320d0ea652 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:03.403576 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b0504-5554-46e8-90cb-f5320d0ea652 None admin] PATH_INFO: `/v3/users` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:03.404399 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4b0504-5554-46e8-90cb-f5320d0ea652 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:03.404703 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4b0504-5554-46e8-90cb-f5320d0ea652 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:03.406364 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4b0504-5554-46e8-90cb-f5320d0ea652 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:03.424355 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 414/827] 10.222.0.30 () {56 vars in 1149 bytes} [Wed Mar 30 01:16:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:03.429817 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ea7181-ffe7-4a68-9457-fea0d651392a None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:03.535077 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ea7181-ffe7-4a68-9457-fea0d651392a None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:03.569284 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5bf37e-61d4-40aa-bdd1-bac8b3f6b64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:03.570071 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5bf37e-61d4-40aa-bdd1-bac8b3f6b64b None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:03.570349 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5bf37e-61d4-40aa-bdd1-bac8b3f6b64b None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:03.570617 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5bf37e-61d4-40aa-bdd1-bac8b3f6b64b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:03.582127 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5bf37e-61d4-40aa-bdd1-bac8b3f6b64b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:03.583633 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5bf37e-61d4-40aa-bdd1-bac8b3f6b64b None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:03.600668 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-1e5bf37e-61d4-40aa-bdd1-bac8b3f6b64b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:16:03.602189 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 414/828] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:16:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:16:03.607674 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b0504-5554-46e8-90cb-f5320d0ea652 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:03.718306 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b0504-5554-46e8-90cb-f5320d0ea652 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:03.753513 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd403844-3cb6-4ef5-9cdd-9dcc4c1a7a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:03.754173 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd403844-3cb6-4ef5-9cdd-9dcc4c1a7a54 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:03.754455 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd403844-3cb6-4ef5-9cdd-9dcc4c1a7a54 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:03.754746 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd403844-3cb6-4ef5-9cdd-9dcc4c1a7a54 None admin] PATH_INFO: `/v3/domains` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:03.755462 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd403844-3cb6-4ef5-9cdd-9dcc4c1a7a54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:03.755761 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd403844-3cb6-4ef5-9cdd-9dcc4c1a7a54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:03.757123 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd403844-3cb6-4ef5-9cdd-9dcc4c1a7a54 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:03.768950 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 415/829] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:16:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:03.775782 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5bf37e-61d4-40aa-bdd1-bac8b3f6b64b None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:03.880015 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5bf37e-61d4-40aa-bdd1-bac8b3f6b64b None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:03.914554 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57807397-5f6d-4fed-afb6-2b0036731bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:03.915409 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57807397-5f6d-4fed-afb6-2b0036731bf6 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:03.915690 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57807397-5f6d-4fed-afb6-2b0036731bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:03.915965 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57807397-5f6d-4fed-afb6-2b0036731bf6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:03.922948 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57807397-5f6d-4fed-afb6-2b0036731bf6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:03.924542 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57807397-5f6d-4fed-afb6-2b0036731bf6 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:03.938314 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-57807397-5f6d-4fed-afb6-2b0036731bf6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 30 01:16:03.940352 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 415/830] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Mar 30 01:16:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:16:03.947807 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd403844-3cb6-4ef5-9cdd-9dcc4c1a7a54 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:04.043587 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff2ced-10b0-4162-8e91-55a093264f01 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:04.043905 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff2ced-10b0-4162-8e91-55a093264f01 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:04.044149 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff2ced-10b0-4162-8e91-55a093264f01 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:04.050319 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 416/831] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:16:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 01:16:04.053000 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b19005-391b-41ed-bbb8-a1517f1c3f49 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:04.053980 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b19005-391b-41ed-bbb8-a1517f1c3f49 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:04.054272 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b19005-391b-41ed-bbb8-a1517f1c3f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:04.057420 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd403844-3cb6-4ef5-9cdd-9dcc4c1a7a54 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:04.071006 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-71b19005-391b-41ed-bbb8-a1517f1c3f49 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:16:04.072206 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-71b19005-391b-41ed-bbb8-a1517f1c3f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:16:04.090492 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2460fc01-6d8f-4fe6-83bf-b9633a88338e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:04.091180 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460fc01-6d8f-4fe6-83bf-b9633a88338e None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:04.091459 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460fc01-6d8f-4fe6-83bf-b9633a88338e None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:04.091730 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460fc01-6d8f-4fe6-83bf-b9633a88338e None admin] PATH_INFO: `/v3/projects` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:04.092511 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2460fc01-6d8f-4fe6-83bf-b9633a88338e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:04.092820 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2460fc01-6d8f-4fe6-83bf-b9633a88338e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:04.094232 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2460fc01-6d8f-4fe6-83bf-b9633a88338e None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:04.107643 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 416/832] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Mar 30 01:16:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:04.113304 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2460fc01-6d8f-4fe6-83bf-b9633a88338e None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:04.152985 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 417/833] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:16:04 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 30 01:16:04.176007 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b19005-391b-41ed-bbb8-a1517f1c3f49 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:04.229759 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2460fc01-6d8f-4fe6-83bf-b9633a88338e None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:04.273373 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff849fc-d3e8-4d04-852c-e78e310d6788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:04.274043 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b19005-391b-41ed-bbb8-a1517f1c3f49 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:04.274889 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff849fc-d3e8-4d04-852c-e78e310d6788 None admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:04.275373 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff849fc-d3e8-4d04-852c-e78e310d6788 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:04.276010 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff849fc-d3e8-4d04-852c-e78e310d6788 None admin] PATH_INFO: `/v3/projects/0c9a4444228d4be89a4ba8aa53099531/users/0503fdca7f834ef0a81422804dc74812/roles/4121aef9b31c4671aebb65fda1c11185` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:04.295866 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff849fc-d3e8-4d04-852c-e78e310d6788 None admin] RBAC: Authorizing `identity:create_grant(project_id=0c9a4444228d4be89a4ba8aa53099531, user_id=0503fdca7f834ef0a81422804dc74812, role_id=4121aef9b31c4671aebb65fda1c11185)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:04.298427 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff849fc-d3e8-4d04-852c-e78e310d6788 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:04.311251 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89024ee-2b52-45bd-8092-1df190dc11e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:04.312260 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89024ee-2b52-45bd-8092-1df190dc11e0 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:04.312550 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89024ee-2b52-45bd-8092-1df190dc11e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:04.312944 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89024ee-2b52-45bd-8092-1df190dc11e0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:04.313598 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89024ee-2b52-45bd-8092-1df190dc11e0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:04.315887 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89024ee-2b52-45bd-8092-1df190dc11e0 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:04.316513 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 417/834] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Mar 30 01:16:04 2022] PUT /identity/v3/projects/0c9a4444228d4be89a4ba8aa53099531/users/0503fdca7f834ef0a81422804dc74812/roles/4121aef9b31c4671aebb65fda1c11185 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:16:04.333359 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-b89024ee-2b52-45bd-8092-1df190dc11e0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Mar 30 01:16:04.339946 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 418/835] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Mar 30 01:16:04 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 01:16:04.341424 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff849fc-d3e8-4d04-852c-e78e310d6788 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:04.467246 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff849fc-d3e8-4d04-852c-e78e310d6788 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:04.505804 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2796b5ad-a7fe-45e7-b00d-763b21ab3ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:04.506478 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2796b5ad-a7fe-45e7-b00d-763b21ab3ff0 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:04.507245 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2796b5ad-a7fe-45e7-b00d-763b21ab3ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:04.507245 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2796b5ad-a7fe-45e7-b00d-763b21ab3ff0 None admin] PATH_INFO: `/v3/services` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:04.507768 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2796b5ad-a7fe-45e7-b00d-763b21ab3ff0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:04.508076 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2796b5ad-a7fe-45e7-b00d-763b21ab3ff0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:04.509443 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2796b5ad-a7fe-45e7-b00d-763b21ab3ff0 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:04.518398 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 418/836] 10.222.0.30 () {56 vars in 1126 bytes} [Wed Mar 30 01:16:04 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:04.524385 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89024ee-2b52-45bd-8092-1df190dc11e0 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:04.634126 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89024ee-2b52-45bd-8092-1df190dc11e0 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:04.668210 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ae4930-c4f8-476a-b65e-1dc099307334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:04.669238 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae4930-c4f8-476a-b65e-1dc099307334 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:04.669744 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae4930-c4f8-476a-b65e-1dc099307334 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:04.670220 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae4930-c4f8-476a-b65e-1dc099307334 None admin] PATH_INFO: `/v3/services` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:04.671196 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ae4930-c4f8-476a-b65e-1dc099307334 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:04.671701 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ae4930-c4f8-476a-b65e-1dc099307334 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:04.673349 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ae4930-c4f8-476a-b65e-1dc099307334 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:04.678685 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 419/837] 10.222.0.30 () {56 vars in 1126 bytes} [Wed Mar 30 01:16:04 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:05.205764 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d348f7-0dd7-4fb2-beff-b242cea4aac4 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:05.206272 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d348f7-0dd7-4fb2-beff-b242cea4aac4 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:05.206635 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d348f7-0dd7-4fb2-beff-b242cea4aac4 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:05.208850 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 419/838] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:16:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:16:05.214906 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b841ddf-b1d2-43d6-a170-85467d83fa0c None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:05.215228 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b841ddf-b1d2-43d6-a170-85467d83fa0c None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:05.215476 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b841ddf-b1d2-43d6-a170-85467d83fa0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:05.233402 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-6b841ddf-b1d2-43d6-a170-85467d83fa0c None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:16:05.234615 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-6b841ddf-b1d2-43d6-a170-85467d83fa0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:16:05.307372 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 420/839] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:16:05 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 01:16:05.332020 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d348f7-0dd7-4fb2-beff-b242cea4aac4 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:05.439460 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d348f7-0dd7-4fb2-beff-b242cea4aac4 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:05.474833 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9e55b7-8fd3-4d97-84d5-d642d863a8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:05.476318 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e55b7-8fd3-4d97-84d5-d642d863a8ea None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:05.476767 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e55b7-8fd3-4d97-84d5-d642d863a8ea None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:05.477190 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e55b7-8fd3-4d97-84d5-d642d863a8ea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:05.488149 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9e55b7-8fd3-4d97-84d5-d642d863a8ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:16:05.495813 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-ea9e55b7-8fd3-4d97-84d5-d642d863a8ea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 30 01:16:05.497665 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 420/840] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Mar 30 01:16:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:16:05.503909 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b841ddf-b1d2-43d6-a170-85467d83fa0c None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:05.577559 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b4a059-c1cd-4d0c-a638-784194d44a8d None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:05.577905 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b4a059-c1cd-4d0c-a638-784194d44a8d None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:05.578113 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b4a059-c1cd-4d0c-a638-784194d44a8d None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:05.581693 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 421/841] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:16:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 01:16:05.585803 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855b1c20-018c-4d9b-a3ab-9f0193f3e767 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:05.586085 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855b1c20-018c-4d9b-a3ab-9f0193f3e767 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:05.586364 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855b1c20-018c-4d9b-a3ab-9f0193f3e767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:05.605559 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-855b1c20-018c-4d9b-a3ab-9f0193f3e767 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:16:05.607024 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-855b1c20-018c-4d9b-a3ab-9f0193f3e767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:16:05.612187 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b841ddf-b1d2-43d6-a170-85467d83fa0c None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:05.663580 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca08d761-e1ea-4795-ac5c-fa4dfbb57fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:05.664433 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca08d761-e1ea-4795-ac5c-fa4dfbb57fbb None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:05.664807 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca08d761-e1ea-4795-ac5c-fa4dfbb57fbb None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:05.665180 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca08d761-e1ea-4795-ac5c-fa4dfbb57fbb None admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:05.666366 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca08d761-e1ea-4795-ac5c-fa4dfbb57fbb None admin] RBAC: Adding query filter params (name=admin) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:05.666832 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca08d761-e1ea-4795-ac5c-fa4dfbb57fbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:05.668634 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca08d761-e1ea-4795-ac5c-fa4dfbb57fbb None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:05.680778 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 421/842] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Mar 30 01:16:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:05.686934 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca08d761-e1ea-4795-ac5c-fa4dfbb57fbb None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:05.699124 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 422/843] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:16:05 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 30 01:16:05.722220 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855b1c20-018c-4d9b-a3ab-9f0193f3e767 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:05.815673 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca08d761-e1ea-4795-ac5c-fa4dfbb57fbb None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:05.833686 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855b1c20-018c-4d9b-a3ab-9f0193f3e767 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:05.853852 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26f4195-5eaa-46ed-bee3-2d833c6e5699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:05.854955 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f4195-5eaa-46ed-bee3-2d833c6e5699 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:05.855555 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f4195-5eaa-46ed-bee3-2d833c6e5699 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:05.856181 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f4195-5eaa-46ed-bee3-2d833c6e5699 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:05.869587 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26f4195-5eaa-46ed-bee3-2d833c6e5699 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:05.871551 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26f4195-5eaa-46ed-bee3-2d833c6e5699 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:05.871959 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5794e2-84ac-4c25-bcd4-72c244d51dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:05.872856 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5794e2-84ac-4c25-bcd4-72c244d51dc7 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:05.873232 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5794e2-84ac-4c25-bcd4-72c244d51dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:05.873602 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5794e2-84ac-4c25-bcd4-72c244d51dc7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:05.874348 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5794e2-84ac-4c25-bcd4-72c244d51dc7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:05.875837 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5794e2-84ac-4c25-bcd4-72c244d51dc7 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:05.887392 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-7c5794e2-84ac-4c25-bcd4-72c244d51dc7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Mar 30 01:16:05.890796 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-e26f4195-5eaa-46ed-bee3-2d833c6e5699 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:16:05.892450 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 422/845] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:16:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:16:05.892554 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 423/845] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Mar 30 01:16:05 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 01:16:05.898736 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5794e2-84ac-4c25-bcd4-72c244d51dc7 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:05.899779 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26f4195-5eaa-46ed-bee3-2d833c6e5699 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:06.006918 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5794e2-84ac-4c25-bcd4-72c244d51dc7 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:06.027285 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26f4195-5eaa-46ed-bee3-2d833c6e5699 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:06.045732 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dac4b6-ee02-4b3e-a9ac-367e13855d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:06.046622 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dac4b6-ee02-4b3e-a9ac-367e13855d62 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:06.047471 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dac4b6-ee02-4b3e-a9ac-367e13855d62 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:06.047893 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dac4b6-ee02-4b3e-a9ac-367e13855d62 None admin] PATH_INFO: `/v3/services` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:06.049000 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dac4b6-ee02-4b3e-a9ac-367e13855d62 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:06.049952 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dac4b6-ee02-4b3e-a9ac-367e13855d62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:06.052301 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dac4b6-ee02-4b3e-a9ac-367e13855d62 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:06.059407 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 424/846] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Mar 30 01:16:05 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:16:06.064376 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dac4b6-ee02-4b3e-a9ac-367e13855d62 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:06.066965 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d330022-db4e-4307-9947-ec287e0dec03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:06.068817 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d330022-db4e-4307-9947-ec287e0dec03 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:06.069257 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d330022-db4e-4307-9947-ec287e0dec03 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:06.069674 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d330022-db4e-4307-9947-ec287e0dec03 None admin] PATH_INFO: `/v3/domains` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:06.070538 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d330022-db4e-4307-9947-ec287e0dec03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:06.071009 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d330022-db4e-4307-9947-ec287e0dec03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:06.072499 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d330022-db4e-4307-9947-ec287e0dec03 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:06.088465 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 423/847] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:16:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:06.093279 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d330022-db4e-4307-9947-ec287e0dec03 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:06.181809 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dac4b6-ee02-4b3e-a9ac-367e13855d62 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:06.207892 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d330022-db4e-4307-9947-ec287e0dec03 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:06.222115 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2160986a-f8b5-4aae-bfb1-4e658309491a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:06.223101 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2160986a-f8b5-4aae-bfb1-4e658309491a None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:06.223252 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2160986a-f8b5-4aae-bfb1-4e658309491a None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:06.223604 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2160986a-f8b5-4aae-bfb1-4e658309491a None admin] PATH_INFO: `/v3/services` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:06.224456 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2160986a-f8b5-4aae-bfb1-4e658309491a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:06.224763 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2160986a-f8b5-4aae-bfb1-4e658309491a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:06.226205 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2160986a-f8b5-4aae-bfb1-4e658309491a None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:06.235088 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 425/848] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Mar 30 01:16:06 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:06.249602 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f3d49f-07f4-41ef-bd5a-cadaed2a6144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:06.250693 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f3d49f-07f4-41ef-bd5a-cadaed2a6144 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:06.251167 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f3d49f-07f4-41ef-bd5a-cadaed2a6144 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:06.251580 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f3d49f-07f4-41ef-bd5a-cadaed2a6144 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:06.260641 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f3d49f-07f4-41ef-bd5a-cadaed2a6144 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:06.262358 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f3d49f-07f4-41ef-bd5a-cadaed2a6144 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:06.277929 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-09f3d49f-07f4-41ef-bd5a-cadaed2a6144 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 30 01:16:06.280122 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 424/849] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Mar 30 01:16:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 01:16:06.290815 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2160986a-f8b5-4aae-bfb1-4e658309491a None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:06.398393 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2160986a-f8b5-4aae-bfb1-4e658309491a None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:06.436047 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10022114-d89a-46ff-94dc-2a0e245414b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:06.436832 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10022114-d89a-46ff-94dc-2a0e245414b5 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:06.437189 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10022114-d89a-46ff-94dc-2a0e245414b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:06.437595 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10022114-d89a-46ff-94dc-2a0e245414b5 None admin] PATH_INFO: `/v3/users` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:06.438517 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10022114-d89a-46ff-94dc-2a0e245414b5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:06.438957 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10022114-d89a-46ff-94dc-2a0e245414b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:06.441006 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10022114-d89a-46ff-94dc-2a0e245414b5 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:06.460522 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 426/850] 10.222.0.30 () {56 vars in 1135 bytes} [Wed Mar 30 01:16:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:06.466226 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f3d49f-07f4-41ef-bd5a-cadaed2a6144 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:06.568922 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f3d49f-07f4-41ef-bd5a-cadaed2a6144 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:06.603333 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78846f50-3bef-453a-8517-3067745febc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:06.604025 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78846f50-3bef-453a-8517-3067745febc4 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:06.604311 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78846f50-3bef-453a-8517-3067745febc4 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:06.604580 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78846f50-3bef-453a-8517-3067745febc4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:06.679417 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78846f50-3bef-453a-8517-3067745febc4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:06.680804 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78846f50-3bef-453a-8517-3067745febc4 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:06.783928 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 425/851] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Mar 30 01:16:06 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 30 01:16:06.785282 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee21113-4d08-43bb-95a7-ec8e5a94fba7 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:06.786006 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee21113-4d08-43bb-95a7-ec8e5a94fba7 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:06.786006 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee21113-4d08-43bb-95a7-ec8e5a94fba7 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:06.787959 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 427/852] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:16:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:16:06.791065 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78846f50-3bef-453a-8517-3067745febc4 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:06.795194 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ead75f-ac40-4eb0-8ba0-42fdc05a4138 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:06.795481 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ead75f-ac40-4eb0-8ba0-42fdc05a4138 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:06.795761 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ead75f-ac40-4eb0-8ba0-42fdc05a4138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:06.817512 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-e8ead75f-ac40-4eb0-8ba0-42fdc05a4138 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:16:06.819066 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-e8ead75f-ac40-4eb0-8ba0-42fdc05a4138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:16:06.896961 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78846f50-3bef-453a-8517-3067745febc4 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:06.899840 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 428/853] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:16:06 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 30 01:16:06.923563 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ead75f-ac40-4eb0-8ba0-42fdc05a4138 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:06.933862 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d4fd45-c053-40a5-b38d-8dfdedc4e91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:06.935277 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4fd45-c053-40a5-b38d-8dfdedc4e91e None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:06.936055 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4fd45-c053-40a5-b38d-8dfdedc4e91e None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:06.936795 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4fd45-c053-40a5-b38d-8dfdedc4e91e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:06.949688 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d4fd45-c053-40a5-b38d-8dfdedc4e91e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:06.952163 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d4fd45-c053-40a5-b38d-8dfdedc4e91e None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:06.973309 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-e7d4fd45-c053-40a5-b38d-8dfdedc4e91e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:16:06.975603 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 426/854] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:16:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:16:06.981266 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d4fd45-c053-40a5-b38d-8dfdedc4e91e None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:07.028181 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ead75f-ac40-4eb0-8ba0-42fdc05a4138 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:07.063566 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a651bc-e2b5-4b7a-a7a5-9e8815526783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:07.064362 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a651bc-e2b5-4b7a-a7a5-9e8815526783 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:07.064642 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a651bc-e2b5-4b7a-a7a5-9e8815526783 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:07.065429 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a651bc-e2b5-4b7a-a7a5-9e8815526783 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:07.075698 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a651bc-e2b5-4b7a-a7a5-9e8815526783 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:16:07.081539 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d4fd45-c053-40a5-b38d-8dfdedc4e91e None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:07.083657 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-f9a651bc-e2b5-4b7a-a7a5-9e8815526783 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 30 01:16:07.084849 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 429/855] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Mar 30 01:16:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 01:16:07.086060 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee8c242-573c-47f6-804a-68ef1fd365d6 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:07.086343 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee8c242-573c-47f6-804a-68ef1fd365d6 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:07.086616 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee8c242-573c-47f6-804a-68ef1fd365d6 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:07.090845 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 430/856] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:16:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:16:07.091769 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee8c242-573c-47f6-804a-68ef1fd365d6 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:07.117327 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ccaa2-81a8-4d65-8278-cb2a7a4ec0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:07.117998 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ccaa2-81a8-4d65-8278-cb2a7a4ec0d8 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:07.118284 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ccaa2-81a8-4d65-8278-cb2a7a4ec0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:07.118562 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ccaa2-81a8-4d65-8278-cb2a7a4ec0d8 None admin] PATH_INFO: `/v3/domains` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:07.119308 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700ccaa2-81a8-4d65-8278-cb2a7a4ec0d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:07.119607 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700ccaa2-81a8-4d65-8278-cb2a7a4ec0d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:07.120984 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700ccaa2-81a8-4d65-8278-cb2a7a4ec0d8 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:07.137847 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 427/857] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:16:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:07.137847 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b81e34-14aa-4a41-b1ac-031629725217 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:07.137847 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b81e34-14aa-4a41-b1ac-031629725217 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:07.137847 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b81e34-14aa-4a41-b1ac-031629725217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:07.153373 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-15b81e34-14aa-4a41-b1ac-031629725217 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:16:07.154560 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-15b81e34-14aa-4a41-b1ac-031629725217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:16:07.210340 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee8c242-573c-47f6-804a-68ef1fd365d6 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:07.226768 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 428/858] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:16:07 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 01:16:07.227430 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b81e34-14aa-4a41-b1ac-031629725217 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:07.244253 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ede39e2-0c1b-4bb9-99c2-a911b52d0cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:07.245236 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede39e2-0c1b-4bb9-99c2-a911b52d0cab None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:07.245712 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede39e2-0c1b-4bb9-99c2-a911b52d0cab None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:07.246200 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede39e2-0c1b-4bb9-99c2-a911b52d0cab None admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:07.247156 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ede39e2-0c1b-4bb9-99c2-a911b52d0cab None admin] RBAC: Adding query filter params (name=service) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:07.247672 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ede39e2-0c1b-4bb9-99c2-a911b52d0cab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:07.249351 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ede39e2-0c1b-4bb9-99c2-a911b52d0cab None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:07.258924 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 431/859] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Mar 30 01:16:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:07.259678 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ede39e2-0c1b-4bb9-99c2-a911b52d0cab None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:07.336226 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b81e34-14aa-4a41-b1ac-031629725217 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:07.357430 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ede39e2-0c1b-4bb9-99c2-a911b52d0cab None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:07.368626 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46a08ce-b383-4324-b533-0e71426a36ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:07.369414 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a08ce-b383-4324-b533-0e71426a36ab None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:07.369694 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a08ce-b383-4324-b533-0e71426a36ab None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:07.369996 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a08ce-b383-4324-b533-0e71426a36ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:07.376718 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46a08ce-b383-4324-b533-0e71426a36ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:07.378331 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46a08ce-b383-4324-b533-0e71426a36ab None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:07.390873 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dc136f-60fa-422a-b6dd-23d6278dc21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:07.391380 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-e46a08ce-b383-4324-b533-0e71426a36ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 30 01:16:07.391608 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc136f-60fa-422a-b6dd-23d6278dc21e None admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:07.391893 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc136f-60fa-422a-b6dd-23d6278dc21e None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:07.392168 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc136f-60fa-422a-b6dd-23d6278dc21e None admin] PATH_INFO: `/v3/services` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:07.398032 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 429/860] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Mar 30 01:16:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:16:07.398186 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dc136f-60fa-422a-b6dd-23d6278dc21e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:07.398266 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46a08ce-b383-4324-b533-0e71426a36ab None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:07.398336 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dc136f-60fa-422a-b6dd-23d6278dc21e None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:07.409358 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 432/861] 10.222.0.30 () {60 vars in 1141 bytes} [Wed Mar 30 01:16:07 2022] POST /identity/v3/services => generated 269 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:16:07.410084 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dc136f-60fa-422a-b6dd-23d6278dc21e None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:07.540212 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46a08ce-b383-4324-b533-0e71426a36ab None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:07.546034 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dc136f-60fa-422a-b6dd-23d6278dc21e None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:07.578723 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4964ea28-4bbc-498e-892e-cbb7ced49bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:07.580123 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964ea28-4bbc-498e-892e-cbb7ced49bc5 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:07.581307 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964ea28-4bbc-498e-892e-cbb7ced49bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:07.582026 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964ea28-4bbc-498e-892e-cbb7ced49bc5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:07.582394 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed32fef-47ad-454b-b9e2-656b37d977c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:07.583163 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed32fef-47ad-454b-b9e2-656b37d977c4 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:07.583509 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed32fef-47ad-454b-b9e2-656b37d977c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:07.583852 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed32fef-47ad-454b-b9e2-656b37d977c4 None admin] PATH_INFO: `/v3/projects` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:07.584805 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed32fef-47ad-454b-b9e2-656b37d977c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:07.585195 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed32fef-47ad-454b-b9e2-656b37d977c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:07.586888 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed32fef-47ad-454b-b9e2-656b37d977c4 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:07.595706 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4964ea28-4bbc-498e-892e-cbb7ced49bc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:07.599072 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4964ea28-4bbc-498e-892e-cbb7ced49bc5 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:07.604963 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 433/862] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Mar 30 01:16:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:07.607350 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed32fef-47ad-454b-b9e2-656b37d977c4 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:07.622800 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-4964ea28-4bbc-498e-892e-cbb7ced49bc5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:16:07.626924 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 430/863] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:16:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:16:07.629356 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4964ea28-4bbc-498e-892e-cbb7ced49bc5 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:07.729658 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed32fef-47ad-454b-b9e2-656b37d977c4 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:07.755006 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4964ea28-4bbc-498e-892e-cbb7ced49bc5 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:07.764184 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c00f22-78bb-4a2b-bae3-f429e6643587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:07.764840 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c00f22-78bb-4a2b-bae3-f429e6643587 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:07.765118 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c00f22-78bb-4a2b-bae3-f429e6643587 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:07.765766 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c00f22-78bb-4a2b-bae3-f429e6643587 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:07.766212 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c00f22-78bb-4a2b-bae3-f429e6643587 None admin] RBAC: Adding query filter params (role.id=36909bbf31d04993bb2a9fe587b572dc, scope.project.id=0c9a4444228d4be89a4ba8aa53099531, user.id=76f16de81dfb4c14b027cd6cd1e6ff2c) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:07.766521 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c00f22-78bb-4a2b-bae3-f429e6643587 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:07.768210 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c00f22-78bb-4a2b-bae3-f429e6643587 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:07.782819 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 434/864] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Mar 30 01:16:07 2022] GET /identity/v3/role_assignments?user.id=76f16de81dfb4c14b027cd6cd1e6ff2c&scope.project.id=0c9a4444228d4be89a4ba8aa53099531&role.id=36909bbf31d04993bb2a9fe587b572dc => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:07.797528 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1828fc02-53cf-482d-b177-41b9d27d7bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:07.798451 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1828fc02-53cf-482d-b177-41b9d27d7bfd None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:07.798908 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1828fc02-53cf-482d-b177-41b9d27d7bfd None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:07.800141 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1828fc02-53cf-482d-b177-41b9d27d7bfd None admin] PATH_INFO: `/v3/domains` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:07.801337 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1828fc02-53cf-482d-b177-41b9d27d7bfd None admin] RBAC: Adding query filter params (name=Default) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:07.801803 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1828fc02-53cf-482d-b177-41b9d27d7bfd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:07.803405 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1828fc02-53cf-482d-b177-41b9d27d7bfd None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:07.817976 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 431/865] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:16:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:16:07.823965 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c00f22-78bb-4a2b-bae3-f429e6643587 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:07.941315 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c00f22-78bb-4a2b-bae3-f429e6643587 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:07.981017 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf7256-7112-4d2b-93f0-1984a0f81df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:07.981829 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf7256-7112-4d2b-93f0-1984a0f81df1 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:07.982107 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf7256-7112-4d2b-93f0-1984a0f81df1 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:07.982376 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf7256-7112-4d2b-93f0-1984a0f81df1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:07.990386 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cf7256-7112-4d2b-93f0-1984a0f81df1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:07.991872 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cf7256-7112-4d2b-93f0-1984a0f81df1 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:08.007282 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-e9cf7256-7112-4d2b-93f0-1984a0f81df1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 30 01:16:08.008823 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 435/866] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Mar 30 01:16:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:16:08.014572 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1828fc02-53cf-482d-b177-41b9d27d7bfd None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:08.119377 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1828fc02-53cf-482d-b177-41b9d27d7bfd None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:08.154502 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec3ef18-3b07-415f-bb68-0eb851b52a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:08.155834 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec3ef18-3b07-415f-bb68-0eb851b52a42 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:08.156307 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec3ef18-3b07-415f-bb68-0eb851b52a42 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:08.156776 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec3ef18-3b07-415f-bb68-0eb851b52a42 None admin] PATH_INFO: `/v3/users` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:08.157793 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec3ef18-3b07-415f-bb68-0eb851b52a42 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:08.158276 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec3ef18-3b07-415f-bb68-0eb851b52a42 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:08.160543 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec3ef18-3b07-415f-bb68-0eb851b52a42 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:08.180254 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 432/867] 10.222.0.30 () {56 vars in 1149 bytes} [Wed Mar 30 01:16:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:08.185890 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf7256-7112-4d2b-93f0-1984a0f81df1 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:08.288978 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf7256-7112-4d2b-93f0-1984a0f81df1 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:08.323320 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d5f9d0-0c88-488a-be63-bdc923a65b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:08.324330 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d5f9d0-0c88-488a-be63-bdc923a65b0a None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:08.324815 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d5f9d0-0c88-488a-be63-bdc923a65b0a None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:08.325332 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d5f9d0-0c88-488a-be63-bdc923a65b0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:08.393599 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d5f9d0-0c88-488a-be63-bdc923a65b0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:08.395463 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d5f9d0-0c88-488a-be63-bdc923a65b0a None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:08.499491 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 436/868] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Mar 30 01:16:08 2022] GET /identity/v3/auth/tokens => generated 1261 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 30 01:16:08.506473 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec3ef18-3b07-415f-bb68-0eb851b52a42 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:08.612708 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec3ef18-3b07-415f-bb68-0eb851b52a42 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:08.647083 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80371304-301b-4b83-9eb8-27b3abcc47e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:08.647809 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80371304-301b-4b83-9eb8-27b3abcc47e9 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:08.648086 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80371304-301b-4b83-9eb8-27b3abcc47e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:08.648359 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80371304-301b-4b83-9eb8-27b3abcc47e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:08.661431 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80371304-301b-4b83-9eb8-27b3abcc47e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:08.662907 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80371304-301b-4b83-9eb8-27b3abcc47e9 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:08.681026 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-80371304-301b-4b83-9eb8-27b3abcc47e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:16:08.682614 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 433/869] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:16:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 01:16:08.688042 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d5f9d0-0c88-488a-be63-bdc923a65b0a None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:08.788729 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d5f9d0-0c88-488a-be63-bdc923a65b0a None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:08.791408 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb127b-f7ef-4e83-a2a8-fa205893d62a None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:08.791855 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb127b-f7ef-4e83-a2a8-fa205893d62a None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:08.792186 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb127b-f7ef-4e83-a2a8-fa205893d62a None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:08.794310 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 434/870] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:16:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 01:16:08.799825 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e2181-d545-4826-85d5-35f942d83d42 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:08.800403 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e2181-d545-4826-85d5-35f942d83d42 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:08.800753 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e2181-d545-4826-85d5-35f942d83d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:08.817994 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-cc0e2181-d545-4826-85d5-35f942d83d42 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:16:08.819425 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-cc0e2181-d545-4826-85d5-35f942d83d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:16:08.825625 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee968aca-2ec7-444d-aba3-a3ad8a90f0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:08.826823 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee968aca-2ec7-444d-aba3-a3ad8a90f0b3 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:08.827634 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee968aca-2ec7-444d-aba3-a3ad8a90f0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:08.828062 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee968aca-2ec7-444d-aba3-a3ad8a90f0b3 None admin] PATH_INFO: `/v3/domains` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:08.828948 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee968aca-2ec7-444d-aba3-a3ad8a90f0b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:08.829742 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee968aca-2ec7-444d-aba3-a3ad8a90f0b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:08.832715 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee968aca-2ec7-444d-aba3-a3ad8a90f0b3 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:08.847446 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 437/871] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:16:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:08.853001 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee968aca-2ec7-444d-aba3-a3ad8a90f0b3 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:08.902891 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 435/872] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:16:08 2022] POST /identity/v3/auth/tokens => generated 1261 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 30 01:16:08.925743 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0e2181-d545-4826-85d5-35f942d83d42 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:08.980719 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee968aca-2ec7-444d-aba3-a3ad8a90f0b3 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:09.015557 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b4717e-f683-415e-bd32-ed4f60bb83aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:09.016362 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4717e-f683-415e-bd32-ed4f60bb83aa None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:09.016646 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4717e-f683-415e-bd32-ed4f60bb83aa None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:09.016921 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4717e-f683-415e-bd32-ed4f60bb83aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:09.024567 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b4717e-f683-415e-bd32-ed4f60bb83aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:09.026075 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b4717e-f683-415e-bd32-ed4f60bb83aa None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:09.041535 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-30b4717e-f683-415e-bd32-ed4f60bb83aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 30 01:16:09.043084 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 438/873] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Mar 30 01:16:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 01:16:09.051639 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b4717e-f683-415e-bd32-ed4f60bb83aa None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:09.052142 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0e2181-d545-4826-85d5-35f942d83d42 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:09.094240 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e45d17f-e28d-4792-a677-9003c35bdc42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:09.095658 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e45d17f-e28d-4792-a677-9003c35bdc42 None admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:09.096254 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e45d17f-e28d-4792-a677-9003c35bdc42 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:09.096732 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e45d17f-e28d-4792-a677-9003c35bdc42 None admin] PATH_INFO: `/v3/services` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:09.097946 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e45d17f-e28d-4792-a677-9003c35bdc42 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:09.100259 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e45d17f-e28d-4792-a677-9003c35bdc42 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:09.122770 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 436/874] 10.222.0.30 () {60 vars in 1141 bytes} [Wed Mar 30 01:16:08 2022] POST /identity/v3/services => generated 251 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 01:16:09.170671 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b4717e-f683-415e-bd32-ed4f60bb83aa None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:09.221695 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e37ddb5-27ca-4f05-b047-4ebf2cd21376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:09.222664 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37ddb5-27ca-4f05-b047-4ebf2cd21376 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:09.223115 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37ddb5-27ca-4f05-b047-4ebf2cd21376 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:09.223532 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37ddb5-27ca-4f05-b047-4ebf2cd21376 None admin] PATH_INFO: `/v3/projects` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:09.224495 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e37ddb5-27ca-4f05-b047-4ebf2cd21376 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:09.224952 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e37ddb5-27ca-4f05-b047-4ebf2cd21376 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:09.226569 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e37ddb5-27ca-4f05-b047-4ebf2cd21376 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:09.240477 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 439/875] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Mar 30 01:16:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:09.248008 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e45d17f-e28d-4792-a677-9003c35bdc42 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:09.362674 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e45d17f-e28d-4792-a677-9003c35bdc42 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:09.397103 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0014b50-fb12-442c-9d33-245d761ed49a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:09.398004 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0014b50-fb12-442c-9d33-245d761ed49a None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:09.398429 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0014b50-fb12-442c-9d33-245d761ed49a None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:09.398866 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0014b50-fb12-442c-9d33-245d761ed49a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:09.399854 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0014b50-fb12-442c-9d33-245d761ed49a None admin] RBAC: Adding query filter params (role.id=4121aef9b31c4671aebb65fda1c11185, scope.project.id=0c9a4444228d4be89a4ba8aa53099531, user.id=0503fdca7f834ef0a81422804dc74812) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:09.400411 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0014b50-fb12-442c-9d33-245d761ed49a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:09.401984 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0014b50-fb12-442c-9d33-245d761ed49a None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:09.408835 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 437/876] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Mar 30 01:16:09 2022] GET /identity/v3/role_assignments?user.id=0503fdca7f834ef0a81422804dc74812&scope.project.id=0c9a4444228d4be89a4ba8aa53099531&role.id=4121aef9b31c4671aebb65fda1c11185 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:16:09.883215 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9afdced-2f96-4e7b-9016-1d1bd8301ff9 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:09.883723 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9afdced-2f96-4e7b-9016-1d1bd8301ff9 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:09.883723 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9afdced-2f96-4e7b-9016-1d1bd8301ff9 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:09.885702 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 440/877] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:16:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:16:09.891088 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c0faea-4d4d-4ad7-9dfb-6eeb8daee805 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:09.891514 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c0faea-4d4d-4ad7-9dfb-6eeb8daee805 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:09.891695 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c0faea-4d4d-4ad7-9dfb-6eeb8daee805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:09.910979 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-c2c0faea-4d4d-4ad7-9dfb-6eeb8daee805 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:16:09.912221 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-c2c0faea-4d4d-4ad7-9dfb-6eeb8daee805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:16:09.985530 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 438/878] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:16:09 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 30 01:16:10.009211 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9afdced-2f96-4e7b-9016-1d1bd8301ff9 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:10.117005 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9afdced-2f96-4e7b-9016-1d1bd8301ff9 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:10.150339 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85751b76-9d9e-4806-a640-6fbf2e9f3f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:10.151163 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85751b76-9d9e-4806-a640-6fbf2e9f3f2b None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:10.151447 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85751b76-9d9e-4806-a640-6fbf2e9f3f2b None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:10.151723 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85751b76-9d9e-4806-a640-6fbf2e9f3f2b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:10.152375 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85751b76-9d9e-4806-a640-6fbf2e9f3f2b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:10.153739 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85751b76-9d9e-4806-a640-6fbf2e9f3f2b None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:10.165996 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-85751b76-9d9e-4806-a640-6fbf2e9f3f2b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Mar 30 01:16:10.167565 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 441/879] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Mar 30 01:16:10 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:16:10.173575 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c0faea-4d4d-4ad7-9dfb-6eeb8daee805 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:10.279640 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c0faea-4d4d-4ad7-9dfb-6eeb8daee805 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:10.303300 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f837fe-3f27-4b00-bab0-1e16762f6968 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:10.303617 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f837fe-3f27-4b00-bab0-1e16762f6968 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:10.303865 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f837fe-3f27-4b00-bab0-1e16762f6968 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:10.305881 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 442/880] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:16:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 01:16:10.311117 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caaa9be-c987-4874-9a55-f74d8ce852e1 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:10.311406 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caaa9be-c987-4874-9a55-f74d8ce852e1 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:10.311681 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caaa9be-c987-4874-9a55-f74d8ce852e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:10.314801 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75cd81b-ebb5-4e04-9812-9a971171c23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:10.315518 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75cd81b-ebb5-4e04-9812-9a971171c23b None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:10.315774 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75cd81b-ebb5-4e04-9812-9a971171c23b None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:10.316040 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75cd81b-ebb5-4e04-9812-9a971171c23b None admin] PATH_INFO: `/v3/services` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:10.316813 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75cd81b-ebb5-4e04-9812-9a971171c23b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:10.317124 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75cd81b-ebb5-4e04-9812-9a971171c23b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:10.318588 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75cd81b-ebb5-4e04-9812-9a971171c23b None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:10.324760 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 439/881] 10.222.0.30 () {56 vars in 1126 bytes} [Wed Mar 30 01:16:10 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:10.333401 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75cd81b-ebb5-4e04-9812-9a971171c23b None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:10.334634 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-2caaa9be-c987-4874-9a55-f74d8ce852e1 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:16:10.336086 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-2caaa9be-c987-4874-9a55-f74d8ce852e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:16:10.419887 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 443/882] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:16:10 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 01:16:10.441286 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caaa9be-c987-4874-9a55-f74d8ce852e1 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:10.452697 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75cd81b-ebb5-4e04-9812-9a971171c23b None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:10.500177 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9253016-9795-4423-b91e-dcf422d3cba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:10.501319 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9253016-9795-4423-b91e-dcf422d3cba0 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:10.502133 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9253016-9795-4423-b91e-dcf422d3cba0 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:10.502626 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9253016-9795-4423-b91e-dcf422d3cba0 None admin] PATH_INFO: `/v3/services` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:10.503793 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9253016-9795-4423-b91e-dcf422d3cba0 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:10.504416 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9253016-9795-4423-b91e-dcf422d3cba0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:10.506559 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9253016-9795-4423-b91e-dcf422d3cba0 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:10.518623 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 440/883] 10.222.0.30 () {56 vars in 1126 bytes} [Wed Mar 30 01:16:10 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:16:10.519894 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9253016-9795-4423-b91e-dcf422d3cba0 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:10.553766 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caaa9be-c987-4874-9a55-f74d8ce852e1 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:10.592195 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca555c6-b23e-4ed5-a510-e429539245fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:10.593942 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca555c6-b23e-4ed5-a510-e429539245fd None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:10.594431 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca555c6-b23e-4ed5-a510-e429539245fd None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:10.595074 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca555c6-b23e-4ed5-a510-e429539245fd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:10.596545 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca555c6-b23e-4ed5-a510-e429539245fd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:10.598128 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca555c6-b23e-4ed5-a510-e429539245fd None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:10.613229 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-aca555c6-b23e-4ed5-a510-e429539245fd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 30 01:16:10.615290 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 444/884] 10.222.0.30 () {56 vars in 1126 bytes} [Wed Mar 30 01:16:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:16:10.623667 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca555c6-b23e-4ed5-a510-e429539245fd None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:10.642887 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9253016-9795-4423-b91e-dcf422d3cba0 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:10.690528 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd161ff-cfb8-4c23-99b5-213a6c6331bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:10.691564 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd161ff-cfb8-4c23-99b5-213a6c6331bf None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:10.692055 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd161ff-cfb8-4c23-99b5-213a6c6331bf None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:10.692544 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd161ff-cfb8-4c23-99b5-213a6c6331bf None admin] PATH_INFO: `/v3/endpoints` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:10.693551 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd161ff-cfb8-4c23-99b5-213a6c6331bf None admin] RBAC: Adding query filter params (interface=public, service_id=5313be3f74f74789a4ec31b052725038, region_id=RegionOne) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:10.694072 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd161ff-cfb8-4c23-99b5-213a6c6331bf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:10.695681 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd161ff-cfb8-4c23-99b5-213a6c6331bf None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:10.701594 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 441/885] 10.222.0.30 () {56 vars in 1251 bytes} [Wed Mar 30 01:16:10 2022] GET /identity/v3/endpoints?service_id=5313be3f74f74789a4ec31b052725038&interface=public®ion_id=RegionOne => generated 194 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:10.709486 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd161ff-cfb8-4c23-99b5-213a6c6331bf None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:10.735494 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca555c6-b23e-4ed5-a510-e429539245fd None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:10.771768 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f66c82-89d5-4041-8dd0-d9a5ad96aa3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:10.772435 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f66c82-89d5-4041-8dd0-d9a5ad96aa3d None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:10.772712 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f66c82-89d5-4041-8dd0-d9a5ad96aa3d None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:10.773004 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f66c82-89d5-4041-8dd0-d9a5ad96aa3d None admin] PATH_INFO: `/v3/services` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:10.773703 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f66c82-89d5-4041-8dd0-d9a5ad96aa3d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:10.774003 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f66c82-89d5-4041-8dd0-d9a5ad96aa3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:10.775387 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f66c82-89d5-4041-8dd0-d9a5ad96aa3d None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:10.780721 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 445/886] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Mar 30 01:16:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:10.786801 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f66c82-89d5-4041-8dd0-d9a5ad96aa3d None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:10.817017 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd161ff-cfb8-4c23-99b5-213a6c6331bf None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:10.854889 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a01ba69-0195-4359-9394-88fbc06e7df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:10.855556 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01ba69-0195-4359-9394-88fbc06e7df7 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:10.855843 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01ba69-0195-4359-9394-88fbc06e7df7 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:10.856122 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01ba69-0195-4359-9394-88fbc06e7df7 None admin] PATH_INFO: `/v3/services` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:10.856803 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a01ba69-0195-4359-9394-88fbc06e7df7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:10.858217 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a01ba69-0195-4359-9394-88fbc06e7df7 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:10.864328 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 442/887] 10.222.0.30 () {56 vars in 1087 bytes} [Wed Mar 30 01:16:10 2022] GET /identity/v3/services => generated 1268 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:16:10.909485 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f66c82-89d5-4041-8dd0-d9a5ad96aa3d None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:10.947443 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f90e80-ecf0-4a31-b6ca-4a019ee0546c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:10.948366 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f90e80-ecf0-4a31-b6ca-4a019ee0546c None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:10.948798 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f90e80-ecf0-4a31-b6ca-4a019ee0546c None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:10.949274 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f90e80-ecf0-4a31-b6ca-4a019ee0546c None admin] PATH_INFO: `/v3/services` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:10.950170 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f90e80-ecf0-4a31-b6ca-4a019ee0546c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:10.950628 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f90e80-ecf0-4a31-b6ca-4a019ee0546c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:10.952177 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f90e80-ecf0-4a31-b6ca-4a019ee0546c None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:10.958104 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 446/888] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Mar 30 01:16:10 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:11.557324 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4c069-e10b-49bb-94bc-66c9170e943c None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:11.557871 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4c069-e10b-49bb-94bc-66c9170e943c None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:11.557871 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4c069-e10b-49bb-94bc-66c9170e943c None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:11.560059 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 443/889] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:16:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:16:11.565497 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b68553-5159-41d2-8173-9a78ddc64f73 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:11.565785 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b68553-5159-41d2-8173-9a78ddc64f73 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:11.566064 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b68553-5159-41d2-8173-9a78ddc64f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:11.583597 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-c3b68553-5159-41d2-8173-9a78ddc64f73 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:16:11.584783 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-c3b68553-5159-41d2-8173-9a78ddc64f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:16:11.662867 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 447/890] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:16:11 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 01:16:11.679919 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f4c069-e10b-49bb-94bc-66c9170e943c None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:11.790246 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f4c069-e10b-49bb-94bc-66c9170e943c None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:11.824809 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf55fe3-f62e-4b74-b77c-5f5ec0c46d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:11.825956 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf55fe3-f62e-4b74-b77c-5f5ec0c46d3a None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:11.826459 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf55fe3-f62e-4b74-b77c-5f5ec0c46d3a None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:11.827003 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf55fe3-f62e-4b74-b77c-5f5ec0c46d3a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:11.827838 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf55fe3-f62e-4b74-b77c-5f5ec0c46d3a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:11.829429 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf55fe3-f62e-4b74-b77c-5f5ec0c46d3a None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:11.841285 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-7cf55fe3-f62e-4b74-b77c-5f5ec0c46d3a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Mar 30 01:16:11.843078 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 444/891] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Mar 30 01:16:11 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 01:16:11.850729 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b68553-5159-41d2-8173-9a78ddc64f73 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:11.928082 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a033e32c-65be-4066-9d99-0eed8b7798be None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:11.928746 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a033e32c-65be-4066-9d99-0eed8b7798be None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:11.929218 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a033e32c-65be-4066-9d99-0eed8b7798be None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:11.931537 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 445/892] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:16:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 01:16:11.936752 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b03e0dc-aa19-422f-94f2-34a30bb041dd None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:11.937290 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b03e0dc-aa19-422f-94f2-34a30bb041dd None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:11.937765 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b03e0dc-aa19-422f-94f2-34a30bb041dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:11.952038 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b68553-5159-41d2-8173-9a78ddc64f73 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:11.956112 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-3b03e0dc-aa19-422f-94f2-34a30bb041dd None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:16:11.957503 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-3b03e0dc-aa19-422f-94f2-34a30bb041dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:16:11.987470 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4712e22-317a-4de5-bfb2-7ba73b55c60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:11.988274 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4712e22-317a-4de5-bfb2-7ba73b55c60e None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:11.988575 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4712e22-317a-4de5-bfb2-7ba73b55c60e None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:11.988847 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4712e22-317a-4de5-bfb2-7ba73b55c60e None admin] PATH_INFO: `/v3/services` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:11.989862 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4712e22-317a-4de5-bfb2-7ba73b55c60e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:11.990177 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4712e22-317a-4de5-bfb2-7ba73b55c60e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:11.991821 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4712e22-317a-4de5-bfb2-7ba73b55c60e None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:12.002737 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 448/893] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Mar 30 01:16:11 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:12.004014 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4712e22-317a-4de5-bfb2-7ba73b55c60e None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:12.046748 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 446/894] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:16:11 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 30 01:16:12.068361 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b03e0dc-aa19-422f-94f2-34a30bb041dd None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:12.129653 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4712e22-317a-4de5-bfb2-7ba73b55c60e None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:12.172674 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc938f-7322-4ba7-ae9f-19069bac7be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:12.173826 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc938f-7322-4ba7-ae9f-19069bac7be1 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:12.175332 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc938f-7322-4ba7-ae9f-19069bac7be1 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:12.175782 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc938f-7322-4ba7-ae9f-19069bac7be1 None admin] PATH_INFO: `/v3/services` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:12.176964 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbc938f-7322-4ba7-ae9f-19069bac7be1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:12.177591 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbc938f-7322-4ba7-ae9f-19069bac7be1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:12.179765 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbc938f-7322-4ba7-ae9f-19069bac7be1 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:12.186462 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 449/895] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Mar 30 01:16:12 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:12.192687 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b03e0dc-aa19-422f-94f2-34a30bb041dd None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:12.196084 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc938f-7322-4ba7-ae9f-19069bac7be1 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:12.234412 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba1d949-aefc-4c56-9320-f78e170c5b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:12.235872 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1d949-aefc-4c56-9320-f78e170c5b0e None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:12.237182 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1d949-aefc-4c56-9320-f78e170c5b0e None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:12.237637 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1d949-aefc-4c56-9320-f78e170c5b0e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:12.250033 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba1d949-aefc-4c56-9320-f78e170c5b0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:16:12.260122 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-aba1d949-aefc-4c56-9320-f78e170c5b0e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 30 01:16:12.267032 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 447/896] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Mar 30 01:16:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 01:16:12.267900 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba1d949-aefc-4c56-9320-f78e170c5b0e None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:12.306814 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc938f-7322-4ba7-ae9f-19069bac7be1 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:12.340652 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7de3e58-ca2c-4258-90ab-a805849055fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:12.341068 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de3e58-ca2c-4258-90ab-a805849055fe None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:12.341351 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de3e58-ca2c-4258-90ab-a805849055fe None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:12.341627 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de3e58-ca2c-4258-90ab-a805849055fe None admin] PATH_INFO: `/v3/endpoints` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:12.342475 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7de3e58-ca2c-4258-90ab-a805849055fe None admin] RBAC: Adding query filter params (interface=public, service_id=49c187cbe17d4e01a2067422946824c6, region_id=RegionOne) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:12.342726 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7de3e58-ca2c-4258-90ab-a805849055fe None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:12.344116 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7de3e58-ca2c-4258-90ab-a805849055fe None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:12.354537 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 450/897] 10.222.0.30 () {56 vars in 1251 bytes} [Wed Mar 30 01:16:12 2022] GET /identity/v3/endpoints?service_id=49c187cbe17d4e01a2067422946824c6&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:12.355738 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7de3e58-ca2c-4258-90ab-a805849055fe None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:12.391354 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba1d949-aefc-4c56-9320-f78e170c5b0e None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:12.433094 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8510d4dd-92b7-46b3-8749-e11f0cbe41c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:12.434254 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510d4dd-92b7-46b3-8749-e11f0cbe41c7 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:12.434780 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510d4dd-92b7-46b3-8749-e11f0cbe41c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:12.435220 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510d4dd-92b7-46b3-8749-e11f0cbe41c7 None admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:12.436236 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8510d4dd-92b7-46b3-8749-e11f0cbe41c7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:12.437021 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8510d4dd-92b7-46b3-8749-e11f0cbe41c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:12.438997 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8510d4dd-92b7-46b3-8749-e11f0cbe41c7 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:12.450591 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 448/898] 10.222.0.30 () {56 vars in 1115 bytes} [Wed Mar 30 01:16:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:16:12.456064 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8510d4dd-92b7-46b3-8749-e11f0cbe41c7 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:12.460264 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7de3e58-ca2c-4258-90ab-a805849055fe None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:12.507980 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42329f75-5392-491b-8685-2eb64f3483b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:12.508646 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42329f75-5392-491b-8685-2eb64f3483b1 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:12.508927 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42329f75-5392-491b-8685-2eb64f3483b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:12.509199 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42329f75-5392-491b-8685-2eb64f3483b1 None admin] PATH_INFO: `/v3/services` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:12.509870 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42329f75-5392-491b-8685-2eb64f3483b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:12.511285 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42329f75-5392-491b-8685-2eb64f3483b1 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:12.522847 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 451/899] 10.222.0.30 () {56 vars in 1087 bytes} [Wed Mar 30 01:16:12 2022] GET /identity/v3/services => generated 1268 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 01:16:12.569972 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8510d4dd-92b7-46b3-8749-e11f0cbe41c7 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:12.608544 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef67089-203d-481b-9286-1d80c62b3f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:12.609709 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef67089-203d-481b-9286-1d80c62b3f61 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:12.610185 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef67089-203d-481b-9286-1d80c62b3f61 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:12.610651 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef67089-203d-481b-9286-1d80c62b3f61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:12.630690 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef67089-203d-481b-9286-1d80c62b3f61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:12.632567 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef67089-203d-481b-9286-1d80c62b3f61 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:12.656857 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-0ef67089-203d-481b-9286-1d80c62b3f61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:16:12.662633 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 449/900] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:16:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 01:16:12.665057 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42329f75-5392-491b-8685-2eb64f3483b1 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:12.769460 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42329f75-5392-491b-8685-2eb64f3483b1 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:12.804785 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828b5b83-2d06-461a-b013-160496817705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:12.805802 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b5b83-2d06-461a-b013-160496817705 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:12.806283 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b5b83-2d06-461a-b013-160496817705 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:12.806774 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b5b83-2d06-461a-b013-160496817705 None admin] PATH_INFO: `/v3/domains` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:12.807729 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828b5b83-2d06-461a-b013-160496817705 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:12.808221 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828b5b83-2d06-461a-b013-160496817705 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:12.809781 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828b5b83-2d06-461a-b013-160496817705 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:12.821854 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 452/901] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:16:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:12.827525 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef67089-203d-481b-9286-1d80c62b3f61 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:12.934074 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef67089-203d-481b-9286-1d80c62b3f61 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:12.971767 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112309e0-c6ed-4ae4-84ec-799df3629cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:12.973029 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112309e0-c6ed-4ae4-84ec-799df3629cb1 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:12.973511 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112309e0-c6ed-4ae4-84ec-799df3629cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:12.974086 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112309e0-c6ed-4ae4-84ec-799df3629cb1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:12.985033 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112309e0-c6ed-4ae4-84ec-799df3629cb1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:12.987056 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112309e0-c6ed-4ae4-84ec-799df3629cb1 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:13.002858 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-112309e0-c6ed-4ae4-84ec-799df3629cb1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 30 01:16:13.004709 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 450/902] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Mar 30 01:16:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:16:13.010433 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828b5b83-2d06-461a-b013-160496817705 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:13.115624 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828b5b83-2d06-461a-b013-160496817705 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:13.148861 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab49dd5b-48b2-403f-8e95-bb4b7aa4d991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:13.149537 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab49dd5b-48b2-403f-8e95-bb4b7aa4d991 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:13.149820 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab49dd5b-48b2-403f-8e95-bb4b7aa4d991 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:13.150098 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab49dd5b-48b2-403f-8e95-bb4b7aa4d991 None admin] PATH_INFO: `/v3/users` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:13.150964 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab49dd5b-48b2-403f-8e95-bb4b7aa4d991 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:13.151277 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab49dd5b-48b2-403f-8e95-bb4b7aa4d991 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:13.152708 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab49dd5b-48b2-403f-8e95-bb4b7aa4d991 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:13.171479 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 453/903] 10.222.0.30 () {56 vars in 1149 bytes} [Wed Mar 30 01:16:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:13.177559 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112309e0-c6ed-4ae4-84ec-799df3629cb1 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:13.223471 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32b629-8816-4b7a-b7e7-4a67ca65cd65 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:13.223751 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32b629-8816-4b7a-b7e7-4a67ca65cd65 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:13.223959 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32b629-8816-4b7a-b7e7-4a67ca65cd65 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:13.226043 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 454/904] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:16:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 01:16:13.230799 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3b0c4-b849-4a59-8c95-f7a8c6bf708e None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:13.231193 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3b0c4-b849-4a59-8c95-f7a8c6bf708e None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:13.231626 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3b0c4-b849-4a59-8c95-f7a8c6bf708e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:13.249357 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-16e3b0c4-b849-4a59-8c95-f7a8c6bf708e None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:16:13.250765 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-16e3b0c4-b849-4a59-8c95-f7a8c6bf708e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:16:13.287026 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112309e0-c6ed-4ae4-84ec-799df3629cb1 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:13.320126 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 455/905] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:16:13 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 30 01:16:13.320849 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd6310b-22e8-46a1-b9df-fed501c6f8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:13.321496 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd6310b-22e8-46a1-b9df-fed501c6f8e2 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:13.321774 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd6310b-22e8-46a1-b9df-fed501c6f8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:13.322045 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd6310b-22e8-46a1-b9df-fed501c6f8e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:13.336103 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929776df-bf16-4002-8cfc-e246e47e1898 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:13.336385 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929776df-bf16-4002-8cfc-e246e47e1898 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:13.336671 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929776df-bf16-4002-8cfc-e246e47e1898 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:13.342478 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 456/906] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:16:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 01:16:13.343721 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f5050f-f9d0-4c07-97eb-c15a34cca097 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:13.344012 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f5050f-f9d0-4c07-97eb-c15a34cca097 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:13.344297 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f5050f-f9d0-4c07-97eb-c15a34cca097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:13.362093 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-c8f5050f-f9d0-4c07-97eb-c15a34cca097 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:16:13.363323 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-c8f5050f-f9d0-4c07-97eb-c15a34cca097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:16:13.394675 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd6310b-22e8-46a1-b9df-fed501c6f8e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:13.396243 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd6310b-22e8-46a1-b9df-fed501c6f8e2 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:13.430753 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 457/907] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:16:13 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 01:16:13.430753 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f5050f-f9d0-4c07-97eb-c15a34cca097 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:13.501854 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 451/908] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Mar 30 01:16:13 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 30 01:16:13.503699 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd6310b-22e8-46a1-b9df-fed501c6f8e2 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:13.524449 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f5050f-f9d0-4c07-97eb-c15a34cca097 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:13.558469 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9775d929-e356-4311-ba4a-aafc8b9d68f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:13.559951 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9775d929-e356-4311-ba4a-aafc8b9d68f1 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:13.560379 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9775d929-e356-4311-ba4a-aafc8b9d68f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:13.561056 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9775d929-e356-4311-ba4a-aafc8b9d68f1 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:13.562034 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9775d929-e356-4311-ba4a-aafc8b9d68f1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:13.564164 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9775d929-e356-4311-ba4a-aafc8b9d68f1 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:13.576231 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-9775d929-e356-4311-ba4a-aafc8b9d68f1 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Mar 30 01:16:13.578736 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 458/909] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Mar 30 01:16:13 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:16:13.578736 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9775d929-e356-4311-ba4a-aafc8b9d68f1 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:13.609977 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd6310b-22e8-46a1-b9df-fed501c6f8e2 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:13.643863 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2ddfde-5423-4e96-b27a-9491fb3c37e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:13.644529 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ddfde-5423-4e96-b27a-9491fb3c37e8 None admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:13.644891 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ddfde-5423-4e96-b27a-9491fb3c37e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:13.645167 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ddfde-5423-4e96-b27a-9491fb3c37e8 None admin] PATH_INFO: `/v3/services` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:13.645884 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2ddfde-5423-4e96-b27a-9491fb3c37e8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:13.647478 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2ddfde-5423-4e96-b27a-9491fb3c37e8 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:13.667140 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 452/910] 10.222.0.30 () {60 vars in 1141 bytes} [Wed Mar 30 01:16:13 2022] POST /identity/v3/services => generated 241 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:16:13.668315 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2ddfde-5423-4e96-b27a-9491fb3c37e8 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:13.681142 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9775d929-e356-4311-ba4a-aafc8b9d68f1 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:13.725706 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac1fb68-3d15-4a08-8e02-771a94234ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:13.726525 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1fb68-3d15-4a08-8e02-771a94234ef4 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:13.726841 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1fb68-3d15-4a08-8e02-771a94234ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:13.727119 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1fb68-3d15-4a08-8e02-771a94234ef4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:13.739812 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac1fb68-3d15-4a08-8e02-771a94234ef4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:13.741322 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac1fb68-3d15-4a08-8e02-771a94234ef4 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:13.760536 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-6ac1fb68-3d15-4a08-8e02-771a94234ef4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:16:13.766122 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 459/911] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:16:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:16:13.768289 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac1fb68-3d15-4a08-8e02-771a94234ef4 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:13.796742 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2ddfde-5423-4e96-b27a-9491fb3c37e8 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:13.833163 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779f16ec-1ce0-40f0-97ec-d9c11306126d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:13.834208 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f16ec-1ce0-40f0-97ec-d9c11306126d None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:13.834774 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f16ec-1ce0-40f0-97ec-d9c11306126d None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:13.835257 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f16ec-1ce0-40f0-97ec-d9c11306126d None admin] PATH_INFO: `/v3/services` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:13.836185 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779f16ec-1ce0-40f0-97ec-d9c11306126d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:13.836699 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779f16ec-1ce0-40f0-97ec-d9c11306126d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:13.838321 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779f16ec-1ce0-40f0-97ec-d9c11306126d None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:13.844076 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 453/912] 10.222.0.30 () {56 vars in 1126 bytes} [Wed Mar 30 01:16:13 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:13.850086 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779f16ec-1ce0-40f0-97ec-d9c11306126d None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:13.886038 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac1fb68-3d15-4a08-8e02-771a94234ef4 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:13.926435 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fcbace-1968-40df-956b-329fb2d6fe0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:13.927157 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fcbace-1968-40df-956b-329fb2d6fe0b None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:13.927444 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fcbace-1968-40df-956b-329fb2d6fe0b None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:13.927722 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fcbace-1968-40df-956b-329fb2d6fe0b None admin] PATH_INFO: `/v3/domains` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:13.928443 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fcbace-1968-40df-956b-329fb2d6fe0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:13.928747 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fcbace-1968-40df-956b-329fb2d6fe0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:13.930153 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fcbace-1968-40df-956b-329fb2d6fe0b None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:13.943967 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 460/913] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:16:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:13.949376 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fcbace-1968-40df-956b-329fb2d6fe0b None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:13.972735 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779f16ec-1ce0-40f0-97ec-d9c11306126d None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:14.013291 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1560c8-b57b-4453-b4a4-850b123de730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:14.014145 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1560c8-b57b-4453-b4a4-850b123de730 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:14.014506 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1560c8-b57b-4453-b4a4-850b123de730 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:14.014908 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1560c8-b57b-4453-b4a4-850b123de730 None admin] PATH_INFO: `/v3/services` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:14.015987 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1560c8-b57b-4453-b4a4-850b123de730 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:14.016366 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1560c8-b57b-4453-b4a4-850b123de730 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:14.018417 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1560c8-b57b-4453-b4a4-850b123de730 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:14.025099 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 454/914] 10.222.0.30 () {56 vars in 1126 bytes} [Wed Mar 30 01:16:13 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:14.030444 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1560c8-b57b-4453-b4a4-850b123de730 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:14.070158 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fcbace-1968-40df-956b-329fb2d6fe0b None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:14.113216 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abd3813-4601-4255-a906-c82789898357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:14.114651 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd3813-4601-4255-a906-c82789898357 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:14.115203 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd3813-4601-4255-a906-c82789898357 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:14.115849 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd3813-4601-4255-a906-c82789898357 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:14.125089 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abd3813-4601-4255-a906-c82789898357 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:14.127270 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abd3813-4601-4255-a906-c82789898357 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:14.142430 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-8abd3813-4601-4255-a906-c82789898357 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 30 01:16:14.144938 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 461/915] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Mar 30 01:16:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 01:16:14.147956 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1560c8-b57b-4453-b4a4-850b123de730 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:14.150478 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abd3813-4601-4255-a906-c82789898357 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:14.190905 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16cede-dfa2-43b9-942c-303ed9ec08a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:14.191971 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16cede-dfa2-43b9-942c-303ed9ec08a4 None admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:14.192852 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16cede-dfa2-43b9-942c-303ed9ec08a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:14.193335 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16cede-dfa2-43b9-942c-303ed9ec08a4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:14.194671 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e16cede-dfa2-43b9-942c-303ed9ec08a4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:14.196913 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e16cede-dfa2-43b9-942c-303ed9ec08a4 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:14.230733 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 455/916] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Mar 30 01:16:14 2022] POST /identity/v3/endpoints => generated 347 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 01:16:14.271574 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abd3813-4601-4255-a906-c82789898357 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:14.314062 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cebdbc-8532-4ba4-9db8-b3bd983ffb9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:14.314904 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cebdbc-8532-4ba4-9db8-b3bd983ffb9f None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:14.315191 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cebdbc-8532-4ba4-9db8-b3bd983ffb9f None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:14.315469 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cebdbc-8532-4ba4-9db8-b3bd983ffb9f None admin] PATH_INFO: `/v3/projects` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:14.316255 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cebdbc-8532-4ba4-9db8-b3bd983ffb9f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:14.316563 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cebdbc-8532-4ba4-9db8-b3bd983ffb9f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:14.318030 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cebdbc-8532-4ba4-9db8-b3bd983ffb9f None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:14.332383 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 462/917] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Mar 30 01:16:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:16:14.340300 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16cede-dfa2-43b9-942c-303ed9ec08a4 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:14.451295 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16cede-dfa2-43b9-942c-303ed9ec08a4 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:14.487998 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f5b8e5-8310-47b3-b816-cbf6bd29e50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:14.488673 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f5b8e5-8310-47b3-b816-cbf6bd29e50b None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:14.489021 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f5b8e5-8310-47b3-b816-cbf6bd29e50b None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:14.489291 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f5b8e5-8310-47b3-b816-cbf6bd29e50b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:14.490236 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f5b8e5-8310-47b3-b816-cbf6bd29e50b None admin] RBAC: Adding query filter params (role.id=ead4e9a9b7e947e1bff82fa3300df26c, scope.project.id=0c9a4444228d4be89a4ba8aa53099531, user.id=0503fdca7f834ef0a81422804dc74812) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:14.490548 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f5b8e5-8310-47b3-b816-cbf6bd29e50b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:14.492010 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f5b8e5-8310-47b3-b816-cbf6bd29e50b None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:14.498277 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 456/918] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Mar 30 01:16:14 2022] GET /identity/v3/role_assignments?user.id=0503fdca7f834ef0a81422804dc74812&scope.project.id=0c9a4444228d4be89a4ba8aa53099531&role.id=ead4e9a9b7e947e1bff82fa3300df26c => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:14.932541 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5828e1-49c6-40db-9ad8-6140e40ce9e5 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:14.932892 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5828e1-49c6-40db-9ad8-6140e40ce9e5 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:14.933009 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5828e1-49c6-40db-9ad8-6140e40ce9e5 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:14.935066 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 463/919] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:16:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:16:14.941371 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729ba913-0bff-4138-9c3b-3b772ba6ee1f None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:14.942207 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729ba913-0bff-4138-9c3b-3b772ba6ee1f None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:14.942674 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729ba913-0bff-4138-9c3b-3b772ba6ee1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:14.960066 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-729ba913-0bff-4138-9c3b-3b772ba6ee1f None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:16:14.961528 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-729ba913-0bff-4138-9c3b-3b772ba6ee1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:16:15.033160 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 457/920] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:16:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 30 01:16:15.052174 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5828e1-49c6-40db-9ad8-6140e40ce9e5 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:15.153410 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5828e1-49c6-40db-9ad8-6140e40ce9e5 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:15.188348 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6baa39-2c59-4492-a78f-879bdc1c2d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:15.189081 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6baa39-2c59-4492-a78f-879bdc1c2d7b None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:15.189859 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6baa39-2c59-4492-a78f-879bdc1c2d7b None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:15.190170 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6baa39-2c59-4492-a78f-879bdc1c2d7b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:15.190854 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6baa39-2c59-4492-a78f-879bdc1c2d7b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:15.192224 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6baa39-2c59-4492-a78f-879bdc1c2d7b None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:15.203365 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-de6baa39-2c59-4492-a78f-879bdc1c2d7b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Mar 30 01:16:15.204871 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 464/921] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Mar 30 01:16:15 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:16:15.212184 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729ba913-0bff-4138-9c3b-3b772ba6ee1f None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:15.313642 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729ba913-0bff-4138-9c3b-3b772ba6ee1f None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:15.348190 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ea7d0-9e08-4921-8880-1eaf1ad6009d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:15.349212 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ea7d0-9e08-4921-8880-1eaf1ad6009d None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:15.349690 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ea7d0-9e08-4921-8880-1eaf1ad6009d None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:15.350156 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ea7d0-9e08-4921-8880-1eaf1ad6009d None admin] PATH_INFO: `/v3/services` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:15.351078 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33ea7d0-9e08-4921-8880-1eaf1ad6009d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:15.351619 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33ea7d0-9e08-4921-8880-1eaf1ad6009d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:15.353159 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33ea7d0-9e08-4921-8880-1eaf1ad6009d None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:15.362798 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 458/922] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Mar 30 01:16:15 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:15.367785 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6baa39-2c59-4492-a78f-879bdc1c2d7b None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:15.474552 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6baa39-2c59-4492-a78f-879bdc1c2d7b None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:15.509472 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ad4f2-1be9-42d3-bae0-56337c9faba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:15.510531 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ad4f2-1be9-42d3-bae0-56337c9faba5 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:15.511194 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ad4f2-1be9-42d3-bae0-56337c9faba5 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:15.511658 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ad4f2-1be9-42d3-bae0-56337c9faba5 None admin] PATH_INFO: `/v3/services` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:15.512561 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296ad4f2-1be9-42d3-bae0-56337c9faba5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:15.513076 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296ad4f2-1be9-42d3-bae0-56337c9faba5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:15.514640 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296ad4f2-1be9-42d3-bae0-56337c9faba5 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:15.520834 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 465/923] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Mar 30 01:16:15 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:15.526762 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ea7d0-9e08-4921-8880-1eaf1ad6009d None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:15.628441 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ea7d0-9e08-4921-8880-1eaf1ad6009d None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:15.662631 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ae05f7-fb1f-4d01-a558-9213ef1328dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:15.663346 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ae05f7-fb1f-4d01-a558-9213ef1328dd None admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:15.663626 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ae05f7-fb1f-4d01-a558-9213ef1328dd None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:15.663898 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ae05f7-fb1f-4d01-a558-9213ef1328dd None admin] PATH_INFO: `/v3/endpoints` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:15.664652 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ae05f7-fb1f-4d01-a558-9213ef1328dd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:15.666102 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ae05f7-fb1f-4d01-a558-9213ef1328dd None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:15.695309 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 459/924] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Mar 30 01:16:15 2022] POST /identity/v3/endpoints => generated 346 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:16:16.116787 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706793dc-daad-4fdc-91e2-e5e869f3a48e None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:16.117163 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706793dc-daad-4fdc-91e2-e5e869f3a48e None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:16.117356 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706793dc-daad-4fdc-91e2-e5e869f3a48e None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:16.119466 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 466/925] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:16:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:16:16.124663 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8fb6fa-0e0d-49d3-a83e-3eb219759122 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:16.125097 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8fb6fa-0e0d-49d3-a83e-3eb219759122 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:16.125282 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8fb6fa-0e0d-49d3-a83e-3eb219759122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:16.142534 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-2c8fb6fa-0e0d-49d3-a83e-3eb219759122 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:16:16.144042 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-2c8fb6fa-0e0d-49d3-a83e-3eb219759122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:16:16.216716 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 460/926] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:16:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 01:16:16.240221 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706793dc-daad-4fdc-91e2-e5e869f3a48e None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:16.347907 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706793dc-daad-4fdc-91e2-e5e869f3a48e None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:16.385326 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d28d707-a950-444f-b8c2-6b8f981a5f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:16.386044 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d28d707-a950-444f-b8c2-6b8f981a5f78 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:16.386373 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d28d707-a950-444f-b8c2-6b8f981a5f78 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:16.386650 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d28d707-a950-444f-b8c2-6b8f981a5f78 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:16.387399 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d28d707-a950-444f-b8c2-6b8f981a5f78 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:16.388762 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d28d707-a950-444f-b8c2-6b8f981a5f78 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:16.400767 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-6d28d707-a950-444f-b8c2-6b8f981a5f78 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 30 01:16:16.402331 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 467/927] 10.222.0.30 () {56 vars in 1126 bytes} [Wed Mar 30 01:16:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:16:16.408377 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8fb6fa-0e0d-49d3-a83e-3eb219759122 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:16.513423 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8fb6fa-0e0d-49d3-a83e-3eb219759122 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:16.552845 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec1704b-f271-47e1-8a1e-e6409d2939c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:16.553897 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1704b-f271-47e1-8a1e-e6409d2939c6 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:16.554382 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1704b-f271-47e1-8a1e-e6409d2939c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:16.554910 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1704b-f271-47e1-8a1e-e6409d2939c6 None admin] PATH_INFO: `/v3/services` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:16.556130 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec1704b-f271-47e1-8a1e-e6409d2939c6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:16.556662 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec1704b-f271-47e1-8a1e-e6409d2939c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:16.558259 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec1704b-f271-47e1-8a1e-e6409d2939c6 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:16.564049 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 461/928] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Mar 30 01:16:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:16.570247 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d28d707-a950-444f-b8c2-6b8f981a5f78 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:16.631528 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf9489-71c4-4ecb-be1e-97a02ea9d775 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:16.631810 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf9489-71c4-4ecb-be1e-97a02ea9d775 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:16.632346 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf9489-71c4-4ecb-be1e-97a02ea9d775 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:16.634611 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 462/929] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:16:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 01:16:16.640544 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d91b97-f19f-4045-a72c-e1f1b5c3d101 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:16.641080 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d91b97-f19f-4045-a72c-e1f1b5c3d101 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:16.641581 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d91b97-f19f-4045-a72c-e1f1b5c3d101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:16.659694 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-53d91b97-f19f-4045-a72c-e1f1b5c3d101 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:16:16.661210 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-53d91b97-f19f-4045-a72c-e1f1b5c3d101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:16:16.687589 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d28d707-a950-444f-b8c2-6b8f981a5f78 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:16.729237 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96080d61-4590-411b-8284-daf5e0543b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:16.730175 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96080d61-4590-411b-8284-daf5e0543b25 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:16.730590 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96080d61-4590-411b-8284-daf5e0543b25 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:16.731023 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96080d61-4590-411b-8284-daf5e0543b25 None admin] PATH_INFO: `/v3/services` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:16.731858 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96080d61-4590-411b-8284-daf5e0543b25 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:16.732309 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96080d61-4590-411b-8284-daf5e0543b25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:16.733807 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96080d61-4590-411b-8284-daf5e0543b25 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:16.735264 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 463/930] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:16:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 30 01:16:16.739525 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 468/931] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Mar 30 01:16:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:16.745258 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d91b97-f19f-4045-a72c-e1f1b5c3d101 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:16.754416 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96080d61-4590-411b-8284-daf5e0543b25 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:16.852329 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d91b97-f19f-4045-a72c-e1f1b5c3d101 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:16.855724 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96080d61-4590-411b-8284-daf5e0543b25 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:16.887501 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8010e9-a6d5-4475-8c3a-176f37a6f5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:16.888591 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8010e9-a6d5-4475-8c3a-176f37a6f5a1 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:16.889048 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8010e9-a6d5-4475-8c3a-176f37a6f5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:16.889466 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8010e9-a6d5-4475-8c3a-176f37a6f5a1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:16.890460 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140677f1-7cf4-4e75-b5d8-3dab4b0c01e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:16.890647 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8010e9-a6d5-4475-8c3a-176f37a6f5a1 None admin] RBAC: Adding query filter params (interface=public, service_id=7b159ff8440648f6bd05c2eec0a8b2b2, region_id=RegionOne) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:16.890853 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8010e9-a6d5-4475-8c3a-176f37a6f5a1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:16.891829 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140677f1-7cf4-4e75-b5d8-3dab4b0c01e3 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:16.892356 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140677f1-7cf4-4e75-b5d8-3dab4b0c01e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:16.892579 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8010e9-a6d5-4475-8c3a-176f37a6f5a1 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:16.893058 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140677f1-7cf4-4e75-b5d8-3dab4b0c01e3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:16.893926 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140677f1-7cf4-4e75-b5d8-3dab4b0c01e3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:16.895578 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140677f1-7cf4-4e75-b5d8-3dab4b0c01e3 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:16.902820 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 464/932] 10.222.0.30 () {56 vars in 1251 bytes} [Wed Mar 30 01:16:16 2022] GET /identity/v3/endpoints?service_id=7b159ff8440648f6bd05c2eec0a8b2b2&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:16.904889 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926d8c0-a1c4-4b07-b022-0ace64545551 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:16.905185 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926d8c0-a1c4-4b07-b022-0ace64545551 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:16.905466 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926d8c0-a1c4-4b07-b022-0ace64545551 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:16.907452 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 465/933] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:16:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:16:16.908022 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3926d8c0-a1c4-4b07-b022-0ace64545551 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:16.909021 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-140677f1-7cf4-4e75-b5d8-3dab4b0c01e3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Mar 30 01:16:16.912346 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 469/934] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Mar 30 01:16:16 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 01:16:16.916406 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38208821-b21f-49ed-a224-7f97c110556e None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:16.916693 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38208821-b21f-49ed-a224-7f97c110556e None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:16.916972 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38208821-b21f-49ed-a224-7f97c110556e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:16.933990 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-38208821-b21f-49ed-a224-7f97c110556e None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:16:16.935211 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-38208821-b21f-49ed-a224-7f97c110556e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:16:17.003363 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 470/935] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:16:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 30 01:16:17.004045 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38208821-b21f-49ed-a224-7f97c110556e None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:17.021841 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3926d8c0-a1c4-4b07-b022-0ace64545551 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:17.062118 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db25f237-4513-4913-8fc2-791735068a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:17.062948 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25f237-4513-4913-8fc2-791735068a38 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:17.063425 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25f237-4513-4913-8fc2-791735068a38 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:17.063555 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25f237-4513-4913-8fc2-791735068a38 None admin] PATH_INFO: `/v3/services` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:17.064445 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db25f237-4513-4913-8fc2-791735068a38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:17.066173 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db25f237-4513-4913-8fc2-791735068a38 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:17.082966 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 466/936] 10.222.0.30 () {56 vars in 1087 bytes} [Wed Mar 30 01:16:16 2022] GET /identity/v3/services => generated 1497 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:16:17.082966 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db25f237-4513-4913-8fc2-791735068a38 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:17.120019 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38208821-b21f-49ed-a224-7f97c110556e None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:17.157072 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b7052e-3a84-4c6d-983d-462e55e295e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:17.157661 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7052e-3a84-4c6d-983d-462e55e295e1 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:17.157941 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7052e-3a84-4c6d-983d-462e55e295e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:17.158935 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7052e-3a84-4c6d-983d-462e55e295e1 None admin] PATH_INFO: `/v3/services` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:17.159653 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b7052e-3a84-4c6d-983d-462e55e295e1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:17.159957 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b7052e-3a84-4c6d-983d-462e55e295e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:17.161360 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b7052e-3a84-4c6d-983d-462e55e295e1 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:17.170742 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 471/937] 10.222.0.30 () {56 vars in 1112 bytes} [Wed Mar 30 01:16:17 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:17.172544 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b7052e-3a84-4c6d-983d-462e55e295e1 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:17.190742 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db25f237-4513-4913-8fc2-791735068a38 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:17.235552 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a895f4-435c-4856-9512-5d08d9213c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:17.236913 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a895f4-435c-4856-9512-5d08d9213c22 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:17.237189 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a895f4-435c-4856-9512-5d08d9213c22 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:17.237467 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a895f4-435c-4856-9512-5d08d9213c22 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:17.250376 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a895f4-435c-4856-9512-5d08d9213c22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:16:17.259119 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-c1a895f4-435c-4856-9512-5d08d9213c22 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 30 01:16:17.265961 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 467/938] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Mar 30 01:16:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:16:17.268091 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a895f4-435c-4856-9512-5d08d9213c22 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:17.300911 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b7052e-3a84-4c6d-983d-462e55e295e1 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:17.344313 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36dd999-f171-4bec-8114-a2ce954ccff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:17.344977 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36dd999-f171-4bec-8114-a2ce954ccff6 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:17.345418 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36dd999-f171-4bec-8114-a2ce954ccff6 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:17.346439 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36dd999-f171-4bec-8114-a2ce954ccff6 None admin] PATH_INFO: `/v3/services` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:17.347683 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36dd999-f171-4bec-8114-a2ce954ccff6 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:17.347991 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36dd999-f171-4bec-8114-a2ce954ccff6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:17.349801 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36dd999-f171-4bec-8114-a2ce954ccff6 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:17.355620 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 472/939] 10.222.0.30 () {56 vars in 1112 bytes} [Wed Mar 30 01:16:17 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:16:17.387626 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a895f4-435c-4856-9512-5d08d9213c22 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:17.426629 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f0f93-417c-4a2e-bc08-c71be3358ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:17.427258 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f0f93-417c-4a2e-bc08-c71be3358ca0 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:17.427540 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f0f93-417c-4a2e-bc08-c71be3358ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:17.427815 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f0f93-417c-4a2e-bc08-c71be3358ca0 None admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:17.428571 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15f0f93-417c-4a2e-bc08-c71be3358ca0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:17.428873 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15f0f93-417c-4a2e-bc08-c71be3358ca0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:17.430368 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15f0f93-417c-4a2e-bc08-c71be3358ca0 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:17.441267 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 468/940] 10.222.0.30 () {56 vars in 1115 bytes} [Wed Mar 30 01:16:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:17.446846 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36dd999-f171-4bec-8114-a2ce954ccff6 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:17.555079 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36dd999-f171-4bec-8114-a2ce954ccff6 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:17.588754 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294c80f6-b596-439c-8370-f66f8b7967b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:17.589542 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c80f6-b596-439c-8370-f66f8b7967b8 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:17.589819 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c80f6-b596-439c-8370-f66f8b7967b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:17.590090 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c80f6-b596-439c-8370-f66f8b7967b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:17.600894 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294c80f6-b596-439c-8370-f66f8b7967b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:17.602333 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294c80f6-b596-439c-8370-f66f8b7967b8 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:17.624066 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-294c80f6-b596-439c-8370-f66f8b7967b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:16:17.625632 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 473/941] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:16:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:16:17.631819 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f0f93-417c-4a2e-bc08-c71be3358ca0 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:17.742517 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f0f93-417c-4a2e-bc08-c71be3358ca0 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:17.779287 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce56df22-b152-4229-be7f-62da23ca7a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:17.780196 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce56df22-b152-4229-be7f-62da23ca7a12 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:17.780476 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce56df22-b152-4229-be7f-62da23ca7a12 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:17.780749 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce56df22-b152-4229-be7f-62da23ca7a12 None admin] PATH_INFO: `/v3/domains` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:17.781467 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce56df22-b152-4229-be7f-62da23ca7a12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:17.781767 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce56df22-b152-4229-be7f-62da23ca7a12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:17.785197 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce56df22-b152-4229-be7f-62da23ca7a12 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:17.797460 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 469/942] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:16:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:16:17.802986 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294c80f6-b596-439c-8370-f66f8b7967b8 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:17.908947 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294c80f6-b596-439c-8370-f66f8b7967b8 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:17.943336 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a45019-f63d-4635-b5ad-7d369a295a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:17.944146 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a45019-f63d-4635-b5ad-7d369a295a33 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:17.944433 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a45019-f63d-4635-b5ad-7d369a295a33 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:17.944711 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a45019-f63d-4635-b5ad-7d369a295a33 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:17.952263 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a45019-f63d-4635-b5ad-7d369a295a33 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:17.953720 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a45019-f63d-4635-b5ad-7d369a295a33 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:17.968893 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-94a45019-f63d-4635-b5ad-7d369a295a33 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 30 01:16:17.970474 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 474/943] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Mar 30 01:16:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:16:17.976259 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce56df22-b152-4229-be7f-62da23ca7a12 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:18.082893 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce56df22-b152-4229-be7f-62da23ca7a12 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:18.116935 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe54c2-252a-4d1a-a20f-155520dd4bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:18.117603 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe54c2-252a-4d1a-a20f-155520dd4bd0 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:18.117878 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe54c2-252a-4d1a-a20f-155520dd4bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:18.118147 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe54c2-252a-4d1a-a20f-155520dd4bd0 None admin] PATH_INFO: `/v3/users` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:18.118996 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efe54c2-252a-4d1a-a20f-155520dd4bd0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:18.119304 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efe54c2-252a-4d1a-a20f-155520dd4bd0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:18.124902 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efe54c2-252a-4d1a-a20f-155520dd4bd0 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:18.125117 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c6ff26-b220-41d6-b098-0b617e9e71d0 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:18.125117 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c6ff26-b220-41d6-b098-0b617e9e71d0 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:18.125117 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c6ff26-b220-41d6-b098-0b617e9e71d0 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:18.125117 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 475/944] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:16:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 01:16:18.132670 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f438d4-3fd8-45d6-9a4a-0ac294bb9331 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:18.132670 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f438d4-3fd8-45d6-9a4a-0ac294bb9331 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:18.132670 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f438d4-3fd8-45d6-9a4a-0ac294bb9331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:18.139180 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 470/945] 10.222.0.30 () {56 vars in 1149 bytes} [Wed Mar 30 01:16:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:18.144295 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe54c2-252a-4d1a-a20f-155520dd4bd0 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:18.149523 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-e4f438d4-3fd8-45d6-9a4a-0ac294bb9331 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:16:18.150959 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-e4f438d4-3fd8-45d6-9a4a-0ac294bb9331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:16:18.230025 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 476/946] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:16:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 01:16:18.254779 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f438d4-3fd8-45d6-9a4a-0ac294bb9331 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:18.276608 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe54c2-252a-4d1a-a20f-155520dd4bd0 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:18.327910 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70dc2cc-027e-4613-afc6-d891f3638b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:18.328703 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70dc2cc-027e-4613-afc6-d891f3638b01 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:18.328988 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70dc2cc-027e-4613-afc6-d891f3638b01 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:18.329263 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70dc2cc-027e-4613-afc6-d891f3638b01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:18.344688 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70dc2cc-027e-4613-afc6-d891f3638b01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:18.346599 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70dc2cc-027e-4613-afc6-d891f3638b01 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:18.363616 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-b70dc2cc-027e-4613-afc6-d891f3638b01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:16:18.365194 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 471/947] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:16:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 01:16:18.374161 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f438d4-3fd8-45d6-9a4a-0ac294bb9331 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:18.374651 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70dc2cc-027e-4613-afc6-d891f3638b01 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:18.405174 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d216e67a-ad91-42f3-a789-c47ca831e8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:18.405992 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d216e67a-ad91-42f3-a789-c47ca831e8fc None admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:18.406400 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d216e67a-ad91-42f3-a789-c47ca831e8fc None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:18.406811 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d216e67a-ad91-42f3-a789-c47ca831e8fc None admin] PATH_INFO: `/v3/projects` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:18.407612 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d216e67a-ad91-42f3-a789-c47ca831e8fc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:18.409183 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d216e67a-ad91-42f3-a789-c47ca831e8fc None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:18.410618 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.common [None req-d216e67a-ad91-42f3-a789-c47ca831e8fc None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Mar 30 01:16:18.429494 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.sql.core [None req-d216e67a-ad91-42f3-a789-c47ca831e8fc None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Mar 30 01:16:18.429494 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Mar 30 01:16:18.429494 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [parameters: {'id': '866ade6cf85e445fb0cbe00d1b97be09', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Mar 30 01:16:18.429494 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79702) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Mar 30 01:16:18.449709 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-d216e67a-ad91-42f3-a789-c47ca831e8fc None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 866ade6cf85e445fb0cbe00d1b97be09.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 866ade6cf85e445fb0cbe00d1b97be09. Mar 30 01:16:18.452648 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 477/948] 10.222.0.30 () {60 vars in 1140 bytes} [Wed Mar 30 01:16:18 2022] POST /identity/v3/projects => generated 262 bytes in 198 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Mar 30 01:16:18.458316 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d216e67a-ad91-42f3-a789-c47ca831e8fc None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:18.492002 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70dc2cc-027e-4613-afc6-d891f3638b01 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:18.535870 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414015c4-8e82-4730-88b8-06e9570e7a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:18.536582 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414015c4-8e82-4730-88b8-06e9570e7a8a None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:18.537004 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414015c4-8e82-4730-88b8-06e9570e7a8a None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:18.537305 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414015c4-8e82-4730-88b8-06e9570e7a8a None admin] PATH_INFO: `/v3/domains` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:18.538514 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414015c4-8e82-4730-88b8-06e9570e7a8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:18.538972 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414015c4-8e82-4730-88b8-06e9570e7a8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:18.540354 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414015c4-8e82-4730-88b8-06e9570e7a8a None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:18.555610 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 472/949] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:16:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:18.563493 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414015c4-8e82-4730-88b8-06e9570e7a8a None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:18.584182 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d216e67a-ad91-42f3-a789-c47ca831e8fc None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:18.624369 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64bcfff-0327-405c-8557-0467888d9dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:18.625423 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64bcfff-0327-405c-8557-0467888d9dde None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:18.625923 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64bcfff-0327-405c-8557-0467888d9dde None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:18.626381 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64bcfff-0327-405c-8557-0467888d9dde None admin] PATH_INFO: `/v3/projects/service` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:18.634043 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64bcfff-0327-405c-8557-0467888d9dde None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:18.636019 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64bcfff-0327-405c-8557-0467888d9dde None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:18.656145 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-e64bcfff-0327-405c-8557-0467888d9dde None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 30 01:16:18.657955 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 478/950] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Mar 30 01:16:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 01:16:18.663501 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64bcfff-0327-405c-8557-0467888d9dde None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:18.667548 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414015c4-8e82-4730-88b8-06e9570e7a8a None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:18.701590 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c71d4c5-3dad-43da-be7e-962ebdba0611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:18.702382 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c71d4c5-3dad-43da-be7e-962ebdba0611 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:18.702665 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c71d4c5-3dad-43da-be7e-962ebdba0611 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:18.702972 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c71d4c5-3dad-43da-be7e-962ebdba0611 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:18.710826 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c71d4c5-3dad-43da-be7e-962ebdba0611 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:18.712365 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c71d4c5-3dad-43da-be7e-962ebdba0611 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:18.726055 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-6c71d4c5-3dad-43da-be7e-962ebdba0611 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 30 01:16:18.732305 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 473/951] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Mar 30 01:16:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:16:18.732992 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c71d4c5-3dad-43da-be7e-962ebdba0611 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:18.785526 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64bcfff-0327-405c-8557-0467888d9dde None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:18.827126 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995dde43-6828-45f5-a245-add9c758db38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:18.828073 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995dde43-6828-45f5-a245-add9c758db38 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:18.828362 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995dde43-6828-45f5-a245-add9c758db38 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:18.828644 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995dde43-6828-45f5-a245-add9c758db38 None admin] PATH_INFO: `/v3/projects` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:18.829397 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995dde43-6828-45f5-a245-add9c758db38 None admin] RBAC: Adding query filter params (name=service) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:18.829705 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995dde43-6828-45f5-a245-add9c758db38 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:18.832305 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995dde43-6828-45f5-a245-add9c758db38 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:18.850811 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c71d4c5-3dad-43da-be7e-962ebdba0611 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:18.857558 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 479/952] 10.222.0.30 () {56 vars in 1112 bytes} [Wed Mar 30 01:16:18 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:16:18.894294 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a8803c-f36e-44b4-a5a3-c12fac6f0ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:18.895388 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a8803c-f36e-44b4-a5a3-c12fac6f0ba7 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:18.895901 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a8803c-f36e-44b4-a5a3-c12fac6f0ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:18.896366 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a8803c-f36e-44b4-a5a3-c12fac6f0ba7 None admin] PATH_INFO: `/v3/projects` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:18.897372 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a8803c-f36e-44b4-a5a3-c12fac6f0ba7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:18.897902 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a8803c-f36e-44b4-a5a3-c12fac6f0ba7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:18.899626 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a8803c-f36e-44b4-a5a3-c12fac6f0ba7 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:18.914204 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 474/953] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Mar 30 01:16:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:18.920782 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995dde43-6828-45f5-a245-add9c758db38 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:19.031302 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995dde43-6828-45f5-a245-add9c758db38 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:19.070613 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a20fc8-4607-497b-afd8-f09f61d67918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:19.071538 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a20fc8-4607-497b-afd8-f09f61d67918 None admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:19.071824 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a20fc8-4607-497b-afd8-f09f61d67918 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:19.072106 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a20fc8-4607-497b-afd8-f09f61d67918 None admin] PATH_INFO: `/v3/projects/0c9a4444228d4be89a4ba8aa53099531/users/0503fdca7f834ef0a81422804dc74812/roles/ead4e9a9b7e947e1bff82fa3300df26c` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:19.074485 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a20fc8-4607-497b-afd8-f09f61d67918 None admin] RBAC: Authorizing `identity:create_grant(project_id=0c9a4444228d4be89a4ba8aa53099531, user_id=0503fdca7f834ef0a81422804dc74812, role_id=ead4e9a9b7e947e1bff82fa3300df26c)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:19.075952 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a20fc8-4607-497b-afd8-f09f61d67918 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:19.091838 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 480/954] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Mar 30 01:16:18 2022] PUT /identity/v3/projects/0c9a4444228d4be89a4ba8aa53099531/users/0503fdca7f834ef0a81422804dc74812/roles/ead4e9a9b7e947e1bff82fa3300df26c => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:16:19.513264 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ebcc51-3e74-4080-ad95-8d6a36a5f743 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:19.513780 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ebcc51-3e74-4080-ad95-8d6a36a5f743 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:19.513780 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ebcc51-3e74-4080-ad95-8d6a36a5f743 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:19.515920 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 475/955] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:16:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:16:19.522261 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0001ba4-cb84-4df9-a65e-c91f82c05fe1 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:19.522679 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0001ba4-cb84-4df9-a65e-c91f82c05fe1 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:19.522892 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0001ba4-cb84-4df9-a65e-c91f82c05fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:19.539974 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-b0001ba4-cb84-4df9-a65e-c91f82c05fe1 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:16:19.541455 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-b0001ba4-cb84-4df9-a65e-c91f82c05fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:16:19.616974 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 481/956] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:16:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 01:16:19.631375 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ebcc51-3e74-4080-ad95-8d6a36a5f743 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:19.738064 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ebcc51-3e74-4080-ad95-8d6a36a5f743 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:19.741461 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0011bbb-bb95-43c1-a95a-703085ec818c None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:19.741753 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0011bbb-bb95-43c1-a95a-703085ec818c None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:19.742036 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0011bbb-bb95-43c1-a95a-703085ec818c None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:19.744110 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 482/957] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:16:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:16:19.748889 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92167fd6-e054-493e-b56e-936c845176c9 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:19.749173 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92167fd6-e054-493e-b56e-936c845176c9 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:19.749452 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92167fd6-e054-493e-b56e-936c845176c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:19.768569 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-92167fd6-e054-493e-b56e-936c845176c9 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:16:19.769679 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-92167fd6-e054-493e-b56e-936c845176c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:16:19.778566 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b212c-c68d-4992-bd7b-311ab94c4b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:19.780029 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b212c-c68d-4992-bd7b-311ab94c4b54 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:19.780309 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b212c-c68d-4992-bd7b-311ab94c4b54 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:19.780589 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b212c-c68d-4992-bd7b-311ab94c4b54 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:19.781545 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6b212c-c68d-4992-bd7b-311ab94c4b54 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:19.783792 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6b212c-c68d-4992-bd7b-311ab94c4b54 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:19.798617 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-be6b212c-c68d-4992-bd7b-311ab94c4b54 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 30 01:16:19.802845 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 476/958] 10.222.0.30 () {56 vars in 1126 bytes} [Wed Mar 30 01:16:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:16:19.806916 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b212c-c68d-4992-bd7b-311ab94c4b54 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:19.850800 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 483/959] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:16:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 30 01:16:19.867826 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92167fd6-e054-493e-b56e-936c845176c9 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:19.930039 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b212c-c68d-4992-bd7b-311ab94c4b54 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:19.969874 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92167fd6-e054-493e-b56e-936c845176c9 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:19.973852 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efabd05-c708-4b73-a651-ca4501ae291a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:19.974524 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efabd05-c708-4b73-a651-ca4501ae291a None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:19.974827 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efabd05-c708-4b73-a651-ca4501ae291a None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:19.975112 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efabd05-c708-4b73-a651-ca4501ae291a None admin] PATH_INFO: `/v3/services` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:19.975809 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efabd05-c708-4b73-a651-ca4501ae291a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:19.976111 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efabd05-c708-4b73-a651-ca4501ae291a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:19.977473 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efabd05-c708-4b73-a651-ca4501ae291a None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:19.988330 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 477/960] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Mar 30 01:16:19 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:19.989659 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efabd05-c708-4b73-a651-ca4501ae291a None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:20.015062 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076b7559-e6e6-442a-ae4c-b4434f1b303e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:20.015754 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b7559-e6e6-442a-ae4c-b4434f1b303e None admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:20.016036 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b7559-e6e6-442a-ae4c-b4434f1b303e None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:20.016310 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b7559-e6e6-442a-ae4c-b4434f1b303e None admin] PATH_INFO: `/v3/services` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:20.017029 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076b7559-e6e6-442a-ae4c-b4434f1b303e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:20.019099 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076b7559-e6e6-442a-ae4c-b4434f1b303e None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:20.037321 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 484/961] 10.222.0.30 () {60 vars in 1141 bytes} [Wed Mar 30 01:16:19 2022] POST /identity/v3/services => generated 242 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 01:16:20.105439 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efabd05-c708-4b73-a651-ca4501ae291a None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:20.152625 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d0724-5855-440c-8f87-ed76d51df1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:20.153302 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d0724-5855-440c-8f87-ed76d51df1a3 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:20.153582 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d0724-5855-440c-8f87-ed76d51df1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:20.153855 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d0724-5855-440c-8f87-ed76d51df1a3 None admin] PATH_INFO: `/v3/services` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:20.154559 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0d0724-5855-440c-8f87-ed76d51df1a3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:20.155135 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0d0724-5855-440c-8f87-ed76d51df1a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:20.156567 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0d0724-5855-440c-8f87-ed76d51df1a3 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:20.166879 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 478/962] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Mar 30 01:16:19 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:16:20.168729 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076b7559-e6e6-442a-ae4c-b4434f1b303e None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:20.276770 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076b7559-e6e6-442a-ae4c-b4434f1b303e None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:20.311403 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc6ddcd-f3e9-4045-aa30-b8877e3a2320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:20.312059 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6ddcd-f3e9-4045-aa30-b8877e3a2320 None admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:20.312339 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6ddcd-f3e9-4045-aa30-b8877e3a2320 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:20.312618 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6ddcd-f3e9-4045-aa30-b8877e3a2320 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:20.313348 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc6ddcd-f3e9-4045-aa30-b8877e3a2320 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:20.314791 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc6ddcd-f3e9-4045-aa30-b8877e3a2320 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:20.338870 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 485/963] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Mar 30 01:16:20 2022] POST /identity/v3/endpoints => generated 349 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:16:21.305108 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37825904-a22a-4745-80d5-3ceaab1adb21 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:21.305624 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37825904-a22a-4745-80d5-3ceaab1adb21 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:21.305699 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37825904-a22a-4745-80d5-3ceaab1adb21 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:21.307709 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 479/964] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:16:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:16:21.313172 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5fb0c2-2f4a-4a04-b2af-60812ef9e8aa None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:21.314005 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5fb0c2-2f4a-4a04-b2af-60812ef9e8aa None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:21.314529 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5fb0c2-2f4a-4a04-b2af-60812ef9e8aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:21.333711 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-3c5fb0c2-2f4a-4a04-b2af-60812ef9e8aa None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:16:21.335244 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-3c5fb0c2-2f4a-4a04-b2af-60812ef9e8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:16:21.414793 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 486/965] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:16:21 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 01:16:21.433492 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37825904-a22a-4745-80d5-3ceaab1adb21 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:21.451554 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f253f-259a-4cfd-906b-f431cbf55f80 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:21.452054 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f253f-259a-4cfd-906b-f431cbf55f80 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:21.452472 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f253f-259a-4cfd-906b-f431cbf55f80 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:21.454667 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 487/966] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:16:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 01:16:21.459929 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e64ceb-7a5f-4357-adae-ebc6543c4936 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:21.460380 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e64ceb-7a5f-4357-adae-ebc6543c4936 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:21.460792 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e64ceb-7a5f-4357-adae-ebc6543c4936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:21.478192 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-c7e64ceb-7a5f-4357-adae-ebc6543c4936 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:16:21.479694 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-c7e64ceb-7a5f-4357-adae-ebc6543c4936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:16:21.558852 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 488/967] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:16:21 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 30 01:16:21.561757 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37825904-a22a-4745-80d5-3ceaab1adb21 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:21.578059 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e64ceb-7a5f-4357-adae-ebc6543c4936 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:21.601643 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36868f73-acd8-426b-8895-25cb4dba9f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:21.602315 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36868f73-acd8-426b-8895-25cb4dba9f1f None admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:21.602601 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36868f73-acd8-426b-8895-25cb4dba9f1f None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:21.602903 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36868f73-acd8-426b-8895-25cb4dba9f1f None admin] PATH_INFO: `/v3/users` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:21.603758 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36868f73-acd8-426b-8895-25cb4dba9f1f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:21.605751 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36868f73-acd8-426b-8895-25cb4dba9f1f None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:21.607241 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.common [None req-36868f73-acd8-426b-8895-25cb4dba9f1f None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Mar 30 01:16:21.621800 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.sql.core [None req-36868f73-acd8-426b-8895-25cb4dba9f1f None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Mar 30 01:16:21.621800 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Mar 30 01:16:21.621800 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [parameters: {'user_id': '38a73175cdb049cd824c7f8758c1f638', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Mar 30 01:16:21.621800 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79701) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Mar 30 01:16:21.629756 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-36868f73-acd8-426b-8895-25cb4dba9f1f None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Mar 30 01:16:21.636646 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 480/968] 10.222.0.30 () {60 vars in 1131 bytes} [Wed Mar 30 01:16:21 2022] POST /identity/v3/users => generated 160 bytes in 199 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Mar 30 01:16:21.638462 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36868f73-acd8-426b-8895-25cb4dba9f1f None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:21.715946 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e64ceb-7a5f-4357-adae-ebc6543c4936 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:21.748994 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36868f73-acd8-426b-8895-25cb4dba9f1f None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:21.757287 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cf1df6-7bed-452b-8879-23d564d9393e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:21.758091 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf1df6-7bed-452b-8879-23d564d9393e None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:21.758372 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf1df6-7bed-452b-8879-23d564d9393e None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:21.758644 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf1df6-7bed-452b-8879-23d564d9393e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:21.771876 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cf1df6-7bed-452b-8879-23d564d9393e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:16:21.781816 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-b8cf1df6-7bed-452b-8879-23d564d9393e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 30 01:16:21.785675 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26116015-467d-4687-984c-efa4feb9acdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:21.786713 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26116015-467d-4687-984c-efa4feb9acdc None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:21.787245 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26116015-467d-4687-984c-efa4feb9acdc None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:21.787719 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26116015-467d-4687-984c-efa4feb9acdc None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:21.788691 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 489/969] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Mar 30 01:16:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 01:16:21.789540 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cf1df6-7bed-452b-8879-23d564d9393e None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:21.796890 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26116015-467d-4687-984c-efa4feb9acdc None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:21.798990 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26116015-467d-4687-984c-efa4feb9acdc None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:21.815444 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-26116015-467d-4687-984c-efa4feb9acdc None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Mar 30 01:16:21.821703 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 481/970] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Mar 30 01:16:21 2022] GET /identity/v3/users/cinder => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:16:21.823246 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26116015-467d-4687-984c-efa4feb9acdc None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:21.903808 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cf1df6-7bed-452b-8879-23d564d9393e None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:21.940429 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26116015-467d-4687-984c-efa4feb9acdc None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:21.946384 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6db48a-b7f0-4ecf-a1bc-a6234d866002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:21.947111 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6db48a-b7f0-4ecf-a1bc-a6234d866002 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:21.947392 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6db48a-b7f0-4ecf-a1bc-a6234d866002 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:21.947666 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6db48a-b7f0-4ecf-a1bc-a6234d866002 None admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:21.948410 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6db48a-b7f0-4ecf-a1bc-a6234d866002 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:21.948710 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6db48a-b7f0-4ecf-a1bc-a6234d866002 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:21.950645 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6db48a-b7f0-4ecf-a1bc-a6234d866002 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:21.966394 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 490/971] 10.222.0.30 () {56 vars in 1115 bytes} [Wed Mar 30 01:16:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:21.967308 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6db48a-b7f0-4ecf-a1bc-a6234d866002 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:21.983146 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2d15f5-1c3f-4404-b54b-b000a3a8b1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:21.984203 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d15f5-1c3f-4404-b54b-b000a3a8b1ef None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:21.984676 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d15f5-1c3f-4404-b54b-b000a3a8b1ef None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:21.985173 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d15f5-1c3f-4404-b54b-b000a3a8b1ef None admin] PATH_INFO: `/v3/users` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:21.986289 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2d15f5-1c3f-4404-b54b-b000a3a8b1ef None admin] RBAC: Adding query filter params (name=cinder) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:21.987024 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2d15f5-1c3f-4404-b54b-b000a3a8b1ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:21.988782 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2d15f5-1c3f-4404-b54b-b000a3a8b1ef None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:22.034992 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 482/972] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Mar 30 01:16:21 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:16:22.080925 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6db48a-b7f0-4ecf-a1bc-a6234d866002 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:22.120141 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42681301-aaa4-4acd-bc42-5fb80b3f478e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:22.120952 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42681301-aaa4-4acd-bc42-5fb80b3f478e None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:22.121230 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42681301-aaa4-4acd-bc42-5fb80b3f478e None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:22.121500 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42681301-aaa4-4acd-bc42-5fb80b3f478e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:22.133581 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42681301-aaa4-4acd-bc42-5fb80b3f478e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:22.135082 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42681301-aaa4-4acd-bc42-5fb80b3f478e None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:22.152757 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-42681301-aaa4-4acd-bc42-5fb80b3f478e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:16:22.154331 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 491/973] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:16:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:16:22.161061 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2d15f5-1c3f-4404-b54b-b000a3a8b1ef None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:22.263498 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2d15f5-1c3f-4404-b54b-b000a3a8b1ef None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:22.298281 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36d6aba-5059-4ab4-ae97-3c21c69b9b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:22.299521 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d6aba-5059-4ab4-ae97-3c21c69b9b9a None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:22.299839 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d6aba-5059-4ab4-ae97-3c21c69b9b9a None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:22.300116 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d6aba-5059-4ab4-ae97-3c21c69b9b9a None admin] PATH_INFO: `/v3/domains` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:22.300794 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36d6aba-5059-4ab4-ae97-3c21c69b9b9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:22.301093 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36d6aba-5059-4ab4-ae97-3c21c69b9b9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:22.302445 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36d6aba-5059-4ab4-ae97-3c21c69b9b9a None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:22.315668 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 483/974] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:16:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:22.321557 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42681301-aaa4-4acd-bc42-5fb80b3f478e None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:22.438950 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42681301-aaa4-4acd-bc42-5fb80b3f478e None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:22.449406 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d72fb-6db2-401e-b1b5-74c79f797412 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:22.449692 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d72fb-6db2-401e-b1b5-74c79f797412 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:22.449969 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d72fb-6db2-401e-b1b5-74c79f797412 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:22.454731 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 484/975] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:16:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 01:16:22.457858 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d0ff02-27b8-495f-a1fb-313f61fa184e None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:22.458144 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d0ff02-27b8-495f-a1fb-313f61fa184e None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:22.458414 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d0ff02-27b8-495f-a1fb-313f61fa184e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:22.473996 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd80147-1043-4686-92fa-44c674246e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:22.474833 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd80147-1043-4686-92fa-44c674246e45 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:22.475120 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd80147-1043-4686-92fa-44c674246e45 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:22.475391 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd80147-1043-4686-92fa-44c674246e45 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:22.476294 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-00d0ff02-27b8-495f-a1fb-313f61fa184e None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:16:22.477996 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-00d0ff02-27b8-495f-a1fb-313f61fa184e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:16:22.482926 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd80147-1043-4686-92fa-44c674246e45 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:22.484365 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd80147-1043-4686-92fa-44c674246e45 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:22.498592 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-0fd80147-1043-4686-92fa-44c674246e45 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 30 01:16:22.500318 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 492/976] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Mar 30 01:16:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:16:22.505259 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd80147-1043-4686-92fa-44c674246e45 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:22.551739 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 485/977] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:16:22 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 30 01:16:22.574738 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d0ff02-27b8-495f-a1fb-313f61fa184e None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:22.604309 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd80147-1043-4686-92fa-44c674246e45 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:22.639086 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82dcff5-5c95-44ec-86f8-f903620be088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:22.639759 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82dcff5-5c95-44ec-86f8-f903620be088 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:22.640043 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82dcff5-5c95-44ec-86f8-f903620be088 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:22.640326 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82dcff5-5c95-44ec-86f8-f903620be088 None admin] PATH_INFO: `/v3/users` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:22.641153 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82dcff5-5c95-44ec-86f8-f903620be088 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:22.641464 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82dcff5-5c95-44ec-86f8-f903620be088 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:22.643087 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82dcff5-5c95-44ec-86f8-f903620be088 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:22.666806 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 493/978] 10.222.0.30 () {56 vars in 1149 bytes} [Wed Mar 30 01:16:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:16:22.672082 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82dcff5-5c95-44ec-86f8-f903620be088 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:22.678281 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d0ff02-27b8-495f-a1fb-313f61fa184e None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:22.716161 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a23a971-9be7-4fef-98f2-f89f668babcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:22.716877 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23a971-9be7-4fef-98f2-f89f668babcc None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:22.717163 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23a971-9be7-4fef-98f2-f89f668babcc None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:22.717438 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23a971-9be7-4fef-98f2-f89f668babcc None admin] PATH_INFO: `/v3/services/compute` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:22.718089 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a23a971-9be7-4fef-98f2-f89f668babcc None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:22.719495 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a23a971-9be7-4fef-98f2-f89f668babcc None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:22.736047 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-0a23a971-9be7-4fef-98f2-f89f668babcc None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Mar 30 01:16:22.737933 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 486/979] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Mar 30 01:16:22 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 01:16:22.739197 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2134c6dc-36fa-4ea2-8afb-6dc2ef393440 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:22.739485 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2134c6dc-36fa-4ea2-8afb-6dc2ef393440 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:22.739760 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2134c6dc-36fa-4ea2-8afb-6dc2ef393440 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:22.741417 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 487/980] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:16:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:16:22.743792 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2134c6dc-36fa-4ea2-8afb-6dc2ef393440 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:22.772254 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82dcff5-5c95-44ec-86f8-f903620be088 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:22.805945 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adea3aba-6d33-4654-b38d-59e789efbf53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:22.806592 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea3aba-6d33-4654-b38d-59e789efbf53 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:22.806900 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea3aba-6d33-4654-b38d-59e789efbf53 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:22.807177 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea3aba-6d33-4654-b38d-59e789efbf53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:22.848320 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2134c6dc-36fa-4ea2-8afb-6dc2ef393440 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:22.870830 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adea3aba-6d33-4654-b38d-59e789efbf53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:22.872289 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adea3aba-6d33-4654-b38d-59e789efbf53 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:22.880317 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e2add-9072-4098-bee6-97219f877836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:22.880968 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e2add-9072-4098-bee6-97219f877836 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:22.881249 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e2add-9072-4098-bee6-97219f877836 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:22.881531 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e2add-9072-4098-bee6-97219f877836 None admin] PATH_INFO: `/v3/services` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:22.882225 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9e2add-9072-4098-bee6-97219f877836 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:22.882533 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9e2add-9072-4098-bee6-97219f877836 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:22.883920 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9e2add-9072-4098-bee6-97219f877836 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:22.888588 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 488/981] 10.222.0.30 () {56 vars in 1112 bytes} [Wed Mar 30 01:16:22 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:22.889733 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a3edc-d21b-4502-84a3-185fdb0b3839 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:22.890024 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a3edc-d21b-4502-84a3-185fdb0b3839 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:22.890299 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a3edc-d21b-4502-84a3-185fdb0b3839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:22.907057 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-e28a3edc-d21b-4502-84a3-185fdb0b3839 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:16:22.909001 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-e28a3edc-d21b-4502-84a3-185fdb0b3839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:16:22.966867 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 494/982] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Mar 30 01:16:22 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Mar 30 01:16:22.967631 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adea3aba-6d33-4654-b38d-59e789efbf53 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:22.972135 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 489/983] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:16:22 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 01:16:22.972987 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28a3edc-d21b-4502-84a3-185fdb0b3839 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:23.066060 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adea3aba-6d33-4654-b38d-59e789efbf53 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:23.077636 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28a3edc-d21b-4502-84a3-185fdb0b3839 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:23.098220 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d419712c-ce95-4d53-a4f0-8c553c9ae688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:23.098906 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d419712c-ce95-4d53-a4f0-8c553c9ae688 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:23.099239 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d419712c-ce95-4d53-a4f0-8c553c9ae688 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:23.099536 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d419712c-ce95-4d53-a4f0-8c553c9ae688 None admin] PATH_INFO: `/v3/services` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:23.100263 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d419712c-ce95-4d53-a4f0-8c553c9ae688 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:23.100571 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d419712c-ce95-4d53-a4f0-8c553c9ae688 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:23.101938 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d419712c-ce95-4d53-a4f0-8c553c9ae688 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:23.106596 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 495/984] 10.222.0.30 () {56 vars in 1112 bytes} [Wed Mar 30 01:16:22 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:23.107392 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d419712c-ce95-4d53-a4f0-8c553c9ae688 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:23.109449 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0573217d-8b0f-4846-a587-86ec8c8268c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:23.110230 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0573217d-8b0f-4846-a587-86ec8c8268c0 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:23.110512 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0573217d-8b0f-4846-a587-86ec8c8268c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:23.110812 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0573217d-8b0f-4846-a587-86ec8c8268c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:23.121182 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0573217d-8b0f-4846-a587-86ec8c8268c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:23.122620 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0573217d-8b0f-4846-a587-86ec8c8268c0 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:23.139500 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-0573217d-8b0f-4846-a587-86ec8c8268c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:16:23.140668 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 490/985] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:16:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:16:23.141425 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0573217d-8b0f-4846-a587-86ec8c8268c0 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:23.201884 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d419712c-ce95-4d53-a4f0-8c553c9ae688 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:23.232981 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0573217d-8b0f-4846-a587-86ec8c8268c0 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:23.233853 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b9b0ee-ac5e-47a9-b8a2-c0f009374bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:23.234650 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b9b0ee-ac5e-47a9-b8a2-c0f009374bd1 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:23.234964 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b9b0ee-ac5e-47a9-b8a2-c0f009374bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:23.235241 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b9b0ee-ac5e-47a9-b8a2-c0f009374bd1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:23.235880 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b9b0ee-ac5e-47a9-b8a2-c0f009374bd1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:23.238168 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b9b0ee-ac5e-47a9-b8a2-c0f009374bd1 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:23.250735 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-54b9b0ee-ac5e-47a9-b8a2-c0f009374bd1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 30 01:16:23.252860 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 496/986] 10.222.0.30 () {56 vars in 1126 bytes} [Wed Mar 30 01:16:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:16:23.253620 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b9b0ee-ac5e-47a9-b8a2-c0f009374bd1 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:23.268792 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9145b859-6565-4716-98f6-095ab2f29cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:23.269452 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9145b859-6565-4716-98f6-095ab2f29cee None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:23.269736 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9145b859-6565-4716-98f6-095ab2f29cee None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:23.270004 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9145b859-6565-4716-98f6-095ab2f29cee None admin] PATH_INFO: `/v3/endpoints` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:23.270820 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9145b859-6565-4716-98f6-095ab2f29cee None admin] RBAC: Adding query filter params (interface=public, service_id=11c32bb2d42e40ae9c2ad2ab023ced40, region_id=RegionOne) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:23.271132 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9145b859-6565-4716-98f6-095ab2f29cee None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:23.272507 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9145b859-6565-4716-98f6-095ab2f29cee None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:23.277359 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 491/987] 10.222.0.30 () {56 vars in 1251 bytes} [Wed Mar 30 01:16:23 2022] GET /identity/v3/endpoints?service_id=11c32bb2d42e40ae9c2ad2ab023ced40&interface=public®ion_id=RegionOne => generated 194 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:23.278129 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9145b859-6565-4716-98f6-095ab2f29cee None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:23.350250 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b9b0ee-ac5e-47a9-b8a2-c0f009374bd1 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:23.385452 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41028a46-0293-4ca7-a5b6-e4850cb100b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:23.386114 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41028a46-0293-4ca7-a5b6-e4850cb100b1 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:23.386395 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41028a46-0293-4ca7-a5b6-e4850cb100b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:23.386667 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41028a46-0293-4ca7-a5b6-e4850cb100b1 None admin] PATH_INFO: `/v3/domains` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:23.387422 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41028a46-0293-4ca7-a5b6-e4850cb100b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:23.387529 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9145b859-6565-4716-98f6-095ab2f29cee None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:23.387937 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41028a46-0293-4ca7-a5b6-e4850cb100b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:23.389083 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41028a46-0293-4ca7-a5b6-e4850cb100b1 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:23.401845 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 497/988] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:16:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:23.402651 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41028a46-0293-4ca7-a5b6-e4850cb100b1 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:23.420897 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35496e09-f1ec-4737-bfd5-3e0f946c8bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:23.421546 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35496e09-f1ec-4737-bfd5-3e0f946c8bd3 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:23.421825 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35496e09-f1ec-4737-bfd5-3e0f946c8bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:23.422096 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35496e09-f1ec-4737-bfd5-3e0f946c8bd3 None admin] PATH_INFO: `/v3/services` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:23.422814 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35496e09-f1ec-4737-bfd5-3e0f946c8bd3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:23.423116 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35496e09-f1ec-4737-bfd5-3e0f946c8bd3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:23.424696 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35496e09-f1ec-4737-bfd5-3e0f946c8bd3 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:23.429180 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 492/989] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Mar 30 01:16:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:23.430005 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35496e09-f1ec-4737-bfd5-3e0f946c8bd3 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:23.496947 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41028a46-0293-4ca7-a5b6-e4850cb100b1 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:23.524388 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35496e09-f1ec-4737-bfd5-3e0f946c8bd3 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:23.530296 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f79c1ce-476d-44e3-abf3-983715299848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:23.530978 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f79c1ce-476d-44e3-abf3-983715299848 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:23.531263 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f79c1ce-476d-44e3-abf3-983715299848 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:23.531535 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f79c1ce-476d-44e3-abf3-983715299848 None admin] PATH_INFO: `/v3/services` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:23.532202 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f79c1ce-476d-44e3-abf3-983715299848 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:23.533588 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f79c1ce-476d-44e3-abf3-983715299848 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:23.539594 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 498/990] 10.222.0.30 () {56 vars in 1087 bytes} [Wed Mar 30 01:16:23 2022] GET /identity/v3/services => generated 1727 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:16:23.540367 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f79c1ce-476d-44e3-abf3-983715299848 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:23.557732 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087d0132-ac4c-451b-9a90-e42416bd34c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:23.558549 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087d0132-ac4c-451b-9a90-e42416bd34c3 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:23.558865 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087d0132-ac4c-451b-9a90-e42416bd34c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:23.559145 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087d0132-ac4c-451b-9a90-e42416bd34c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:23.570867 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087d0132-ac4c-451b-9a90-e42416bd34c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:23.572424 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087d0132-ac4c-451b-9a90-e42416bd34c3 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:23.587557 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-087d0132-ac4c-451b-9a90-e42416bd34c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 30 01:16:23.593601 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 493/991] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Mar 30 01:16:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:16:23.594758 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087d0132-ac4c-451b-9a90-e42416bd34c3 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:23.662975 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f79c1ce-476d-44e3-abf3-983715299848 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:23.699228 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f34f59c-1de8-4051-a1ae-45dcc4c5c266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:23.699906 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f34f59c-1de8-4051-a1ae-45dcc4c5c266 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:23.700186 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f34f59c-1de8-4051-a1ae-45dcc4c5c266 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:23.700517 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f34f59c-1de8-4051-a1ae-45dcc4c5c266 None admin] PATH_INFO: `/v3/services` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:23.701346 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f34f59c-1de8-4051-a1ae-45dcc4c5c266 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:23.701653 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f34f59c-1de8-4051-a1ae-45dcc4c5c266 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:23.703124 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f34f59c-1de8-4051-a1ae-45dcc4c5c266 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:23.710965 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 499/992] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Mar 30 01:16:23 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:23.711165 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087d0132-ac4c-451b-9a90-e42416bd34c3 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:23.716924 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f34f59c-1de8-4051-a1ae-45dcc4c5c266 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:23.748516 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ebf33b-a2df-46c8-bc52-e9290661ba40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:23.749118 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ebf33b-a2df-46c8-bc52-e9290661ba40 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:23.749401 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ebf33b-a2df-46c8-bc52-e9290661ba40 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:23.749682 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ebf33b-a2df-46c8-bc52-e9290661ba40 None admin] PATH_INFO: `/v3/projects` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:23.750564 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ebf33b-a2df-46c8-bc52-e9290661ba40 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:23.750824 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ebf33b-a2df-46c8-bc52-e9290661ba40 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:23.752466 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ebf33b-a2df-46c8-bc52-e9290661ba40 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:23.766747 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 494/993] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Mar 30 01:16:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:23.771367 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ebf33b-a2df-46c8-bc52-e9290661ba40 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:23.819629 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f34f59c-1de8-4051-a1ae-45dcc4c5c266 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:23.854092 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936228fb-ce6c-4e59-bcdb-7dfc5bedbd0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:23.854782 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936228fb-ce6c-4e59-bcdb-7dfc5bedbd0c None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:23.855173 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936228fb-ce6c-4e59-bcdb-7dfc5bedbd0c None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:23.855345 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936228fb-ce6c-4e59-bcdb-7dfc5bedbd0c None admin] PATH_INFO: `/v3/endpoints` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:23.856128 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936228fb-ce6c-4e59-bcdb-7dfc5bedbd0c None admin] RBAC: Adding query filter params (interface=admin, service_id=7b159ff8440648f6bd05c2eec0a8b2b2, region_id=RegionOne) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:23.856436 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936228fb-ce6c-4e59-bcdb-7dfc5bedbd0c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:23.857800 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936228fb-ce6c-4e59-bcdb-7dfc5bedbd0c None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:23.864061 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 500/994] 10.222.0.30 () {56 vars in 1249 bytes} [Wed Mar 30 01:16:23 2022] GET /identity/v3/endpoints?service_id=7b159ff8440648f6bd05c2eec0a8b2b2&interface=admin®ion_id=RegionOne => generated 193 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:16:23.869139 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936228fb-ce6c-4e59-bcdb-7dfc5bedbd0c None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:23.875225 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ebf33b-a2df-46c8-bc52-e9290661ba40 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:23.910310 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5583e302-6d6b-42af-9971-e16e1f3d7745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:23.911026 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583e302-6d6b-42af-9971-e16e1f3d7745 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:23.911309 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583e302-6d6b-42af-9971-e16e1f3d7745 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:23.911582 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583e302-6d6b-42af-9971-e16e1f3d7745 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:23.912403 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5583e302-6d6b-42af-9971-e16e1f3d7745 None admin] RBAC: Adding query filter params (role.id=ead4e9a9b7e947e1bff82fa3300df26c, scope.project.id=0c9a4444228d4be89a4ba8aa53099531, user.id=0503fdca7f834ef0a81422804dc74812) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:23.912796 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5583e302-6d6b-42af-9971-e16e1f3d7745 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:23.914113 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5583e302-6d6b-42af-9971-e16e1f3d7745 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:23.919812 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 495/995] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Mar 30 01:16:23 2022] GET /identity/v3/role_assignments?user.id=0503fdca7f834ef0a81422804dc74812&scope.project.id=0c9a4444228d4be89a4ba8aa53099531&role.id=ead4e9a9b7e947e1bff82fa3300df26c => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:16:23.970836 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936228fb-ce6c-4e59-bcdb-7dfc5bedbd0c None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:24.008461 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa5e62f-9192-4028-b871-ebcb9c5e258e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:24.009102 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa5e62f-9192-4028-b871-ebcb9c5e258e None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:24.009381 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa5e62f-9192-4028-b871-ebcb9c5e258e None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:24.009651 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa5e62f-9192-4028-b871-ebcb9c5e258e None admin] PATH_INFO: `/v3/services` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:24.010338 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa5e62f-9192-4028-b871-ebcb9c5e258e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:24.011766 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa5e62f-9192-4028-b871-ebcb9c5e258e None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:24.027005 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 501/996] 10.222.0.30 () {56 vars in 1087 bytes} [Wed Mar 30 01:16:23 2022] GET /identity/v3/services => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 01:16:25.890514 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4158b-8f6c-4355-9eda-3baacb9302ef None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:25.891049 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4158b-8f6c-4355-9eda-3baacb9302ef None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:25.891049 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4158b-8f6c-4355-9eda-3baacb9302ef None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:25.893093 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 496/997] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:16:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:16:25.898121 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa89d85-629f-437d-a931-03efb728d23c None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:25.898510 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa89d85-629f-437d-a931-03efb728d23c None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:25.898684 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa89d85-629f-437d-a931-03efb728d23c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:25.916359 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-4aa89d85-629f-437d-a931-03efb728d23c None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:16:25.917608 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-4aa89d85-629f-437d-a931-03efb728d23c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:16:25.987019 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 502/998] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:16:25 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 01:16:26.009770 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf4158b-8f6c-4355-9eda-3baacb9302ef None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:26.110434 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf4158b-8f6c-4355-9eda-3baacb9302ef None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:26.142868 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f3e6bc-0255-4d52-ae5b-12d09fdec914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:26.143623 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f3e6bc-0255-4d52-ae5b-12d09fdec914 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:26.143896 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f3e6bc-0255-4d52-ae5b-12d09fdec914 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:26.144162 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f3e6bc-0255-4d52-ae5b-12d09fdec914 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:26.144803 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f3e6bc-0255-4d52-ae5b-12d09fdec914 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:26.146141 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f3e6bc-0255-4d52-ae5b-12d09fdec914 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:26.157030 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-49f3e6bc-0255-4d52-ae5b-12d09fdec914 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Mar 30 01:16:26.159119 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 497/999] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Mar 30 01:16:26 2022] GET /identity/v3/services/compute => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:16:26.164846 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa89d85-629f-437d-a931-03efb728d23c None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:26.257412 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa89d85-629f-437d-a931-03efb728d23c None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:26.290193 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14acd85d-1617-4c56-931b-9449c5ab6f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:26.290387 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b9762-2c85-44ec-9b78-0e6db5c4effe None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:26.290497 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b9762-2c85-44ec-9b78-0e6db5c4effe None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:26.290773 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b9762-2c85-44ec-9b78-0e6db5c4effe None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:26.290944 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14acd85d-1617-4c56-931b-9449c5ab6f4f None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:26.291226 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14acd85d-1617-4c56-931b-9449c5ab6f4f None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:26.291499 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14acd85d-1617-4c56-931b-9449c5ab6f4f None admin] PATH_INFO: `/v3/services` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:26.292192 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14acd85d-1617-4c56-931b-9449c5ab6f4f None admin] RBAC: Adding query filter params (name=compute) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:26.292671 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14acd85d-1617-4c56-931b-9449c5ab6f4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:26.292772 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 498/1000] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:16:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 01:16:26.293847 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14acd85d-1617-4c56-931b-9449c5ab6f4f None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:26.297605 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad0b592-9074-4a5e-8309-e65aaa13da38 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:26.297892 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad0b592-9074-4a5e-8309-e65aaa13da38 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:26.298172 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad0b592-9074-4a5e-8309-e65aaa13da38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:26.304516 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 503/1001] 10.222.0.30 () {56 vars in 1112 bytes} [Wed Mar 30 01:16:26 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:26.305759 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14acd85d-1617-4c56-931b-9449c5ab6f4f None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:26.316534 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-6ad0b592-9074-4a5e-8309-e65aaa13da38 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:16:26.317733 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-6ad0b592-9074-4a5e-8309-e65aaa13da38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:16:26.381916 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 499/1002] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:16:26 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 30 01:16:26.402197 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14acd85d-1617-4c56-931b-9449c5ab6f4f None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:26.404141 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad0b592-9074-4a5e-8309-e65aaa13da38 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:26.435700 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999cfb42-5060-43e7-95da-131ab31aff56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:26.436361 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999cfb42-5060-43e7-95da-131ab31aff56 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:26.436638 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999cfb42-5060-43e7-95da-131ab31aff56 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:26.436911 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999cfb42-5060-43e7-95da-131ab31aff56 None admin] PATH_INFO: `/v3/services` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:26.437602 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999cfb42-5060-43e7-95da-131ab31aff56 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:26.437902 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999cfb42-5060-43e7-95da-131ab31aff56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:26.439812 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999cfb42-5060-43e7-95da-131ab31aff56 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:26.444403 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 504/1003] 10.222.0.30 () {56 vars in 1112 bytes} [Wed Mar 30 01:16:26 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:16:26.445597 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66d754-c3f8-4bf9-88ff-85cf2c211fe3 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:26.445872 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66d754-c3f8-4bf9-88ff-85cf2c211fe3 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:26.446148 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66d754-c3f8-4bf9-88ff-85cf2c211fe3 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:26.447773 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 505/1004] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:16:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:16:26.449836 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d66d754-c3f8-4bf9-88ff-85cf2c211fe3 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:26.501271 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad0b592-9074-4a5e-8309-e65aaa13da38 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:26.534535 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90d399b-49df-468a-8511-4827c2746052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:26.535362 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90d399b-49df-468a-8511-4827c2746052 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:26.535649 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90d399b-49df-468a-8511-4827c2746052 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:26.535927 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90d399b-49df-468a-8511-4827c2746052 None admin] PATH_INFO: `/v3/services/image` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:26.536570 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90d399b-49df-468a-8511-4827c2746052 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:26.537922 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90d399b-49df-468a-8511-4827c2746052 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:26.546853 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d66d754-c3f8-4bf9-88ff-85cf2c211fe3 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:26.548403 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-e90d399b-49df-468a-8511-4827c2746052 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Mar 30 01:16:26.549565 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 500/1005] 10.222.0.30 () {56 vars in 1105 bytes} [Wed Mar 30 01:16:26 2022] GET /identity/v3/services/image => generated 86 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 01:16:26.550740 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869603aa-a6a3-41af-9099-32a18e4e844b None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:26.551030 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869603aa-a6a3-41af-9099-32a18e4e844b None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:26.551308 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869603aa-a6a3-41af-9099-32a18e4e844b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:26.567707 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-869603aa-a6a3-41af-9099-32a18e4e844b None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:16:26.568893 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-869603aa-a6a3-41af-9099-32a18e4e844b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:16:26.579206 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334cc0ef-99b3-4010-9771-5690b7fe5243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:26.579987 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334cc0ef-99b3-4010-9771-5690b7fe5243 None admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:26.580268 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334cc0ef-99b3-4010-9771-5690b7fe5243 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:26.580538 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334cc0ef-99b3-4010-9771-5690b7fe5243 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:26.581257 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334cc0ef-99b3-4010-9771-5690b7fe5243 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:26.582631 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334cc0ef-99b3-4010-9771-5690b7fe5243 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:26.600642 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 506/1006] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Mar 30 01:16:26 2022] POST /identity/v3/endpoints => generated 334 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 01:16:26.601423 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334cc0ef-99b3-4010-9771-5690b7fe5243 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:26.650475 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 501/1007] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:16:26 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 01:16:26.678877 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869603aa-a6a3-41af-9099-32a18e4e844b None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:26.712833 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334cc0ef-99b3-4010-9771-5690b7fe5243 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:26.747952 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7188e65a-8636-4264-b815-b9229f41768a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:26.748341 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7188e65a-8636-4264-b815-b9229f41768a None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:26.748581 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7188e65a-8636-4264-b815-b9229f41768a None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:26.748950 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7188e65a-8636-4264-b815-b9229f41768a None admin] PATH_INFO: `/v3/services` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:26.749566 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7188e65a-8636-4264-b815-b9229f41768a None admin] RBAC: Adding query filter params (name=image) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:26.749868 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7188e65a-8636-4264-b815-b9229f41768a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:26.752392 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7188e65a-8636-4264-b815-b9229f41768a None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:26.757116 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 507/1008] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:16:26 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:26.762874 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7188e65a-8636-4264-b815-b9229f41768a None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:26.783146 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869603aa-a6a3-41af-9099-32a18e4e844b None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:26.819139 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f1f2e-caf7-4801-aca4-657289197e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:26.820485 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f1f2e-caf7-4801-aca4-657289197e61 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:26.820485 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f1f2e-caf7-4801-aca4-657289197e61 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:26.820485 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f1f2e-caf7-4801-aca4-657289197e61 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:26.821153 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5f1f2e-caf7-4801-aca4-657289197e61 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:26.822512 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5f1f2e-caf7-4801-aca4-657289197e61 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:26.834664 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-da5f1f2e-caf7-4801-aca4-657289197e61 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 30 01:16:26.836176 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 502/1009] 10.222.0.30 () {56 vars in 1126 bytes} [Wed Mar 30 01:16:26 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 01:16:26.842016 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f1f2e-caf7-4801-aca4-657289197e61 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:26.865514 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7188e65a-8636-4264-b815-b9229f41768a None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:26.901801 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f10fb61-3d1f-4f1e-bec7-5227d6dc79a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:26.902563 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f10fb61-3d1f-4f1e-bec7-5227d6dc79a4 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:26.902779 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f10fb61-3d1f-4f1e-bec7-5227d6dc79a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:26.903058 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f10fb61-3d1f-4f1e-bec7-5227d6dc79a4 None admin] PATH_INFO: `/v3/services` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:26.903768 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f10fb61-3d1f-4f1e-bec7-5227d6dc79a4 None admin] RBAC: Adding query filter params (type=image) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:26.904075 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f10fb61-3d1f-4f1e-bec7-5227d6dc79a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:26.905698 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f10fb61-3d1f-4f1e-bec7-5227d6dc79a4 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:26.910585 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 508/1010] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:16:26 2022] GET /identity/v3/services?type=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:16:26.954547 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f1f2e-caf7-4801-aca4-657289197e61 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:27.001057 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44218520-6ed5-4b7c-9e78-f760b2b1454f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:27.002313 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44218520-6ed5-4b7c-9e78-f760b2b1454f None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:27.002602 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44218520-6ed5-4b7c-9e78-f760b2b1454f None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:27.002911 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44218520-6ed5-4b7c-9e78-f760b2b1454f None admin] PATH_INFO: `/v3/services` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:27.003639 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44218520-6ed5-4b7c-9e78-f760b2b1454f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:27.003947 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44218520-6ed5-4b7c-9e78-f760b2b1454f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:27.005355 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44218520-6ed5-4b7c-9e78-f760b2b1454f None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:27.010765 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 503/1011] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Mar 30 01:16:26 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:16:27.016747 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f10fb61-3d1f-4f1e-bec7-5227d6dc79a4 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:27.119980 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f10fb61-3d1f-4f1e-bec7-5227d6dc79a4 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:27.152148 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e4fe46-ff0b-40a5-a12b-17f92d97d74a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:27.152813 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4fe46-ff0b-40a5-a12b-17f92d97d74a None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:27.153092 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4fe46-ff0b-40a5-a12b-17f92d97d74a None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:27.153373 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4fe46-ff0b-40a5-a12b-17f92d97d74a None admin] PATH_INFO: `/v3/services` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:27.154074 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e4fe46-ff0b-40a5-a12b-17f92d97d74a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:27.154380 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e4fe46-ff0b-40a5-a12b-17f92d97d74a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:27.156023 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e4fe46-ff0b-40a5-a12b-17f92d97d74a None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:27.165845 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 509/1012] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Mar 30 01:16:27 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:27.167101 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44218520-6ed5-4b7c-9e78-f760b2b1454f None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:27.268457 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44218520-6ed5-4b7c-9e78-f760b2b1454f None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:27.300725 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1feb1f9-3c18-4441-9d0c-1a960c88c69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:27.301381 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1feb1f9-3c18-4441-9d0c-1a960c88c69f None admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:27.301662 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1feb1f9-3c18-4441-9d0c-1a960c88c69f None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:27.301937 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1feb1f9-3c18-4441-9d0c-1a960c88c69f None admin] PATH_INFO: `/v3/endpoints` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:27.302659 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1feb1f9-3c18-4441-9d0c-1a960c88c69f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:27.304026 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1feb1f9-3c18-4441-9d0c-1a960c88c69f None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:27.322886 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 504/1013] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Mar 30 01:16:27 2022] POST /identity/v3/endpoints => generated 325 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:16:29.025241 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e8ec2e-a176-4f9f-98d0-d53b93f3b2f6 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:29.025751 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e8ec2e-a176-4f9f-98d0-d53b93f3b2f6 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:29.025751 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e8ec2e-a176-4f9f-98d0-d53b93f3b2f6 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:29.027556 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 510/1014] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:16:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:16:29.033197 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455991d7-fc13-4545-a5ee-0132c37718c6 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:29.033585 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455991d7-fc13-4545-a5ee-0132c37718c6 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:29.033752 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455991d7-fc13-4545-a5ee-0132c37718c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:29.051012 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-455991d7-fc13-4545-a5ee-0132c37718c6 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:16:29.052186 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-455991d7-fc13-4545-a5ee-0132c37718c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:16:29.124638 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 505/1015] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:16:29 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 01:16:29.149453 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e8ec2e-a176-4f9f-98d0-d53b93f3b2f6 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:29.186475 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c160f-f111-4e9b-ab72-a1ce3144e928 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:29.186805 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c160f-f111-4e9b-ab72-a1ce3144e928 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:29.187052 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c160f-f111-4e9b-ab72-a1ce3144e928 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:29.188949 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 506/1016] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:16:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 01:16:29.193678 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c0835-1228-410f-9c13-4c4e1fb97412 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:29.193962 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c0835-1228-410f-9c13-4c4e1fb97412 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:29.194237 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c0835-1228-410f-9c13-4c4e1fb97412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:29.211964 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-315c0835-1228-410f-9c13-4c4e1fb97412 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:16:29.213130 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-315c0835-1228-410f-9c13-4c4e1fb97412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:16:29.252358 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e8ec2e-a176-4f9f-98d0-d53b93f3b2f6 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:29.280070 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 507/1017] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:16:29 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 30 01:16:29.286948 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8de287-27e3-4e57-bd2f-aa80714f200a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:29.287756 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8de287-27e3-4e57-bd2f-aa80714f200a None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:29.288036 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8de287-27e3-4e57-bd2f-aa80714f200a None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:29.288308 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8de287-27e3-4e57-bd2f-aa80714f200a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:29.299162 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8de287-27e3-4e57-bd2f-aa80714f200a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:16:29.303732 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315c0835-1228-410f-9c13-4c4e1fb97412 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:29.306474 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-8a8de287-27e3-4e57-bd2f-aa80714f200a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 30 01:16:29.307892 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 511/1018] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Mar 30 01:16:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:16:29.314319 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8de287-27e3-4e57-bd2f-aa80714f200a None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:29.404962 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315c0835-1228-410f-9c13-4c4e1fb97412 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:29.413653 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8de287-27e3-4e57-bd2f-aa80714f200a None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:29.438203 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dff768-7d59-46d9-b39e-3c1ce5e9913d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:29.439411 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dff768-7d59-46d9-b39e-3c1ce5e9913d None admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:29.439760 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dff768-7d59-46d9-b39e-3c1ce5e9913d None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:29.440057 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dff768-7d59-46d9-b39e-3c1ce5e9913d None admin] PATH_INFO: `/v3/services` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:29.440837 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dff768-7d59-46d9-b39e-3c1ce5e9913d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:29.442234 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dff768-7d59-46d9-b39e-3c1ce5e9913d None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:29.447255 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9290c306-0d26-4298-84e9-8a50798f1b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:29.448035 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9290c306-0d26-4298-84e9-8a50798f1b16 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:29.448318 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9290c306-0d26-4298-84e9-8a50798f1b16 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:29.448650 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9290c306-0d26-4298-84e9-8a50798f1b16 None admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:29.449488 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9290c306-0d26-4298-84e9-8a50798f1b16 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:29.449787 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9290c306-0d26-4298-84e9-8a50798f1b16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:29.451242 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9290c306-0d26-4298-84e9-8a50798f1b16 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:29.458499 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 508/1019] 10.222.0.30 () {60 vars in 1141 bytes} [Wed Mar 30 01:16:29 2022] POST /identity/v3/services => generated 242 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 01:16:29.463996 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 512/1020] 10.222.0.30 () {56 vars in 1115 bytes} [Wed Mar 30 01:16:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:29.465641 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dff768-7d59-46d9-b39e-3c1ce5e9913d None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:29.585316 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dff768-7d59-46d9-b39e-3c1ce5e9913d None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:29.621094 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869f55ae-966b-4349-86fe-e903f2823b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:29.621905 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f55ae-966b-4349-86fe-e903f2823b9a None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:29.622182 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f55ae-966b-4349-86fe-e903f2823b9a None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:29.622454 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f55ae-966b-4349-86fe-e903f2823b9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:29.634811 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869f55ae-966b-4349-86fe-e903f2823b9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:29.636260 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869f55ae-966b-4349-86fe-e903f2823b9a None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:29.653536 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-869f55ae-966b-4349-86fe-e903f2823b9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:16:29.655731 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 509/1021] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:16:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:16:29.660888 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9290c306-0d26-4298-84e9-8a50798f1b16 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:29.705497 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51432a-06f6-4d31-8ed9-dbacaf5c5a89 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:29.705830 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51432a-06f6-4d31-8ed9-dbacaf5c5a89 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:29.706091 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51432a-06f6-4d31-8ed9-dbacaf5c5a89 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:29.708070 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 510/1022] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:16:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 01:16:29.713145 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a633b4d8-9adf-4765-bc1c-d2b358635dfb None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:29.713426 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a633b4d8-9adf-4765-bc1c-d2b358635dfb None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:29.713696 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a633b4d8-9adf-4765-bc1c-d2b358635dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:29.730474 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-a633b4d8-9adf-4765-bc1c-d2b358635dfb None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:16:29.731688 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-a633b4d8-9adf-4765-bc1c-d2b358635dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:16:29.761213 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9290c306-0d26-4298-84e9-8a50798f1b16 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:29.797819 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 511/1023] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:16:29 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 30 01:16:29.798363 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfddaff2-385c-4d96-9c90-79c29996f8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:29.799456 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfddaff2-385c-4d96-9c90-79c29996f8ae None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:29.799927 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfddaff2-385c-4d96-9c90-79c29996f8ae None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:29.800383 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfddaff2-385c-4d96-9c90-79c29996f8ae None admin] PATH_INFO: `/v3/domains` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:29.801323 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfddaff2-385c-4d96-9c90-79c29996f8ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:29.801853 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfddaff2-385c-4d96-9c90-79c29996f8ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:29.803464 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfddaff2-385c-4d96-9c90-79c29996f8ae None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:29.816053 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 513/1024] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:16:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:29.821372 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a633b4d8-9adf-4765-bc1c-d2b358635dfb None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:29.825172 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfddaff2-385c-4d96-9c90-79c29996f8ae None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:29.921002 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a633b4d8-9adf-4765-bc1c-d2b358635dfb None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:29.922385 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfddaff2-385c-4d96-9c90-79c29996f8ae None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:29.953311 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb794e-9b6f-45be-a5db-7bbba7250817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:29.954094 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb794e-9b6f-45be-a5db-7bbba7250817 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:29.954379 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb794e-9b6f-45be-a5db-7bbba7250817 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:29.955193 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb794e-9b6f-45be-a5db-7bbba7250817 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:29.956108 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38243b71-2d56-45dd-84f0-8836a96c96fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:29.957024 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38243b71-2d56-45dd-84f0-8836a96c96fe None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:29.957197 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38243b71-2d56-45dd-84f0-8836a96c96fe None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:29.957451 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38243b71-2d56-45dd-84f0-8836a96c96fe None admin] PATH_INFO: `/v3/domains/default` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:29.958824 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38243b71-2d56-45dd-84f0-8836a96c96fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:29.960288 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38243b71-2d56-45dd-84f0-8836a96c96fe None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:29.962051 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 514/1025] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:16:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:16:29.962357 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eb794e-9b6f-45be-a5db-7bbba7250817 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:29.963831 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eb794e-9b6f-45be-a5db-7bbba7250817 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:29.967603 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38243b71-2d56-45dd-84f0-8836a96c96fe None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:29.977799 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-07eb794e-9b6f-45be-a5db-7bbba7250817 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 30 01:16:29.978910 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 512/1026] 10.222.0.30 () {56 vars in 1093 bytes} [Wed Mar 30 01:16:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:16:29.984239 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb794e-9b6f-45be-a5db-7bbba7250817 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:30.065031 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38243b71-2d56-45dd-84f0-8836a96c96fe None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:30.080710 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb794e-9b6f-45be-a5db-7bbba7250817 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:30.099734 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ac696e-923e-4783-9a5e-76ef94a304da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:30.100592 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac696e-923e-4783-9a5e-76ef94a304da None admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:30.101034 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac696e-923e-4783-9a5e-76ef94a304da None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:30.101465 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac696e-923e-4783-9a5e-76ef94a304da None admin] PATH_INFO: `/v3/projects` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:30.102147 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ac696e-923e-4783-9a5e-76ef94a304da None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:30.103596 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ac696e-923e-4783-9a5e-76ef94a304da None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:30.113561 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8842b796-2c6b-4fa1-9b95-455c3f8cb261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:30.114217 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8842b796-2c6b-4fa1-9b95-455c3f8cb261 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:30.114498 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8842b796-2c6b-4fa1-9b95-455c3f8cb261 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:30.114813 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8842b796-2c6b-4fa1-9b95-455c3f8cb261 None admin] PATH_INFO: `/v3/users` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:30.115635 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8842b796-2c6b-4fa1-9b95-455c3f8cb261 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:30.115944 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8842b796-2c6b-4fa1-9b95-455c3f8cb261 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:30.117341 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8842b796-2c6b-4fa1-9b95-455c3f8cb261 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:30.136249 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 515/1027] 10.222.0.30 () {60 vars in 1141 bytes} [Wed Mar 30 01:16:29 2022] POST /identity/v3/projects => generated 311 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 01:16:30.136483 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 513/1028] 10.222.0.30 () {56 vars in 1133 bytes} [Wed Mar 30 01:16:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:16:30.141160 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ac696e-923e-4783-9a5e-76ef94a304da None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:30.246499 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ac696e-923e-4783-9a5e-76ef94a304da None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:30.282267 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d86801a-0f7f-4299-8168-88c1eed2e63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:30.282990 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d86801a-0f7f-4299-8168-88c1eed2e63c None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:30.283279 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d86801a-0f7f-4299-8168-88c1eed2e63c None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:30.283553 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d86801a-0f7f-4299-8168-88c1eed2e63c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:30.355194 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d86801a-0f7f-4299-8168-88c1eed2e63c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:30.356661 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d86801a-0f7f-4299-8168-88c1eed2e63c None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:30.452405 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 516/1029] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Mar 30 01:16:30 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 30 01:16:30.459061 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8842b796-2c6b-4fa1-9b95-455c3f8cb261 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:30.557505 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8842b796-2c6b-4fa1-9b95-455c3f8cb261 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:30.590076 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeac5db-1f21-4db8-9705-ccc316eff7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:30.590898 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeac5db-1f21-4db8-9705-ccc316eff7f5 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:30.591180 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeac5db-1f21-4db8-9705-ccc316eff7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:30.591450 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeac5db-1f21-4db8-9705-ccc316eff7f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:30.601500 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeac5db-1f21-4db8-9705-ccc316eff7f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:30.602999 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeac5db-1f21-4db8-9705-ccc316eff7f5 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:30.620899 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-eeeac5db-1f21-4db8-9705-ccc316eff7f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:16:30.622416 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 514/1030] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:16:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:16:30.629003 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d86801a-0f7f-4299-8168-88c1eed2e63c None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:30.723551 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d86801a-0f7f-4299-8168-88c1eed2e63c None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:30.756489 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee37f823-b769-43b6-ba82-98c8c70f0c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:30.757144 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37f823-b769-43b6-ba82-98c8c70f0c7b None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:30.757428 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37f823-b769-43b6-ba82-98c8c70f0c7b None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:30.757702 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37f823-b769-43b6-ba82-98c8c70f0c7b None admin] PATH_INFO: `/v3/domains` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:30.758408 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee37f823-b769-43b6-ba82-98c8c70f0c7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:30.758736 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee37f823-b769-43b6-ba82-98c8c70f0c7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:30.760102 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee37f823-b769-43b6-ba82-98c8c70f0c7b None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:30.775948 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 517/1031] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:16:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:30.777485 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeac5db-1f21-4db8-9705-ccc316eff7f5 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:30.871860 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeac5db-1f21-4db8-9705-ccc316eff7f5 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:30.905072 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88e2dda-0964-4579-a021-35b3c7c07b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:30.905852 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e2dda-0964-4579-a021-35b3c7c07b11 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:30.906128 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e2dda-0964-4579-a021-35b3c7c07b11 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:30.906395 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e2dda-0964-4579-a021-35b3c7c07b11 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:30.913127 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88e2dda-0964-4579-a021-35b3c7c07b11 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:30.914538 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88e2dda-0964-4579-a021-35b3c7c07b11 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:30.927194 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-e88e2dda-0964-4579-a021-35b3c7c07b11 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 30 01:16:30.928509 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 515/1032] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Mar 30 01:16:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:16:30.934230 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee37f823-b769-43b6-ba82-98c8c70f0c7b None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:31.033990 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee37f823-b769-43b6-ba82-98c8c70f0c7b None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:31.067248 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3f6e52-04b1-4e78-a87d-0618276ccce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:31.068006 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f6e52-04b1-4e78-a87d-0618276ccce3 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:31.068205 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f6e52-04b1-4e78-a87d-0618276ccce3 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:31.068454 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f6e52-04b1-4e78-a87d-0618276ccce3 None admin] PATH_INFO: `/v3/projects` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:31.069231 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3f6e52-04b1-4e78-a87d-0618276ccce3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:31.069537 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3f6e52-04b1-4e78-a87d-0618276ccce3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:31.070978 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3f6e52-04b1-4e78-a87d-0618276ccce3 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:31.083519 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 518/1033] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Mar 30 01:16:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:31.089411 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88e2dda-0964-4579-a021-35b3c7c07b11 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:31.185816 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88e2dda-0964-4579-a021-35b3c7c07b11 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:31.218595 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83aa561-31d3-4b15-8b52-50fa80b48bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:31.219314 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83aa561-31d3-4b15-8b52-50fa80b48bcd None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:31.219598 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83aa561-31d3-4b15-8b52-50fa80b48bcd None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:31.219872 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83aa561-31d3-4b15-8b52-50fa80b48bcd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:31.221369 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83aa561-31d3-4b15-8b52-50fa80b48bcd None admin] RBAC: Adding query filter params (role.id=ead4e9a9b7e947e1bff82fa3300df26c, scope.project.id=0c9a4444228d4be89a4ba8aa53099531, user.id=140c6d1a20e94192bde06e72040f162d) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:31.221676 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83aa561-31d3-4b15-8b52-50fa80b48bcd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:31.223121 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83aa561-31d3-4b15-8b52-50fa80b48bcd None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:31.228652 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 516/1034] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Mar 30 01:16:31 2022] GET /identity/v3/role_assignments?user.id=140c6d1a20e94192bde06e72040f162d&scope.project.id=0c9a4444228d4be89a4ba8aa53099531&role.id=ead4e9a9b7e947e1bff82fa3300df26c => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:31.793192 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf0701-085d-45b8-ad1a-6134f8e7db25 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:31.793511 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf0701-085d-45b8-ad1a-6134f8e7db25 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:31.793748 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf0701-085d-45b8-ad1a-6134f8e7db25 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:31.795713 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 519/1035] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:16:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:16:31.800703 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f394c-7556-4b18-80f3-188173fac2a9 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:31.800992 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f394c-7556-4b18-80f3-188173fac2a9 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:31.801271 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f394c-7556-4b18-80f3-188173fac2a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:31.818218 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-5d2f394c-7556-4b18-80f3-188173fac2a9 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:16:31.819406 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-5d2f394c-7556-4b18-80f3-188173fac2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:16:31.882636 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 517/1036] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:16:31 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 01:16:31.906266 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbf0701-085d-45b8-ad1a-6134f8e7db25 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:32.004084 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbf0701-085d-45b8-ad1a-6134f8e7db25 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:32.038483 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a844cf-fbd6-49e1-8aa3-c0de9d3c7224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:32.039292 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a844cf-fbd6-49e1-8aa3-c0de9d3c7224 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:32.039569 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a844cf-fbd6-49e1-8aa3-c0de9d3c7224 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:32.039838 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a844cf-fbd6-49e1-8aa3-c0de9d3c7224 None admin] PATH_INFO: `/v3/services/image` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:32.040478 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a844cf-fbd6-49e1-8aa3-c0de9d3c7224 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:32.041832 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a844cf-fbd6-49e1-8aa3-c0de9d3c7224 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:32.052924 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-c5a844cf-fbd6-49e1-8aa3-c0de9d3c7224 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Mar 30 01:16:32.054299 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 520/1037] 10.222.0.30 () {56 vars in 1105 bytes} [Wed Mar 30 01:16:31 2022] GET /identity/v3/services/image => generated 86 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:16:32.059905 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2f394c-7556-4b18-80f3-188173fac2a9 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:32.154776 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2f394c-7556-4b18-80f3-188173fac2a9 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:32.188559 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa4e3e4-9768-4f6e-a7e2-2822a9a6c2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:32.189425 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa4e3e4-9768-4f6e-a7e2-2822a9a6c2d8 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:32.189706 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa4e3e4-9768-4f6e-a7e2-2822a9a6c2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:32.189975 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa4e3e4-9768-4f6e-a7e2-2822a9a6c2d8 None admin] PATH_INFO: `/v3/services` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:32.190692 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa4e3e4-9768-4f6e-a7e2-2822a9a6c2d8 None admin] RBAC: Adding query filter params (name=image) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:32.191019 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa4e3e4-9768-4f6e-a7e2-2822a9a6c2d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:32.192425 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa4e3e4-9768-4f6e-a7e2-2822a9a6c2d8 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:32.198080 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 518/1038] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:16:32 2022] GET /identity/v3/services?name=image => generated 122 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:32.203662 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a844cf-fbd6-49e1-8aa3-c0de9d3c7224 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:32.302197 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a844cf-fbd6-49e1-8aa3-c0de9d3c7224 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:32.335137 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bece9a-70f9-4c5d-9601-619ea5a4818e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:32.335820 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bece9a-70f9-4c5d-9601-619ea5a4818e None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:32.336100 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bece9a-70f9-4c5d-9601-619ea5a4818e None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:32.336374 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bece9a-70f9-4c5d-9601-619ea5a4818e None admin] PATH_INFO: `/v3/services` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:32.337089 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bece9a-70f9-4c5d-9601-619ea5a4818e None admin] RBAC: Adding query filter params (type=image) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:32.337393 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bece9a-70f9-4c5d-9601-619ea5a4818e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:32.338829 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bece9a-70f9-4c5d-9601-619ea5a4818e None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:32.349835 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 521/1039] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:16:32 2022] GET /identity/v3/services?type=image => generated 350 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:32.350950 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa4e3e4-9768-4f6e-a7e2-2822a9a6c2d8 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:32.446146 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa4e3e4-9768-4f6e-a7e2-2822a9a6c2d8 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:32.479028 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfc2bee-fcd8-4818-bcf1-e52acbe1277b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:32.480013 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc2bee-fcd8-4818-bcf1-e52acbe1277b None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:32.480434 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc2bee-fcd8-4818-bcf1-e52acbe1277b None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:32.480867 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc2bee-fcd8-4818-bcf1-e52acbe1277b None admin] PATH_INFO: `/v3/endpoints` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:32.481808 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfc2bee-fcd8-4818-bcf1-e52acbe1277b None admin] RBAC: Adding query filter params (interface=public, service_id=d4552a1bb64d43ccb4a82ad87b13455d, region_id=RegionOne) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:32.482269 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfc2bee-fcd8-4818-bcf1-e52acbe1277b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:32.483810 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfc2bee-fcd8-4818-bcf1-e52acbe1277b None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:32.493143 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 519/1040] 10.222.0.30 () {56 vars in 1251 bytes} [Wed Mar 30 01:16:32 2022] GET /identity/v3/endpoints?service_id=d4552a1bb64d43ccb4a82ad87b13455d&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:16:32.494897 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bece9a-70f9-4c5d-9601-619ea5a4818e None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:32.559152 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62234ea-f2b0-4712-96d6-c0b9a6bfe42b None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:32.559438 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62234ea-f2b0-4712-96d6-c0b9a6bfe42b None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:32.559706 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62234ea-f2b0-4712-96d6-c0b9a6bfe42b None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:32.561468 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 520/1041] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:16:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 01:16:32.567339 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb93e213-fca1-4b1f-9975-cc91b4211cf3 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:32.567625 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb93e213-fca1-4b1f-9975-cc91b4211cf3 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:32.567902 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb93e213-fca1-4b1f-9975-cc91b4211cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:32.584714 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-bb93e213-fca1-4b1f-9975-cc91b4211cf3 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:16:32.585881 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-bb93e213-fca1-4b1f-9975-cc91b4211cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:16:32.598492 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bece9a-70f9-4c5d-9601-619ea5a4818e None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:32.632315 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b6663-c591-44b0-91eb-4c3db835aa16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:32.632979 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b6663-c591-44b0-91eb-4c3db835aa16 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:32.633262 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b6663-c591-44b0-91eb-4c3db835aa16 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:32.633535 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b6663-c591-44b0-91eb-4c3db835aa16 None admin] PATH_INFO: `/v3/services` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:32.634203 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9b6663-c591-44b0-91eb-4c3db835aa16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:32.635597 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9b6663-c591-44b0-91eb-4c3db835aa16 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:32.650965 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 522/1042] 10.222.0.30 () {56 vars in 1087 bytes} [Wed Mar 30 01:16:32 2022] GET /identity/v3/services => generated 1957 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:16:32.658026 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 521/1043] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:16:32 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 30 01:16:32.684214 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b6663-c591-44b0-91eb-4c3db835aa16 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:32.792232 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b6663-c591-44b0-91eb-4c3db835aa16 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:32.832355 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e73d48e-be80-4a56-ab00-d815fef61f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:32.832583 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73d48e-be80-4a56-ab00-d815fef61f07 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:32.832822 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73d48e-be80-4a56-ab00-d815fef61f07 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:32.833057 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73d48e-be80-4a56-ab00-d815fef61f07 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:32.834227 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e73d48e-be80-4a56-ab00-d815fef61f07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:32.835701 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e73d48e-be80-4a56-ab00-d815fef61f07 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:32.837670 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 523/1044] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:16:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:32.843098 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb93e213-fca1-4b1f-9975-cc91b4211cf3 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:32.942845 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb93e213-fca1-4b1f-9975-cc91b4211cf3 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:32.975918 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b4e1e8-5f92-41cb-a1e8-840c803b1bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:32.976591 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b4e1e8-5f92-41cb-a1e8-840c803b1bcf None admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:32.976874 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b4e1e8-5f92-41cb-a1e8-840c803b1bcf None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:32.977150 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b4e1e8-5f92-41cb-a1e8-840c803b1bcf None admin] PATH_INFO: `/v3/users` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:32.977858 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b4e1e8-5f92-41cb-a1e8-840c803b1bcf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:32.979330 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b4e1e8-5f92-41cb-a1e8-840c803b1bcf None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:33.002261 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 522/1045] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Mar 30 01:16:32 2022] POST /identity/v3/users => generated 285 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:16:33.528057 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5277f8-3147-4f7a-90db-e0a53a02991b None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:33.528584 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5277f8-3147-4f7a-90db-e0a53a02991b None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:33.528584 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5277f8-3147-4f7a-90db-e0a53a02991b None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:33.530910 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 524/1046] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:16:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:16:33.536145 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8c3302-6432-4185-9aca-147512040684 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:33.536563 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8c3302-6432-4185-9aca-147512040684 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:33.536757 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8c3302-6432-4185-9aca-147512040684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:33.553816 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-dc8c3302-6432-4185-9aca-147512040684 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:16:33.555030 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-dc8c3302-6432-4185-9aca-147512040684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:16:33.619554 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 523/1047] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:16:33 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 01:16:33.642494 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5277f8-3147-4f7a-90db-e0a53a02991b None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:33.745650 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5277f8-3147-4f7a-90db-e0a53a02991b None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:33.778546 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808e1e10-7169-4a12-981b-03df4078ba07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:33.779319 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e1e10-7169-4a12-981b-03df4078ba07 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:33.779857 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e1e10-7169-4a12-981b-03df4078ba07 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:33.780132 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e1e10-7169-4a12-981b-03df4078ba07 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:33.792333 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808e1e10-7169-4a12-981b-03df4078ba07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:16:33.800391 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-808e1e10-7169-4a12-981b-03df4078ba07 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 30 01:16:33.801774 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 525/1048] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Mar 30 01:16:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:16:33.807517 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8c3302-6432-4185-9aca-147512040684 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:33.901180 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8c3302-6432-4185-9aca-147512040684 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:33.934093 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a46397c-9054-4588-a5dc-a570f8a028b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:33.934778 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46397c-9054-4588-a5dc-a570f8a028b0 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:33.935062 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46397c-9054-4588-a5dc-a570f8a028b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:33.935336 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46397c-9054-4588-a5dc-a570f8a028b0 None admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:33.936072 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a46397c-9054-4588-a5dc-a570f8a028b0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:33.936377 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a46397c-9054-4588-a5dc-a570f8a028b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:33.937738 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a46397c-9054-4588-a5dc-a570f8a028b0 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:33.950998 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 524/1049] 10.222.0.30 () {56 vars in 1115 bytes} [Wed Mar 30 01:16:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:33.952227 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808e1e10-7169-4a12-981b-03df4078ba07 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:34.048019 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808e1e10-7169-4a12-981b-03df4078ba07 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:34.081326 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3bb1df-a7a8-4ca9-ad00-bc4d90194939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:34.082185 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3bb1df-a7a8-4ca9-ad00-bc4d90194939 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:34.082472 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3bb1df-a7a8-4ca9-ad00-bc4d90194939 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:34.082816 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3bb1df-a7a8-4ca9-ad00-bc4d90194939 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:34.092760 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3bb1df-a7a8-4ca9-ad00-bc4d90194939 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:34.094209 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3bb1df-a7a8-4ca9-ad00-bc4d90194939 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:34.112125 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-0a3bb1df-a7a8-4ca9-ad00-bc4d90194939 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:16:34.117819 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 526/1050] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:16:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:16:34.119171 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a46397c-9054-4588-a5dc-a570f8a028b0 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:34.220366 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a46397c-9054-4588-a5dc-a570f8a028b0 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:34.253541 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8474a383-9050-4575-8ffa-070716182857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:34.254260 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474a383-9050-4575-8ffa-070716182857 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:34.254548 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474a383-9050-4575-8ffa-070716182857 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:34.254857 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474a383-9050-4575-8ffa-070716182857 None admin] PATH_INFO: `/v3/domains` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:34.255631 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8474a383-9050-4575-8ffa-070716182857 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:34.256022 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8474a383-9050-4575-8ffa-070716182857 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:34.257407 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8474a383-9050-4575-8ffa-070716182857 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:34.273671 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 525/1051] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:16:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:34.274984 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3bb1df-a7a8-4ca9-ad00-bc4d90194939 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:34.370603 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3bb1df-a7a8-4ca9-ad00-bc4d90194939 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:34.403140 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1931326b-2228-4874-979f-89ba0cb225f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:34.403931 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1931326b-2228-4874-979f-89ba0cb225f3 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:34.404217 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1931326b-2228-4874-979f-89ba0cb225f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:34.404493 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1931326b-2228-4874-979f-89ba0cb225f3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:34.412945 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1931326b-2228-4874-979f-89ba0cb225f3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:34.414387 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1931326b-2228-4874-979f-89ba0cb225f3 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:34.427313 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-1931326b-2228-4874-979f-89ba0cb225f3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 30 01:16:34.428671 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 527/1052] 10.222.0.30 () {56 vars in 1093 bytes} [Wed Mar 30 01:16:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:16:34.434162 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8474a383-9050-4575-8ffa-070716182857 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:34.533083 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8474a383-9050-4575-8ffa-070716182857 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:34.566124 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236af833-8a74-4c7a-b0f3-1ddd6fb27d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:34.566888 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236af833-8a74-4c7a-b0f3-1ddd6fb27d86 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:34.567091 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236af833-8a74-4c7a-b0f3-1ddd6fb27d86 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:34.567366 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236af833-8a74-4c7a-b0f3-1ddd6fb27d86 None admin] PATH_INFO: `/v3/users` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:34.568191 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236af833-8a74-4c7a-b0f3-1ddd6fb27d86 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:34.568502 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236af833-8a74-4c7a-b0f3-1ddd6fb27d86 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:34.569914 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236af833-8a74-4c7a-b0f3-1ddd6fb27d86 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:34.587956 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 526/1053] 10.222.0.30 () {56 vars in 1133 bytes} [Wed Mar 30 01:16:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:16:34.593894 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1931326b-2228-4874-979f-89ba0cb225f3 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:34.695200 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1931326b-2228-4874-979f-89ba0cb225f3 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:34.727774 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5105b95a-fec6-4606-b234-3d6a87d4c6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:34.728571 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5105b95a-fec6-4606-b234-3d6a87d4c6a0 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:34.728853 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5105b95a-fec6-4606-b234-3d6a87d4c6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:34.729133 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5105b95a-fec6-4606-b234-3d6a87d4c6a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:34.740062 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5105b95a-fec6-4606-b234-3d6a87d4c6a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:34.741518 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5105b95a-fec6-4606-b234-3d6a87d4c6a0 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:34.757991 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-5105b95a-fec6-4606-b234-3d6a87d4c6a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:16:34.759410 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 528/1054] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:16:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 01:16:34.764958 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236af833-8a74-4c7a-b0f3-1ddd6fb27d86 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:34.862912 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236af833-8a74-4c7a-b0f3-1ddd6fb27d86 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:34.895834 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d572af-e9d3-45e6-9310-e5573941b2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:34.896497 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d572af-e9d3-45e6-9310-e5573941b2ee None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:34.896779 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d572af-e9d3-45e6-9310-e5573941b2ee None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:34.897053 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d572af-e9d3-45e6-9310-e5573941b2ee None admin] PATH_INFO: `/v3/domains` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:34.897825 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d572af-e9d3-45e6-9310-e5573941b2ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:34.898131 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d572af-e9d3-45e6-9310-e5573941b2ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:34.899746 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d572af-e9d3-45e6-9310-e5573941b2ee None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:34.911823 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 527/1055] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:16:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:34.917256 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5105b95a-fec6-4606-b234-3d6a87d4c6a0 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:34.961758 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1ff48-34a4-4ce3-8386-0eae323d664b None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:34.961965 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1ff48-34a4-4ce3-8386-0eae323d664b None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:34.962241 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1ff48-34a4-4ce3-8386-0eae323d664b None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:34.964057 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 528/1056] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:16:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 01:16:34.968989 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd32fdb-9c90-4e99-995f-6991ec41b8a9 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:34.969277 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd32fdb-9c90-4e99-995f-6991ec41b8a9 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:34.969587 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd32fdb-9c90-4e99-995f-6991ec41b8a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:34.988620 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-dfd32fdb-9c90-4e99-995f-6991ec41b8a9 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:16:34.989855 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-dfd32fdb-9c90-4e99-995f-6991ec41b8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:16:35.027028 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5105b95a-fec6-4606-b234-3d6a87d4c6a0 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:35.062736 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 529/1057] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:16:34 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 30 01:16:35.063664 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6205982b-eaa9-4b0d-b5e9-d1301c424f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:35.064468 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205982b-eaa9-4b0d-b5e9-d1301c424f76 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:35.064742 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205982b-eaa9-4b0d-b5e9-d1301c424f76 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:35.065012 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205982b-eaa9-4b0d-b5e9-d1301c424f76 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:35.071723 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6205982b-eaa9-4b0d-b5e9-d1301c424f76 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:35.073179 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6205982b-eaa9-4b0d-b5e9-d1301c424f76 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:35.082318 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd32fdb-9c90-4e99-995f-6991ec41b8a9 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:35.086917 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-6205982b-eaa9-4b0d-b5e9-d1301c424f76 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 30 01:16:35.088239 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 529/1058] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Mar 30 01:16:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:16:35.093765 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6205982b-eaa9-4b0d-b5e9-d1301c424f76 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:35.179097 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd32fdb-9c90-4e99-995f-6991ec41b8a9 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:35.191027 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6205982b-eaa9-4b0d-b5e9-d1301c424f76 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:35.213691 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6064eac-452b-4a85-8b99-cc8f48dd094a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:35.214406 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6064eac-452b-4a85-8b99-cc8f48dd094a None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:35.214683 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6064eac-452b-4a85-8b99-cc8f48dd094a None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:35.214983 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6064eac-452b-4a85-8b99-cc8f48dd094a None admin] PATH_INFO: `/v3/services/image` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:35.215630 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6064eac-452b-4a85-8b99-cc8f48dd094a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:35.217018 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6064eac-452b-4a85-8b99-cc8f48dd094a None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:35.225104 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58902975-0029-4e90-aef9-58d0bc43fa7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:35.225764 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58902975-0029-4e90-aef9-58d0bc43fa7d None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:35.226047 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58902975-0029-4e90-aef9-58d0bc43fa7d None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:35.226323 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58902975-0029-4e90-aef9-58d0bc43fa7d None admin] PATH_INFO: `/v3/projects` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:35.227125 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58902975-0029-4e90-aef9-58d0bc43fa7d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:35.227433 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58902975-0029-4e90-aef9-58d0bc43fa7d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:35.227635 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-d6064eac-452b-4a85-8b99-cc8f48dd094a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Mar 30 01:16:35.233786 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58902975-0029-4e90-aef9-58d0bc43fa7d None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:35.233926 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 530/1059] 10.222.0.30 () {56 vars in 1105 bytes} [Wed Mar 30 01:16:35 2022] GET /identity/v3/services/image => generated 86 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 01:16:35.234562 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6064eac-452b-4a85-8b99-cc8f48dd094a None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:35.241606 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 530/1060] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Mar 30 01:16:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:16:35.247531 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58902975-0029-4e90-aef9-58d0bc43fa7d None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:35.354545 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58902975-0029-4e90-aef9-58d0bc43fa7d None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:35.389714 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d30723-9cb8-4c8c-8cca-214301f08530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:35.390611 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d30723-9cb8-4c8c-8cca-214301f08530 None admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:35.390920 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d30723-9cb8-4c8c-8cca-214301f08530 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:35.391195 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d30723-9cb8-4c8c-8cca-214301f08530 None admin] PATH_INFO: `/v3/projects/0c9a4444228d4be89a4ba8aa53099531/users/140c6d1a20e94192bde06e72040f162d/roles/ead4e9a9b7e947e1bff82fa3300df26c` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:35.394509 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d30723-9cb8-4c8c-8cca-214301f08530 None admin] RBAC: Authorizing `identity:create_grant(project_id=0c9a4444228d4be89a4ba8aa53099531, user_id=140c6d1a20e94192bde06e72040f162d, role_id=ead4e9a9b7e947e1bff82fa3300df26c)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:35.396016 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d30723-9cb8-4c8c-8cca-214301f08530 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:35.410339 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 531/1061] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Mar 30 01:16:35 2022] PUT /identity/v3/projects/0c9a4444228d4be89a4ba8aa53099531/users/140c6d1a20e94192bde06e72040f162d/roles/ead4e9a9b7e947e1bff82fa3300df26c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:16:35.411929 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41aaeb-26b3-4a84-b04f-efd9749eb815 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:35.412219 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41aaeb-26b3-4a84-b04f-efd9749eb815 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:35.412495 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41aaeb-26b3-4a84-b04f-efd9749eb815 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:35.414460 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 532/1062] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:16:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:16:35.420330 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5fe4e5-79e3-4344-93ff-60d80c4ee211 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:35.420670 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5fe4e5-79e3-4344-93ff-60d80c4ee211 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:35.420886 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5fe4e5-79e3-4344-93ff-60d80c4ee211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:35.439643 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-4e5fe4e5-79e3-4344-93ff-60d80c4ee211 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:16:35.440992 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-4e5fe4e5-79e3-4344-93ff-60d80c4ee211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:16:35.463337 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6064eac-452b-4a85-8b99-cc8f48dd094a None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:35.499418 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb3b76a-5803-4311-b6a2-e8753937fdfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:35.500200 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb3b76a-5803-4311-b6a2-e8753937fdfc None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:35.500474 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb3b76a-5803-4311-b6a2-e8753937fdfc None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:35.500799 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb3b76a-5803-4311-b6a2-e8753937fdfc None admin] PATH_INFO: `/v3/services` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:35.502076 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb3b76a-5803-4311-b6a2-e8753937fdfc None admin] RBAC: Adding query filter params (name=image) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:35.502380 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb3b76a-5803-4311-b6a2-e8753937fdfc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:35.503838 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb3b76a-5803-4311-b6a2-e8753937fdfc None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:35.509651 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 531/1063] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:16:35 2022] GET /identity/v3/services?name=image => generated 122 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:16:35.515487 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb3b76a-5803-4311-b6a2-e8753937fdfc None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:35.524941 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 533/1064] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:16:35 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 30 01:16:35.543462 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5fe4e5-79e3-4344-93ff-60d80c4ee211 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:35.621999 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb3b76a-5803-4311-b6a2-e8753937fdfc None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:35.644157 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5fe4e5-79e3-4344-93ff-60d80c4ee211 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:35.654295 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca30d1d3-20ca-4a00-93fe-282cfce089a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:35.655253 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca30d1d3-20ca-4a00-93fe-282cfce089a1 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:35.655528 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca30d1d3-20ca-4a00-93fe-282cfce089a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:35.655794 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca30d1d3-20ca-4a00-93fe-282cfce089a1 None admin] PATH_INFO: `/v3/services` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:35.656489 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca30d1d3-20ca-4a00-93fe-282cfce089a1 None admin] RBAC: Adding query filter params (type=image) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:35.656790 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca30d1d3-20ca-4a00-93fe-282cfce089a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:35.658724 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca30d1d3-20ca-4a00-93fe-282cfce089a1 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:35.663784 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 532/1065] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:16:35 2022] GET /identity/v3/services?type=image => generated 350 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:16:35.669178 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca30d1d3-20ca-4a00-93fe-282cfce089a1 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:35.680092 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f415d3c0-8ac0-4896-912d-09f33f9e4fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:35.680890 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415d3c0-8ac0-4896-912d-09f33f9e4fe6 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:35.681170 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415d3c0-8ac0-4896-912d-09f33f9e4fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:35.681443 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415d3c0-8ac0-4896-912d-09f33f9e4fe6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:35.691769 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f415d3c0-8ac0-4896-912d-09f33f9e4fe6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:16:35.698593 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-f415d3c0-8ac0-4896-912d-09f33f9e4fe6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 30 01:16:35.704657 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 534/1066] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Mar 30 01:16:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 01:16:35.706084 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f415d3c0-8ac0-4896-912d-09f33f9e4fe6 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:35.766041 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca30d1d3-20ca-4a00-93fe-282cfce089a1 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:35.801206 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b856cd2c-ad69-4975-b640-d6d2561bfe97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:35.802009 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856cd2c-ad69-4975-b640-d6d2561bfe97 None admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:35.802402 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856cd2c-ad69-4975-b640-d6d2561bfe97 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:35.802772 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856cd2c-ad69-4975-b640-d6d2561bfe97 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:35.803602 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b856cd2c-ad69-4975-b640-d6d2561bfe97 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:35.804996 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f415d3c0-8ac0-4896-912d-09f33f9e4fe6 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:35.805100 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b856cd2c-ad69-4975-b640-d6d2561bfe97 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:35.823563 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 533/1067] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Mar 30 01:16:35 2022] POST /identity/v3/endpoints => generated 327 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 01:16:35.846807 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1728cb6b-d63b-4761-8e98-bd23462d6023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:35.847500 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728cb6b-d63b-4761-8e98-bd23462d6023 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:35.847782 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728cb6b-d63b-4761-8e98-bd23462d6023 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:35.848050 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728cb6b-d63b-4761-8e98-bd23462d6023 None admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:35.848804 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1728cb6b-d63b-4761-8e98-bd23462d6023 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:35.849104 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1728cb6b-d63b-4761-8e98-bd23462d6023 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:35.850531 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1728cb6b-d63b-4761-8e98-bd23462d6023 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:35.859996 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 535/1068] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Mar 30 01:16:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:16:35.866754 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b856cd2c-ad69-4975-b640-d6d2561bfe97 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:35.972320 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b856cd2c-ad69-4975-b640-d6d2561bfe97 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:36.006451 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d924459-2828-46e3-8db4-564af2da5520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:36.007350 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d924459-2828-46e3-8db4-564af2da5520 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:36.007626 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d924459-2828-46e3-8db4-564af2da5520 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:36.007898 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d924459-2828-46e3-8db4-564af2da5520 None admin] PATH_INFO: `/v3/users/e0a13eeb8b434b8799f7d661e30ff31b` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:36.021958 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d924459-2828-46e3-8db4-564af2da5520 None admin] RBAC: Authorizing `identity:get_user(user_id=e0a13eeb8b434b8799f7d661e30ff31b)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:36.023412 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d924459-2828-46e3-8db4-564af2da5520 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:36.025384 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 534/1069] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Mar 30 01:16:35 2022] GET /identity/v3/users/e0a13eeb8b434b8799f7d661e30ff31b => generated 285 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:36.031412 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1728cb6b-d63b-4761-8e98-bd23462d6023 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:36.128559 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1728cb6b-d63b-4761-8e98-bd23462d6023 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:36.160753 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55d0ceb-7ffe-4e9b-bc88-2305f07ee5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:36.161396 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d0ceb-7ffe-4e9b-bc88-2305f07ee5f7 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:36.161675 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d0ceb-7ffe-4e9b-bc88-2305f07ee5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:36.161948 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d0ceb-7ffe-4e9b-bc88-2305f07ee5f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:36.226093 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55d0ceb-7ffe-4e9b-bc88-2305f07ee5f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:36.227508 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55d0ceb-7ffe-4e9b-bc88-2305f07ee5f7 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:36.321358 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 536/1070] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Mar 30 01:16:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 30 01:16:36.326994 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d924459-2828-46e3-8db4-564af2da5520 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:36.420275 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d924459-2828-46e3-8db4-564af2da5520 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:36.452167 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544fb323-15b1-492c-93ca-f14319730a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:36.453010 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544fb323-15b1-492c-93ca-f14319730a48 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:36.453289 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544fb323-15b1-492c-93ca-f14319730a48 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:36.453558 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544fb323-15b1-492c-93ca-f14319730a48 None admin] PATH_INFO: `/v3/projects/c935d5eb8a9a45ed91c209c7ae52ecab` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:36.454789 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544fb323-15b1-492c-93ca-f14319730a48 None admin] RBAC: Authorizing `identity:get_project(project_id=c935d5eb8a9a45ed91c209c7ae52ecab)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:36.456196 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544fb323-15b1-492c-93ca-f14319730a48 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:36.458137 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 535/1071] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Mar 30 01:16:36 2022] GET /identity/v3/projects/c935d5eb8a9a45ed91c209c7ae52ecab => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:16:36.463903 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55d0ceb-7ffe-4e9b-bc88-2305f07ee5f7 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:36.563263 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55d0ceb-7ffe-4e9b-bc88-2305f07ee5f7 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:36.597481 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd817e-5fb0-45a1-8c18-a49daa9623a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:36.598062 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd817e-5fb0-45a1-8c18-a49daa9623a8 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:36.598345 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd817e-5fb0-45a1-8c18-a49daa9623a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:36.598622 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd817e-5fb0-45a1-8c18-a49daa9623a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:36.599485 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afd817e-5fb0-45a1-8c18-a49daa9623a8 None admin] RBAC: Adding query filter params (role.id=36909bbf31d04993bb2a9fe587b572dc, scope.project.id=c935d5eb8a9a45ed91c209c7ae52ecab, user.id=e0a13eeb8b434b8799f7d661e30ff31b) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:36.599795 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afd817e-5fb0-45a1-8c18-a49daa9623a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:36.601227 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afd817e-5fb0-45a1-8c18-a49daa9623a8 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:36.617218 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 537/1072] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Mar 30 01:16:36 2022] GET /identity/v3/role_assignments?user.id=e0a13eeb8b434b8799f7d661e30ff31b&scope.project.id=c935d5eb8a9a45ed91c209c7ae52ecab&role.id=36909bbf31d04993bb2a9fe587b572dc => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:37.746363 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11980087-74b6-4d27-b8db-b7fb68eaf7c9 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:37.746935 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11980087-74b6-4d27-b8db-b7fb68eaf7c9 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:37.746935 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11980087-74b6-4d27-b8db-b7fb68eaf7c9 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:37.748760 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 536/1073] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:16:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:16:37.753915 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff15c1a-0724-4971-9d29-2f27d162db0f None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:37.754317 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff15c1a-0724-4971-9d29-2f27d162db0f None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:37.754485 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff15c1a-0724-4971-9d29-2f27d162db0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:37.771241 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-eff15c1a-0724-4971-9d29-2f27d162db0f None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:16:37.772429 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-eff15c1a-0724-4971-9d29-2f27d162db0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:16:37.842937 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 538/1074] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:16:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 01:16:37.867034 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11980087-74b6-4d27-b8db-b7fb68eaf7c9 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:37.966622 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11980087-74b6-4d27-b8db-b7fb68eaf7c9 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:37.998792 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc2b859-4fcd-4e7c-a650-9f17aae7fd77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:37.999594 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc2b859-4fcd-4e7c-a650-9f17aae7fd77 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:37.999890 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc2b859-4fcd-4e7c-a650-9f17aae7fd77 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:38.000150 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc2b859-4fcd-4e7c-a650-9f17aae7fd77 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:38.010819 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc2b859-4fcd-4e7c-a650-9f17aae7fd77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:16:38.018000 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-dcc2b859-4fcd-4e7c-a650-9f17aae7fd77 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 30 01:16:38.019362 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 537/1075] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Mar 30 01:16:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:16:38.025102 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff15c1a-0724-4971-9d29-2f27d162db0f None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:38.123164 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff15c1a-0724-4971-9d29-2f27d162db0f None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:38.156348 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff369891-b7b9-4607-9c8a-4b3c3e2ad72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:38.157012 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff369891-b7b9-4607-9c8a-4b3c3e2ad72c None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:38.157305 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff369891-b7b9-4607-9c8a-4b3c3e2ad72c None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:38.157583 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff369891-b7b9-4607-9c8a-4b3c3e2ad72c None admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:38.158321 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff369891-b7b9-4607-9c8a-4b3c3e2ad72c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:38.158619 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff369891-b7b9-4607-9c8a-4b3c3e2ad72c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:38.160019 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff369891-b7b9-4607-9c8a-4b3c3e2ad72c None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:38.166031 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b327e0f-6605-44aa-bbbb-acb4f00f97f5 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:38.166321 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b327e0f-6605-44aa-bbbb-acb4f00f97f5 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:38.166596 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b327e0f-6605-44aa-bbbb-acb4f00f97f5 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:38.172810 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 539/1076] 10.222.0.30 () {56 vars in 1115 bytes} [Wed Mar 30 01:16:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:38.173464 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 538/1077] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:16:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 01:16:38.174288 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b327e0f-6605-44aa-bbbb-acb4f00f97f5 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:38.174499 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a01cc7-0d00-4903-b5d8-8ad9abf9419b None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:38.174787 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a01cc7-0d00-4903-b5d8-8ad9abf9419b None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:38.174904 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a01cc7-0d00-4903-b5d8-8ad9abf9419b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:38.192418 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-e6a01cc7-0d00-4903-b5d8-8ad9abf9419b None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:16:38.193702 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-e6a01cc7-0d00-4903-b5d8-8ad9abf9419b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:16:38.259559 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 540/1078] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:16:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 30 01:16:38.275452 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b327e0f-6605-44aa-bbbb-acb4f00f97f5 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:38.282240 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a01cc7-0d00-4903-b5d8-8ad9abf9419b None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:38.311935 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35447e0-429a-4056-944e-db2eaacf3106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:38.312720 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35447e0-429a-4056-944e-db2eaacf3106 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:38.313007 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35447e0-429a-4056-944e-db2eaacf3106 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:38.313278 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35447e0-429a-4056-944e-db2eaacf3106 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:38.323224 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35447e0-429a-4056-944e-db2eaacf3106 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:38.324665 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35447e0-429a-4056-944e-db2eaacf3106 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:38.341519 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-f35447e0-429a-4056-944e-db2eaacf3106 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:16:38.342881 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 539/1079] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:16:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 01:16:38.348931 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35447e0-429a-4056-944e-db2eaacf3106 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:38.380285 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a01cc7-0d00-4903-b5d8-8ad9abf9419b None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:38.417422 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082eb733-ff3b-452f-bbfc-26253eb369d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:38.418240 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082eb733-ff3b-452f-bbfc-26253eb369d5 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:38.418629 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082eb733-ff3b-452f-bbfc-26253eb369d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:38.419032 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082eb733-ff3b-452f-bbfc-26253eb369d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:38.446066 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35447e0-429a-4056-944e-db2eaacf3106 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:38.480858 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be200e-44d5-457f-b217-8db3bb667ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:38.481516 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be200e-44d5-457f-b217-8db3bb667ca5 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:38.481795 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be200e-44d5-457f-b217-8db3bb667ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:38.482065 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be200e-44d5-457f-b217-8db3bb667ca5 None admin] PATH_INFO: `/v3/domains` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:38.482813 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07be200e-44d5-457f-b217-8db3bb667ca5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:38.483115 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07be200e-44d5-457f-b217-8db3bb667ca5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:38.484463 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07be200e-44d5-457f-b217-8db3bb667ca5 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:38.486590 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082eb733-ff3b-452f-bbfc-26253eb369d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:38.488076 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082eb733-ff3b-452f-bbfc-26253eb369d5 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:38.497653 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 540/1080] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:16:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:16:38.503250 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be200e-44d5-457f-b217-8db3bb667ca5 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:38.585116 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 541/1081] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Mar 30 01:16:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Mar 30 01:16:38.591062 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082eb733-ff3b-452f-bbfc-26253eb369d5 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:38.602919 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be200e-44d5-457f-b217-8db3bb667ca5 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:38.639518 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be20b1de-8980-438e-ac23-20869b46d848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:38.640307 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be20b1de-8980-438e-ac23-20869b46d848 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:38.640583 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be20b1de-8980-438e-ac23-20869b46d848 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:38.640852 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be20b1de-8980-438e-ac23-20869b46d848 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:38.648113 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be20b1de-8980-438e-ac23-20869b46d848 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:38.651866 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be20b1de-8980-438e-ac23-20869b46d848 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:38.664134 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-be20b1de-8980-438e-ac23-20869b46d848 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 30 01:16:38.669800 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 541/1082] 10.222.0.30 () {56 vars in 1093 bytes} [Wed Mar 30 01:16:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 01:16:38.670812 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be20b1de-8980-438e-ac23-20869b46d848 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:38.693643 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082eb733-ff3b-452f-bbfc-26253eb369d5 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:38.728080 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d8946b-d08d-4591-b74d-b4f51854b50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:38.728882 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8946b-d08d-4591-b74d-b4f51854b50a None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:38.729161 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8946b-d08d-4591-b74d-b4f51854b50a None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:38.729431 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8946b-d08d-4591-b74d-b4f51854b50a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:38.740237 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d8946b-d08d-4591-b74d-b4f51854b50a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:38.741687 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d8946b-d08d-4591-b74d-b4f51854b50a None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:38.762367 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-e6d8946b-d08d-4591-b74d-b4f51854b50a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:16:38.771463 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 542/1083] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:16:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 01:16:38.772212 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d8946b-d08d-4591-b74d-b4f51854b50a None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:38.773797 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be20b1de-8980-438e-ac23-20869b46d848 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:38.808179 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de2850e-b472-411f-8d14-6cb72e28119b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:38.808845 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de2850e-b472-411f-8d14-6cb72e28119b None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:38.809127 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de2850e-b472-411f-8d14-6cb72e28119b None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:38.809404 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de2850e-b472-411f-8d14-6cb72e28119b None admin] PATH_INFO: `/v3/users` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:38.810230 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de2850e-b472-411f-8d14-6cb72e28119b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:38.810538 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de2850e-b472-411f-8d14-6cb72e28119b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:38.811982 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de2850e-b472-411f-8d14-6cb72e28119b None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:38.830191 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 542/1084] 10.222.0.30 () {56 vars in 1133 bytes} [Wed Mar 30 01:16:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:38.836024 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de2850e-b472-411f-8d14-6cb72e28119b None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:38.871554 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d8946b-d08d-4591-b74d-b4f51854b50a None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:38.905847 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0621890-f1d9-48ee-b2b5-0ec0dd7e9da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:38.906646 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0621890-f1d9-48ee-b2b5-0ec0dd7e9da1 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:38.907060 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0621890-f1d9-48ee-b2b5-0ec0dd7e9da1 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:38.907976 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0621890-f1d9-48ee-b2b5-0ec0dd7e9da1 None admin] PATH_INFO: `/v3/domains` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:38.908871 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0621890-f1d9-48ee-b2b5-0ec0dd7e9da1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:38.909270 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0621890-f1d9-48ee-b2b5-0ec0dd7e9da1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:38.910759 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0621890-f1d9-48ee-b2b5-0ec0dd7e9da1 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:38.931142 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 543/1085] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:16:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:38.936273 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de2850e-b472-411f-8d14-6cb72e28119b None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:38.973738 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84f6ea3-f398-423a-9bb0-8f6c4c158646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:38.974547 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84f6ea3-f398-423a-9bb0-8f6c4c158646 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:38.974957 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84f6ea3-f398-423a-9bb0-8f6c4c158646 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:38.975347 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84f6ea3-f398-423a-9bb0-8f6c4c158646 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:39.001679 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f53ffa-4443-478a-ba4c-878291691e23 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:39.001964 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f53ffa-4443-478a-ba4c-878291691e23 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:39.002245 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f53ffa-4443-478a-ba4c-878291691e23 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:39.004265 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 544/1086] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:16:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 01:16:39.010007 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aadb763-a884-4d5e-a054-60db7f164ae1 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:39.010295 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aadb763-a884-4d5e-a054-60db7f164ae1 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:39.010578 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aadb763-a884-4d5e-a054-60db7f164ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:39.029214 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-8aadb763-a884-4d5e-a054-60db7f164ae1 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:16:39.030806 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-8aadb763-a884-4d5e-a054-60db7f164ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:16:39.048869 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84f6ea3-f398-423a-9bb0-8f6c4c158646 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:39.050501 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84f6ea3-f398-423a-9bb0-8f6c4c158646 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:39.104666 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 545/1087] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:16:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 30 01:16:39.128197 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aadb763-a884-4d5e-a054-60db7f164ae1 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:39.152956 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 543/1088] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Mar 30 01:16:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Mar 30 01:16:39.159158 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84f6ea3-f398-423a-9bb0-8f6c4c158646 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:39.233732 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aadb763-a884-4d5e-a054-60db7f164ae1 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:39.258960 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84f6ea3-f398-423a-9bb0-8f6c4c158646 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:39.268064 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7e067c-1ca9-4a5f-bc75-93131ddb259d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:39.268850 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e067c-1ca9-4a5f-bc75-93131ddb259d None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:39.269131 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e067c-1ca9-4a5f-bc75-93131ddb259d None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:39.269404 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e067c-1ca9-4a5f-bc75-93131ddb259d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:39.279039 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7e067c-1ca9-4a5f-bc75-93131ddb259d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:16:39.286191 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-2c7e067c-1ca9-4a5f-bc75-93131ddb259d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 30 01:16:39.287612 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 546/1089] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Mar 30 01:16:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:16:39.291883 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb18bb-c838-4edb-9d3c-342c32176061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:39.292671 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb18bb-c838-4edb-9d3c-342c32176061 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:39.292949 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb18bb-c838-4edb-9d3c-342c32176061 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:39.293212 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7e067c-1ca9-4a5f-bc75-93131ddb259d None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:39.293317 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb18bb-c838-4edb-9d3c-342c32176061 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:39.303580 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fb18bb-c838-4edb-9d3c-342c32176061 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:39.305011 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fb18bb-c838-4edb-9d3c-342c32176061 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:39.322203 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-30fb18bb-c838-4edb-9d3c-342c32176061 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:16:39.323402 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 544/1090] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:16:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 01:16:39.329240 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb18bb-c838-4edb-9d3c-342c32176061 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:39.391498 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7e067c-1ca9-4a5f-bc75-93131ddb259d None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:39.424216 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb18bb-c838-4edb-9d3c-342c32176061 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:39.427272 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694e13ba-70b4-4248-8c75-4eb08fa3c2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:39.427931 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e13ba-70b4-4248-8c75-4eb08fa3c2e0 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:39.428208 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e13ba-70b4-4248-8c75-4eb08fa3c2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:39.428476 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e13ba-70b4-4248-8c75-4eb08fa3c2e0 None admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:39.429212 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694e13ba-70b4-4248-8c75-4eb08fa3c2e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:39.429516 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694e13ba-70b4-4248-8c75-4eb08fa3c2e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:39.430920 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694e13ba-70b4-4248-8c75-4eb08fa3c2e0 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:39.439433 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 547/1091] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Mar 30 01:16:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:16:39.445328 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694e13ba-70b4-4248-8c75-4eb08fa3c2e0 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:39.459346 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c20d206-6ae9-432e-9c50-0491cc8d8bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:39.460002 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c20d206-6ae9-432e-9c50-0491cc8d8bd7 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:39.460281 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c20d206-6ae9-432e-9c50-0491cc8d8bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:39.460553 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c20d206-6ae9-432e-9c50-0491cc8d8bd7 None admin] PATH_INFO: `/v3/domains` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:39.461268 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c20d206-6ae9-432e-9c50-0491cc8d8bd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:39.461569 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c20d206-6ae9-432e-9c50-0491cc8d8bd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:39.462946 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c20d206-6ae9-432e-9c50-0491cc8d8bd7 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:39.474145 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 545/1092] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:16:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:16:39.479644 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c20d206-6ae9-432e-9c50-0491cc8d8bd7 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:39.546287 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694e13ba-70b4-4248-8c75-4eb08fa3c2e0 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:39.573519 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c20d206-6ae9-432e-9c50-0491cc8d8bd7 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:39.578958 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c5fafd-0ec1-49d0-bb99-4f0b36a2c6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:39.579856 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c5fafd-0ec1-49d0-bb99-4f0b36a2c6d5 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:39.580134 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c5fafd-0ec1-49d0-bb99-4f0b36a2c6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:39.580406 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c5fafd-0ec1-49d0-bb99-4f0b36a2c6d5 None admin] PATH_INFO: `/v3/users/e0a13eeb8b434b8799f7d661e30ff31b` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:39.581605 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c5fafd-0ec1-49d0-bb99-4f0b36a2c6d5 None admin] RBAC: Authorizing `identity:get_user(user_id=e0a13eeb8b434b8799f7d661e30ff31b)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:39.583065 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c5fafd-0ec1-49d0-bb99-4f0b36a2c6d5 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:39.584984 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 548/1093] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Mar 30 01:16:39 2022] GET /identity/v3/users/e0a13eeb8b434b8799f7d661e30ff31b => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:16:39.590274 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c5fafd-0ec1-49d0-bb99-4f0b36a2c6d5 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:39.605882 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591fea9f-c97d-42ea-9888-f9ae34077901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:39.606662 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591fea9f-c97d-42ea-9888-f9ae34077901 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:39.606984 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591fea9f-c97d-42ea-9888-f9ae34077901 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:39.607258 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591fea9f-c97d-42ea-9888-f9ae34077901 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:39.614335 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591fea9f-c97d-42ea-9888-f9ae34077901 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:39.615795 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591fea9f-c97d-42ea-9888-f9ae34077901 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:39.629909 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-591fea9f-c97d-42ea-9888-f9ae34077901 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 30 01:16:39.631108 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 546/1094] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Mar 30 01:16:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 01:16:39.636791 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591fea9f-c97d-42ea-9888-f9ae34077901 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:39.685159 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c5fafd-0ec1-49d0-bb99-4f0b36a2c6d5 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:39.717050 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc3b31-59cc-4893-a9ea-98c10059bab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:39.717903 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc3b31-59cc-4893-a9ea-98c10059bab5 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:39.718186 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc3b31-59cc-4893-a9ea-98c10059bab5 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:39.718460 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc3b31-59cc-4893-a9ea-98c10059bab5 None admin] PATH_INFO: `/v3/projects/c935d5eb8a9a45ed91c209c7ae52ecab` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:39.719674 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dc3b31-59cc-4893-a9ea-98c10059bab5 None admin] RBAC: Authorizing `identity:get_project(project_id=c935d5eb8a9a45ed91c209c7ae52ecab)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:39.721298 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dc3b31-59cc-4893-a9ea-98c10059bab5 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:39.723030 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 549/1095] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Mar 30 01:16:39 2022] GET /identity/v3/projects/c935d5eb8a9a45ed91c209c7ae52ecab => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:16:39.728787 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc3b31-59cc-4893-a9ea-98c10059bab5 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:39.729965 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591fea9f-c97d-42ea-9888-f9ae34077901 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:39.764417 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28a82c2-3cf7-4c22-95a5-2623e34d7ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:39.765209 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a82c2-3cf7-4c22-95a5-2623e34d7ffa None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:39.765492 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a82c2-3cf7-4c22-95a5-2623e34d7ffa None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:39.765764 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a82c2-3cf7-4c22-95a5-2623e34d7ffa None admin] PATH_INFO: `/v3/projects` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:39.766529 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28a82c2-3cf7-4c22-95a5-2623e34d7ffa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:39.766894 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28a82c2-3cf7-4c22-95a5-2623e34d7ffa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:39.768449 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28a82c2-3cf7-4c22-95a5-2623e34d7ffa None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:39.783975 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 547/1096] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Mar 30 01:16:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:16:39.789907 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28a82c2-3cf7-4c22-95a5-2623e34d7ffa None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:39.828601 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc3b31-59cc-4893-a9ea-98c10059bab5 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:39.859734 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a57f58-5d7f-4e21-b645-c69d4a2d5957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:39.861162 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a57f58-5d7f-4e21-b645-c69d4a2d5957 None admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:39.861435 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a57f58-5d7f-4e21-b645-c69d4a2d5957 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:39.861703 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a57f58-5d7f-4e21-b645-c69d4a2d5957 None admin] PATH_INFO: `/v3/projects/c935d5eb8a9a45ed91c209c7ae52ecab/users/e0a13eeb8b434b8799f7d661e30ff31b/roles/36909bbf31d04993bb2a9fe587b572dc` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:39.863671 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a57f58-5d7f-4e21-b645-c69d4a2d5957 None admin] RBAC: Authorizing `identity:create_grant(project_id=c935d5eb8a9a45ed91c209c7ae52ecab, user_id=e0a13eeb8b434b8799f7d661e30ff31b, role_id=36909bbf31d04993bb2a9fe587b572dc)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:39.865094 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a57f58-5d7f-4e21-b645-c69d4a2d5957 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:39.878286 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 550/1097] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Mar 30 01:16:39 2022] PUT /identity/v3/projects/c935d5eb8a9a45ed91c209c7ae52ecab/users/e0a13eeb8b434b8799f7d661e30ff31b/roles/36909bbf31d04993bb2a9fe587b572dc => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:16:39.887060 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28a82c2-3cf7-4c22-95a5-2623e34d7ffa None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:39.923359 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffab6c9c-ded0-4aee-b29b-8dd4feea7600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:39.924030 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab6c9c-ded0-4aee-b29b-8dd4feea7600 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:39.924317 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab6c9c-ded0-4aee-b29b-8dd4feea7600 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:39.924598 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab6c9c-ded0-4aee-b29b-8dd4feea7600 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:39.925437 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffab6c9c-ded0-4aee-b29b-8dd4feea7600 None admin] RBAC: Adding query filter params (role.id=ead4e9a9b7e947e1bff82fa3300df26c, scope.project.id=0c9a4444228d4be89a4ba8aa53099531, user.id=140c6d1a20e94192bde06e72040f162d) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:39.925749 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffab6c9c-ded0-4aee-b29b-8dd4feea7600 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:39.927231 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffab6c9c-ded0-4aee-b29b-8dd4feea7600 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:39.933716 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 548/1098] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Mar 30 01:16:39 2022] GET /identity/v3/role_assignments?user.id=140c6d1a20e94192bde06e72040f162d&scope.project.id=0c9a4444228d4be89a4ba8aa53099531&role.id=ead4e9a9b7e947e1bff82fa3300df26c => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:16:42.156228 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f984cc-87a4-4d13-90d9-f66c56916cdd None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:42.156815 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f984cc-87a4-4d13-90d9-f66c56916cdd None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:42.156815 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f984cc-87a4-4d13-90d9-f66c56916cdd None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:42.159236 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 551/1099] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:16:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:16:42.164301 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3822742-27dd-4464-aa3c-9ad3a5e945d2 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:42.164702 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3822742-27dd-4464-aa3c-9ad3a5e945d2 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:42.164862 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3822742-27dd-4464-aa3c-9ad3a5e945d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:42.183067 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-b3822742-27dd-4464-aa3c-9ad3a5e945d2 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:16:42.184237 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-b3822742-27dd-4464-aa3c-9ad3a5e945d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:16:42.247629 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 549/1100] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:16:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 01:16:42.270983 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f984cc-87a4-4d13-90d9-f66c56916cdd None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:42.368681 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f984cc-87a4-4d13-90d9-f66c56916cdd None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:42.399435 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7533ddb6-63ea-43b0-997b-69941aecf355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:42.400238 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7533ddb6-63ea-43b0-997b-69941aecf355 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:42.400518 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7533ddb6-63ea-43b0-997b-69941aecf355 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:42.400790 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7533ddb6-63ea-43b0-997b-69941aecf355 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:42.411615 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7533ddb6-63ea-43b0-997b-69941aecf355 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:16:42.418282 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-7533ddb6-63ea-43b0-997b-69941aecf355 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 30 01:16:42.419483 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 552/1101] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Mar 30 01:16:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:16:42.426178 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3822742-27dd-4464-aa3c-9ad3a5e945d2 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:42.520995 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3822742-27dd-4464-aa3c-9ad3a5e945d2 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:42.553756 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22771e46-425f-4d3a-b7ef-c210409c67c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:42.554402 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22771e46-425f-4d3a-b7ef-c210409c67c1 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:42.554683 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22771e46-425f-4d3a-b7ef-c210409c67c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:42.554989 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22771e46-425f-4d3a-b7ef-c210409c67c1 None admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:42.555725 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22771e46-425f-4d3a-b7ef-c210409c67c1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:42.556029 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22771e46-425f-4d3a-b7ef-c210409c67c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:42.557372 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22771e46-425f-4d3a-b7ef-c210409c67c1 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:42.565901 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 550/1102] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Mar 30 01:16:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:42.571554 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7533ddb6-63ea-43b0-997b-69941aecf355 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:42.666025 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7533ddb6-63ea-43b0-997b-69941aecf355 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:42.698525 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac0da3e-eb07-4d0b-b96b-d5f70e54a5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:42.699407 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac0da3e-eb07-4d0b-b96b-d5f70e54a5dc None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:42.699690 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac0da3e-eb07-4d0b-b96b-d5f70e54a5dc None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:42.700015 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac0da3e-eb07-4d0b-b96b-d5f70e54a5dc None admin] PATH_INFO: `/v3/users/e0a13eeb8b434b8799f7d661e30ff31b` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:42.701126 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac0da3e-eb07-4d0b-b96b-d5f70e54a5dc None admin] RBAC: Authorizing `identity:get_user(user_id=e0a13eeb8b434b8799f7d661e30ff31b)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:42.702566 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac0da3e-eb07-4d0b-b96b-d5f70e54a5dc None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:42.704227 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 553/1103] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Mar 30 01:16:42 2022] GET /identity/v3/users/e0a13eeb8b434b8799f7d661e30ff31b => generated 285 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:42.709901 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22771e46-425f-4d3a-b7ef-c210409c67c1 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:42.803597 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22771e46-425f-4d3a-b7ef-c210409c67c1 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:42.835073 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93115fa8-91ff-4ff8-b9f8-f4c9a42bbb82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:42.835704 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93115fa8-91ff-4ff8-b9f8-f4c9a42bbb82 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:42.835987 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93115fa8-91ff-4ff8-b9f8-f4c9a42bbb82 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:42.836265 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93115fa8-91ff-4ff8-b9f8-f4c9a42bbb82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:42.898943 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93115fa8-91ff-4ff8-b9f8-f4c9a42bbb82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:42.900372 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93115fa8-91ff-4ff8-b9f8-f4c9a42bbb82 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:42.993867 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 551/1104] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Mar 30 01:16:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Mar 30 01:16:43.000274 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac0da3e-eb07-4d0b-b96b-d5f70e54a5dc None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:43.096633 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac0da3e-eb07-4d0b-b96b-d5f70e54a5dc None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:43.129168 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90319fed-6af2-48c5-ad38-8d9a1e3f7db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:43.130006 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90319fed-6af2-48c5-ad38-8d9a1e3f7db9 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:43.130287 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90319fed-6af2-48c5-ad38-8d9a1e3f7db9 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:43.130562 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90319fed-6af2-48c5-ad38-8d9a1e3f7db9 None admin] PATH_INFO: `/v3/projects/c935d5eb8a9a45ed91c209c7ae52ecab` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:43.131747 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90319fed-6af2-48c5-ad38-8d9a1e3f7db9 None admin] RBAC: Authorizing `identity:get_project(project_id=c935d5eb8a9a45ed91c209c7ae52ecab)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:43.133163 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90319fed-6af2-48c5-ad38-8d9a1e3f7db9 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:43.134826 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 554/1105] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Mar 30 01:16:42 2022] GET /identity/v3/projects/c935d5eb8a9a45ed91c209c7ae52ecab => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:43.140904 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93115fa8-91ff-4ff8-b9f8-f4c9a42bbb82 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:43.234147 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93115fa8-91ff-4ff8-b9f8-f4c9a42bbb82 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:43.267643 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2104acf0-7f06-4974-b768-11d7d8abebf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:43.268230 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2104acf0-7f06-4974-b768-11d7d8abebf2 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:43.268513 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2104acf0-7f06-4974-b768-11d7d8abebf2 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:43.268788 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2104acf0-7f06-4974-b768-11d7d8abebf2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:43.269595 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2104acf0-7f06-4974-b768-11d7d8abebf2 None admin] RBAC: Adding query filter params (role.id=36909bbf31d04993bb2a9fe587b572dc, scope.project.id=c935d5eb8a9a45ed91c209c7ae52ecab, user.id=e0a13eeb8b434b8799f7d661e30ff31b) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:43.269905 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2104acf0-7f06-4974-b768-11d7d8abebf2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:43.271342 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2104acf0-7f06-4974-b768-11d7d8abebf2 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:43.276824 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 552/1106] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Mar 30 01:16:43 2022] GET /identity/v3/role_assignments?user.id=e0a13eeb8b434b8799f7d661e30ff31b&scope.project.id=c935d5eb8a9a45ed91c209c7ae52ecab&role.id=36909bbf31d04993bb2a9fe587b572dc => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:45.589292 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e87eaf-dc24-4e91-8398-f2483ff58226 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:45.589855 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e87eaf-dc24-4e91-8398-f2483ff58226 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:45.589855 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e87eaf-dc24-4e91-8398-f2483ff58226 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:45.591624 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 555/1107] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:16:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:16:45.597241 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439b421-6c5f-46dd-9e6f-94a87ad432c8 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:45.597647 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439b421-6c5f-46dd-9e6f-94a87ad432c8 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:45.597836 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439b421-6c5f-46dd-9e6f-94a87ad432c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:45.614672 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-3439b421-6c5f-46dd-9e6f-94a87ad432c8 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:16:45.615876 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-3439b421-6c5f-46dd-9e6f-94a87ad432c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:16:45.679122 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 553/1108] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:16:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 01:16:45.703760 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e87eaf-dc24-4e91-8398-f2483ff58226 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:45.799538 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e87eaf-dc24-4e91-8398-f2483ff58226 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:45.831289 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09d5017-9cb7-4966-a970-f48556e46f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:45.832054 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d5017-9cb7-4966-a970-f48556e46f6a None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:45.832336 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d5017-9cb7-4966-a970-f48556e46f6a None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:45.832612 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d5017-9cb7-4966-a970-f48556e46f6a None admin] PATH_INFO: `/v3/domains/default` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:45.833765 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09d5017-9cb7-4966-a970-f48556e46f6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:45.835216 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09d5017-9cb7-4966-a970-f48556e46f6a None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:45.836788 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 556/1109] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:16:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:45.842524 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3439b421-6c5f-46dd-9e6f-94a87ad432c8 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:45.936516 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3439b421-6c5f-46dd-9e6f-94a87ad432c8 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:45.968447 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1efb90-8550-45a4-918d-b522829d68bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:45.969093 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1efb90-8550-45a4-918d-b522829d68bc None admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:45.969375 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1efb90-8550-45a4-918d-b522829d68bc None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:45.970248 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1efb90-8550-45a4-918d-b522829d68bc None admin] PATH_INFO: `/v3/users` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:45.971150 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1efb90-8550-45a4-918d-b522829d68bc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:45.972557 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1efb90-8550-45a4-918d-b522829d68bc None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:45.992112 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 554/1110] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Mar 30 01:16:45 2022] POST /identity/v3/users => generated 286 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:16:48.317974 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78278c-e207-4dbd-ba07-c82a628e9e60 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:48.318540 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78278c-e207-4dbd-ba07-c82a628e9e60 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:48.318540 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78278c-e207-4dbd-ba07-c82a628e9e60 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:48.320463 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 557/1111] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:16:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:16:48.325498 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc21f4-dd47-4c8e-8d7b-19d590c451be None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:48.325925 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc21f4-dd47-4c8e-8d7b-19d590c451be None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:48.326037 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc21f4-dd47-4c8e-8d7b-19d590c451be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:48.342466 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-a7cc21f4-dd47-4c8e-8d7b-19d590c451be None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:16:48.343667 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-a7cc21f4-dd47-4c8e-8d7b-19d590c451be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:16:48.405891 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 555/1112] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:16:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 30 01:16:48.430334 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc78278c-e207-4dbd-ba07-c82a628e9e60 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:48.526812 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc78278c-e207-4dbd-ba07-c82a628e9e60 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:48.558848 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35231d69-f40f-44dc-aecf-2d77a73ea516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:48.559683 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35231d69-f40f-44dc-aecf-2d77a73ea516 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:48.559960 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35231d69-f40f-44dc-aecf-2d77a73ea516 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:48.560228 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35231d69-f40f-44dc-aecf-2d77a73ea516 None admin] PATH_INFO: `/v3/roles/7ab1dc76ea3e450689be4c2ab56097f4` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:48.561680 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35231d69-f40f-44dc-aecf-2d77a73ea516 None admin] RBAC: Authorizing `identity:get_role(role_id=7ab1dc76ea3e450689be4c2ab56097f4)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:48.563059 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35231d69-f40f-44dc-aecf-2d77a73ea516 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:48.564498 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 558/1113] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Mar 30 01:16:48 2022] GET /identity/v3/roles/7ab1dc76ea3e450689be4c2ab56097f4 => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:48.570351 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cc21f4-dd47-4c8e-8d7b-19d590c451be None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:48.665149 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cc21f4-dd47-4c8e-8d7b-19d590c451be None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:48.696824 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3215b25b-d477-41d0-b578-00dd5ae72f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:48.697673 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215b25b-d477-41d0-b578-00dd5ae72f0a None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:48.697954 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215b25b-d477-41d0-b578-00dd5ae72f0a None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:48.698226 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215b25b-d477-41d0-b578-00dd5ae72f0a None admin] PATH_INFO: `/v3/users/98e0ae1da9f940a9b52c280ae0bc15ca` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:48.711160 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3215b25b-d477-41d0-b578-00dd5ae72f0a None admin] RBAC: Authorizing `identity:get_user(user_id=98e0ae1da9f940a9b52c280ae0bc15ca)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:48.712590 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3215b25b-d477-41d0-b578-00dd5ae72f0a None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:48.714216 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 556/1114] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Mar 30 01:16:48 2022] GET /identity/v3/users/98e0ae1da9f940a9b52c280ae0bc15ca => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:48.720987 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35231d69-f40f-44dc-aecf-2d77a73ea516 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:48.816195 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35231d69-f40f-44dc-aecf-2d77a73ea516 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:48.849820 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2777dd6f-0f18-400d-93a9-70b2491cd352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:48.850387 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777dd6f-0f18-400d-93a9-70b2491cd352 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:48.850668 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777dd6f-0f18-400d-93a9-70b2491cd352 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:48.850978 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777dd6f-0f18-400d-93a9-70b2491cd352 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:48.914988 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2777dd6f-0f18-400d-93a9-70b2491cd352 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:48.916431 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2777dd6f-0f18-400d-93a9-70b2491cd352 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:49.009942 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 559/1115] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Mar 30 01:16:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 30 01:16:49.015663 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3215b25b-d477-41d0-b578-00dd5ae72f0a None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:49.109137 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3215b25b-d477-41d0-b578-00dd5ae72f0a None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:49.140826 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534ad8a4-ca3c-47e5-a305-47d78c52ee4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:49.142222 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ad8a4-ca3c-47e5-a305-47d78c52ee4a None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:49.142500 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ad8a4-ca3c-47e5-a305-47d78c52ee4a None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:49.142796 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ad8a4-ca3c-47e5-a305-47d78c52ee4a None admin] PATH_INFO: `/v3/projects/c935d5eb8a9a45ed91c209c7ae52ecab` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:49.143954 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534ad8a4-ca3c-47e5-a305-47d78c52ee4a None admin] RBAC: Authorizing `identity:get_project(project_id=c935d5eb8a9a45ed91c209c7ae52ecab)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:49.145349 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534ad8a4-ca3c-47e5-a305-47d78c52ee4a None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:49.147010 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 557/1116] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Mar 30 01:16:49 2022] GET /identity/v3/projects/c935d5eb8a9a45ed91c209c7ae52ecab => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:49.152888 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2777dd6f-0f18-400d-93a9-70b2491cd352 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:49.247359 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2777dd6f-0f18-400d-93a9-70b2491cd352 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:49.280759 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a451a-b47d-4614-97e1-6286a5db9a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:49.281399 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a451a-b47d-4614-97e1-6286a5db9a9d None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:49.281684 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a451a-b47d-4614-97e1-6286a5db9a9d None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:49.282014 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a451a-b47d-4614-97e1-6286a5db9a9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:49.282924 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077a451a-b47d-4614-97e1-6286a5db9a9d None admin] RBAC: Adding query filter params (role.id=7ab1dc76ea3e450689be4c2ab56097f4, scope.project.id=c935d5eb8a9a45ed91c209c7ae52ecab, user.id=98e0ae1da9f940a9b52c280ae0bc15ca) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:49.283232 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077a451a-b47d-4614-97e1-6286a5db9a9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:49.284655 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077a451a-b47d-4614-97e1-6286a5db9a9d None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:49.289853 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 560/1117] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Mar 30 01:16:49 2022] GET /identity/v3/role_assignments?user.id=98e0ae1da9f940a9b52c280ae0bc15ca&scope.project.id=c935d5eb8a9a45ed91c209c7ae52ecab&role.id=7ab1dc76ea3e450689be4c2ab56097f4 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:51.568433 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772722d0-fba3-4b39-bf0e-2b1c7ef14ce9 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:51.569005 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772722d0-fba3-4b39-bf0e-2b1c7ef14ce9 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:51.569005 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772722d0-fba3-4b39-bf0e-2b1c7ef14ce9 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:51.570893 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 558/1118] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:16:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:16:51.576296 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d78066-1978-4d4a-99cb-e78af1ff5ac3 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:51.576712 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d78066-1978-4d4a-99cb-e78af1ff5ac3 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:51.576819 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d78066-1978-4d4a-99cb-e78af1ff5ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:51.593696 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-c8d78066-1978-4d4a-99cb-e78af1ff5ac3 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:16:51.594923 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-c8d78066-1978-4d4a-99cb-e78af1ff5ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:16:51.658089 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 561/1119] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:16:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 30 01:16:51.680997 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772722d0-fba3-4b39-bf0e-2b1c7ef14ce9 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:51.776172 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772722d0-fba3-4b39-bf0e-2b1c7ef14ce9 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:51.808309 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f5fc5-9228-49b5-8015-9e3defe7b9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:51.809148 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f5fc5-9228-49b5-8015-9e3defe7b9e9 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:51.809426 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f5fc5-9228-49b5-8015-9e3defe7b9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:51.809700 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f5fc5-9228-49b5-8015-9e3defe7b9e9 None admin] PATH_INFO: `/v3/roles/7ab1dc76ea3e450689be4c2ab56097f4` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:51.811171 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2f5fc5-9228-49b5-8015-9e3defe7b9e9 None admin] RBAC: Authorizing `identity:get_role(role_id=7ab1dc76ea3e450689be4c2ab56097f4)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:51.812516 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2f5fc5-9228-49b5-8015-9e3defe7b9e9 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:51.814724 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 559/1120] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Mar 30 01:16:51 2022] GET /identity/v3/roles/7ab1dc76ea3e450689be4c2ab56097f4 => generated 223 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:51.820654 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d78066-1978-4d4a-99cb-e78af1ff5ac3 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:51.913279 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d78066-1978-4d4a-99cb-e78af1ff5ac3 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:51.945142 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5152a22-7218-4e12-9b8b-a30a5887544f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:51.945998 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5152a22-7218-4e12-9b8b-a30a5887544f None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:51.946283 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5152a22-7218-4e12-9b8b-a30a5887544f None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:51.946561 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5152a22-7218-4e12-9b8b-a30a5887544f None admin] PATH_INFO: `/v3/users/98e0ae1da9f940a9b52c280ae0bc15ca` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:51.947771 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5152a22-7218-4e12-9b8b-a30a5887544f None admin] RBAC: Authorizing `identity:get_user(user_id=98e0ae1da9f940a9b52c280ae0bc15ca)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:51.949199 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5152a22-7218-4e12-9b8b-a30a5887544f None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:51.951019 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 562/1121] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Mar 30 01:16:51 2022] GET /identity/v3/users/98e0ae1da9f940a9b52c280ae0bc15ca => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:51.956843 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f5fc5-9228-49b5-8015-9e3defe7b9e9 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:52.050187 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f5fc5-9228-49b5-8015-9e3defe7b9e9 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:52.082324 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f41a12-6c21-46b3-ae39-354a172632db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:52.083144 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f41a12-6c21-46b3-ae39-354a172632db None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:52.083423 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f41a12-6c21-46b3-ae39-354a172632db None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:52.083694 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f41a12-6c21-46b3-ae39-354a172632db None admin] PATH_INFO: `/v3/projects/c935d5eb8a9a45ed91c209c7ae52ecab` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:52.084844 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f41a12-6c21-46b3-ae39-354a172632db None admin] RBAC: Authorizing `identity:get_project(project_id=c935d5eb8a9a45ed91c209c7ae52ecab)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:52.086250 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f41a12-6c21-46b3-ae39-354a172632db None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:52.087930 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 560/1122] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Mar 30 01:16:51 2022] GET /identity/v3/projects/c935d5eb8a9a45ed91c209c7ae52ecab => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:52.093992 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5152a22-7218-4e12-9b8b-a30a5887544f None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:52.187460 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5152a22-7218-4e12-9b8b-a30a5887544f None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:52.220064 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80460040-8795-4ef2-85b3-1c0cfc2fd20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:52.220926 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80460040-8795-4ef2-85b3-1c0cfc2fd20b None admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:52.221201 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80460040-8795-4ef2-85b3-1c0cfc2fd20b None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:52.221468 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80460040-8795-4ef2-85b3-1c0cfc2fd20b None admin] PATH_INFO: `/v3/projects/c935d5eb8a9a45ed91c209c7ae52ecab/users/98e0ae1da9f940a9b52c280ae0bc15ca/roles/7ab1dc76ea3e450689be4c2ab56097f4` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:52.223638 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80460040-8795-4ef2-85b3-1c0cfc2fd20b None admin] RBAC: Authorizing `identity:create_grant(project_id=c935d5eb8a9a45ed91c209c7ae52ecab, user_id=98e0ae1da9f940a9b52c280ae0bc15ca, role_id=7ab1dc76ea3e450689be4c2ab56097f4)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:52.225068 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80460040-8795-4ef2-85b3-1c0cfc2fd20b None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:52.237740 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 563/1123] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Mar 30 01:16:52 2022] PUT /identity/v3/projects/c935d5eb8a9a45ed91c209c7ae52ecab/users/98e0ae1da9f940a9b52c280ae0bc15ca/roles/7ab1dc76ea3e450689be4c2ab56097f4 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:16:54.520162 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ec9f5-034e-43bb-b920-664dd02b5e3f None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:54.520723 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ec9f5-034e-43bb-b920-664dd02b5e3f None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:54.520723 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ec9f5-034e-43bb-b920-664dd02b5e3f None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:54.522478 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 561/1124] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:16:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:16:54.527736 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6b7bb-a36d-45eb-a843-a6125994787e None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:54.528164 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6b7bb-a36d-45eb-a843-a6125994787e None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:54.528294 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6b7bb-a36d-45eb-a843-a6125994787e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:54.546222 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-81c6b7bb-a36d-45eb-a843-a6125994787e None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:16:54.548533 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-81c6b7bb-a36d-45eb-a843-a6125994787e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:16:54.612395 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 564/1125] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:16:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 01:16:54.637002 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ec9f5-034e-43bb-b920-664dd02b5e3f None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:54.732254 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ec9f5-034e-43bb-b920-664dd02b5e3f None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:54.764302 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea3a82-e02c-4b8f-a0d4-1993fa102dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:54.765134 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea3a82-e02c-4b8f-a0d4-1993fa102dcb None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:54.765409 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea3a82-e02c-4b8f-a0d4-1993fa102dcb None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:54.765677 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea3a82-e02c-4b8f-a0d4-1993fa102dcb None admin] PATH_INFO: `/v3/roles/7ab1dc76ea3e450689be4c2ab56097f4` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:54.767752 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ea3a82-e02c-4b8f-a0d4-1993fa102dcb None admin] RBAC: Authorizing `identity:get_role(role_id=7ab1dc76ea3e450689be4c2ab56097f4)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:54.769092 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ea3a82-e02c-4b8f-a0d4-1993fa102dcb None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:54.770463 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 562/1126] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Mar 30 01:16:54 2022] GET /identity/v3/roles/7ab1dc76ea3e450689be4c2ab56097f4 => generated 223 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:54.776111 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c6b7bb-a36d-45eb-a843-a6125994787e None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:54.872387 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c6b7bb-a36d-45eb-a843-a6125994787e None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:54.905720 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd40fe-fdd8-4d32-a6a7-77066d2adace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:54.906579 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd40fe-fdd8-4d32-a6a7-77066d2adace None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:54.907402 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd40fe-fdd8-4d32-a6a7-77066d2adace None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:54.907686 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd40fe-fdd8-4d32-a6a7-77066d2adace None admin] PATH_INFO: `/v3/users/98e0ae1da9f940a9b52c280ae0bc15ca` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:54.908866 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cd40fe-fdd8-4d32-a6a7-77066d2adace None admin] RBAC: Authorizing `identity:get_user(user_id=98e0ae1da9f940a9b52c280ae0bc15ca)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:54.910285 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cd40fe-fdd8-4d32-a6a7-77066d2adace None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:54.911932 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 565/1127] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Mar 30 01:16:54 2022] GET /identity/v3/users/98e0ae1da9f940a9b52c280ae0bc15ca => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:54.917729 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea3a82-e02c-4b8f-a0d4-1993fa102dcb None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:55.011169 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea3a82-e02c-4b8f-a0d4-1993fa102dcb None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:55.043223 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3f5f27-a749-4198-95b5-46069b55fbae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:55.043861 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f5f27-a749-4198-95b5-46069b55fbae None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:55.044144 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f5f27-a749-4198-95b5-46069b55fbae None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:55.044421 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f5f27-a749-4198-95b5-46069b55fbae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:55.107340 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3f5f27-a749-4198-95b5-46069b55fbae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:55.108758 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3f5f27-a749-4198-95b5-46069b55fbae None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:55.207077 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 563/1128] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Mar 30 01:16:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 30 01:16:55.212986 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd40fe-fdd8-4d32-a6a7-77066d2adace None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:55.305589 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd40fe-fdd8-4d32-a6a7-77066d2adace None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:55.337175 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0968d40-a797-43c8-a7e3-c5d2e2442323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:55.338013 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0968d40-a797-43c8-a7e3-c5d2e2442323 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:55.338291 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0968d40-a797-43c8-a7e3-c5d2e2442323 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:55.338563 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0968d40-a797-43c8-a7e3-c5d2e2442323 None admin] PATH_INFO: `/v3/projects/c935d5eb8a9a45ed91c209c7ae52ecab` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:55.339741 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0968d40-a797-43c8-a7e3-c5d2e2442323 None admin] RBAC: Authorizing `identity:get_project(project_id=c935d5eb8a9a45ed91c209c7ae52ecab)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:55.341155 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0968d40-a797-43c8-a7e3-c5d2e2442323 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:55.342802 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 566/1129] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Mar 30 01:16:55 2022] GET /identity/v3/projects/c935d5eb8a9a45ed91c209c7ae52ecab => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:55.348806 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3f5f27-a749-4198-95b5-46069b55fbae None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:55.443449 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3f5f27-a749-4198-95b5-46069b55fbae None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:55.476171 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530cb9cd-0b1a-4dcd-8629-1412a7cf2bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:55.476827 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530cb9cd-0b1a-4dcd-8629-1412a7cf2bf2 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:55.477110 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530cb9cd-0b1a-4dcd-8629-1412a7cf2bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:55.477386 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530cb9cd-0b1a-4dcd-8629-1412a7cf2bf2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:55.478211 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530cb9cd-0b1a-4dcd-8629-1412a7cf2bf2 None admin] RBAC: Adding query filter params (role.id=7ab1dc76ea3e450689be4c2ab56097f4, scope.project.id=c935d5eb8a9a45ed91c209c7ae52ecab, user.id=98e0ae1da9f940a9b52c280ae0bc15ca) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:16:55.478525 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530cb9cd-0b1a-4dcd-8629-1412a7cf2bf2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:55.479983 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530cb9cd-0b1a-4dcd-8629-1412a7cf2bf2 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:55.486555 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 564/1130] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Mar 30 01:16:55 2022] GET /identity/v3/role_assignments?user.id=98e0ae1da9f940a9b52c280ae0bc15ca&scope.project.id=c935d5eb8a9a45ed91c209c7ae52ecab&role.id=7ab1dc76ea3e450689be4c2ab56097f4 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:57.842078 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe0f26-4983-4b12-b199-bb7e0664a363 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:57.842620 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe0f26-4983-4b12-b199-bb7e0664a363 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:57.842620 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe0f26-4983-4b12-b199-bb7e0664a363 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:57.844434 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 567/1131] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:16:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:16:57.849511 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10f5f6-c2f0-44d3-8df4-fa6ce150cb35 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:57.849902 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10f5f6-c2f0-44d3-8df4-fa6ce150cb35 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:57.850073 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10f5f6-c2f0-44d3-8df4-fa6ce150cb35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:57.867205 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-2d10f5f6-c2f0-44d3-8df4-fa6ce150cb35 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:16:57.868381 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-2d10f5f6-c2f0-44d3-8df4-fa6ce150cb35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:16:57.932743 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 565/1132] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:16:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 01:16:57.957419 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe0f26-4983-4b12-b199-bb7e0664a363 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:58.057137 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe0f26-4983-4b12-b199-bb7e0664a363 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:58.092981 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2575f4f-6080-451c-be37-e4ef59f5499f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:58.093764 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2575f4f-6080-451c-be37-e4ef59f5499f None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:58.094101 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2575f4f-6080-451c-be37-e4ef59f5499f None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:58.094460 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2575f4f-6080-451c-be37-e4ef59f5499f None admin] PATH_INFO: `/v3/domains/default` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:58.095658 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2575f4f-6080-451c-be37-e4ef59f5499f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:58.097091 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2575f4f-6080-451c-be37-e4ef59f5499f None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:58.098686 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 568/1133] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:16:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:16:58.104522 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d10f5f6-c2f0-44d3-8df4-fa6ce150cb35 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:16:58.198513 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d10f5f6-c2f0-44d3-8df4-fa6ce150cb35 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:16:58.230486 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb86dc8-745c-4ca6-bbf7-b509bf903ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:16:58.231157 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb86dc8-745c-4ca6-bbf7-b509bf903ff4 None admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:16:58.231442 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb86dc8-745c-4ca6-bbf7-b509bf903ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:16:58.231719 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb86dc8-745c-4ca6-bbf7-b509bf903ff4 None admin] PATH_INFO: `/v3/projects` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:16:58.232424 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb86dc8-745c-4ca6-bbf7-b509bf903ff4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:16:58.233838 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb86dc8-745c-4ca6-bbf7-b509bf903ff4 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:16:58.258598 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 566/1134] 10.222.0.30 () {60 vars in 1141 bytes} [Wed Mar 30 01:16:58 2022] POST /identity/v3/projects => generated 311 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:17:00.542643 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a106d0-6fdc-420c-b430-8877da1b0647 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:17:00.543196 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a106d0-6fdc-420c-b430-8877da1b0647 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:17:00.543288 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a106d0-6fdc-420c-b430-8877da1b0647 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:17:00.545003 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 569/1135] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:17:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:17:00.550884 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34911bac-f093-4200-abf8-f39dab030ca2 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:17:00.551286 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34911bac-f093-4200-abf8-f39dab030ca2 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:17:00.551436 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34911bac-f093-4200-abf8-f39dab030ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:17:00.568288 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-34911bac-f093-4200-abf8-f39dab030ca2 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:17:00.569448 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-34911bac-f093-4200-abf8-f39dab030ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:17:00.631877 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 567/1136] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:17:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 01:17:00.656714 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a106d0-6fdc-420c-b430-8877da1b0647 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:17:00.752988 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a106d0-6fdc-420c-b430-8877da1b0647 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:17:00.784724 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f8c2c1-af5e-4887-9ac6-7d974c5a105c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:17:00.785502 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f8c2c1-af5e-4887-9ac6-7d974c5a105c None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:17:00.785786 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f8c2c1-af5e-4887-9ac6-7d974c5a105c None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:17:00.786061 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f8c2c1-af5e-4887-9ac6-7d974c5a105c None admin] PATH_INFO: `/v3/domains/default` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:17:00.787248 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f8c2c1-af5e-4887-9ac6-7d974c5a105c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:17:00.788667 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f8c2c1-af5e-4887-9ac6-7d974c5a105c None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:17:00.790251 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 570/1137] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:17:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:17:00.795936 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34911bac-f093-4200-abf8-f39dab030ca2 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:17:00.889779 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34911bac-f093-4200-abf8-f39dab030ca2 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:17:00.921708 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d686d-949e-46fd-930c-0b32a090ce63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:17:00.923024 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d686d-949e-46fd-930c-0b32a090ce63 None admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:17:00.923361 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d686d-949e-46fd-930c-0b32a090ce63 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:17:00.923638 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d686d-949e-46fd-930c-0b32a090ce63 None admin] PATH_INFO: `/v3/users` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:17:00.924330 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838d686d-949e-46fd-930c-0b32a090ce63 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:17:00.925743 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838d686d-949e-46fd-930c-0b32a090ce63 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:17:00.944469 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 568/1138] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Mar 30 01:17:00 2022] POST /identity/v3/users => generated 286 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:17:03.255292 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d688ac0-71dd-4a79-b8f6-6c13650ce3c4 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:17:03.255843 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d688ac0-71dd-4a79-b8f6-6c13650ce3c4 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:17:03.255843 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d688ac0-71dd-4a79-b8f6-6c13650ce3c4 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:17:03.257604 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 571/1139] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:17:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:17:03.262794 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2871f-789b-4770-b751-e5bbd5c95479 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:17:03.263208 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2871f-789b-4770-b751-e5bbd5c95479 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:17:03.263353 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2871f-789b-4770-b751-e5bbd5c95479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:17:03.280772 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-63e2871f-789b-4770-b751-e5bbd5c95479 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:17:03.282212 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-63e2871f-789b-4770-b751-e5bbd5c95479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:17:03.345849 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 569/1140] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:17:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 01:17:03.368938 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d688ac0-71dd-4a79-b8f6-6c13650ce3c4 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:17:03.468755 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d688ac0-71dd-4a79-b8f6-6c13650ce3c4 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:17:03.501075 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a2628a-58ad-4c02-9f6a-3edb1f521d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:17:03.501846 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2628a-58ad-4c02-9f6a-3edb1f521d96 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:17:03.502124 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2628a-58ad-4c02-9f6a-3edb1f521d96 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:17:03.502389 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2628a-58ad-4c02-9f6a-3edb1f521d96 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:17:03.511907 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a2628a-58ad-4c02-9f6a-3edb1f521d96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:17:03.518523 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-b5a2628a-58ad-4c02-9f6a-3edb1f521d96 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 30 01:17:03.519693 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 572/1141] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Mar 30 01:17:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:17:03.525766 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e2871f-789b-4770-b751-e5bbd5c95479 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:17:03.618398 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e2871f-789b-4770-b751-e5bbd5c95479 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:17:03.650484 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c946a7a2-5a0e-4623-9d7e-5e15f9907d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:17:03.651173 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946a7a2-5a0e-4623-9d7e-5e15f9907d89 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:17:03.651456 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946a7a2-5a0e-4623-9d7e-5e15f9907d89 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:17:03.651727 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946a7a2-5a0e-4623-9d7e-5e15f9907d89 None admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:17:03.652469 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c946a7a2-5a0e-4623-9d7e-5e15f9907d89 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:17:03.652771 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c946a7a2-5a0e-4623-9d7e-5e15f9907d89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:17:03.654125 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c946a7a2-5a0e-4623-9d7e-5e15f9907d89 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:17:03.662536 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 570/1142] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Mar 30 01:17:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:17:03.668119 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a2628a-58ad-4c02-9f6a-3edb1f521d96 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:17:03.762925 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a2628a-58ad-4c02-9f6a-3edb1f521d96 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:17:03.793755 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a59415-b12b-457d-ae7b-17a4f8f85ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:17:03.794604 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a59415-b12b-457d-ae7b-17a4f8f85ec3 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:17:03.794983 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a59415-b12b-457d-ae7b-17a4f8f85ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:17:03.795258 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a59415-b12b-457d-ae7b-17a4f8f85ec3 None admin] PATH_INFO: `/v3/users/40aac46cb20a465eb6f41d189a3ea7d9` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:17:03.808108 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a59415-b12b-457d-ae7b-17a4f8f85ec3 None admin] RBAC: Authorizing `identity:get_user(user_id=40aac46cb20a465eb6f41d189a3ea7d9)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:17:03.809552 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a59415-b12b-457d-ae7b-17a4f8f85ec3 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:17:03.811199 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 573/1143] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Mar 30 01:17:03 2022] GET /identity/v3/users/40aac46cb20a465eb6f41d189a3ea7d9 => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:17:03.817258 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c946a7a2-5a0e-4623-9d7e-5e15f9907d89 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:17:03.911353 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c946a7a2-5a0e-4623-9d7e-5e15f9907d89 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:17:03.942479 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed76f15f-e93e-4279-a2f0-4f771e0e7a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:17:03.943127 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76f15f-e93e-4279-a2f0-4f771e0e7a34 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:17:03.943409 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76f15f-e93e-4279-a2f0-4f771e0e7a34 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:17:03.943681 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76f15f-e93e-4279-a2f0-4f771e0e7a34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:17:04.005712 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed76f15f-e93e-4279-a2f0-4f771e0e7a34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:17:04.007168 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed76f15f-e93e-4279-a2f0-4f771e0e7a34 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:17:04.098359 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 571/1144] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Mar 30 01:17:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 30 01:17:04.104059 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a59415-b12b-457d-ae7b-17a4f8f85ec3 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:17:04.196498 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a59415-b12b-457d-ae7b-17a4f8f85ec3 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:17:04.227955 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f3cea-3a49-4bdc-92a1-b5129e1152c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:17:04.228793 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f3cea-3a49-4bdc-92a1-b5129e1152c6 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:17:04.229069 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f3cea-3a49-4bdc-92a1-b5129e1152c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:17:04.229336 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f3cea-3a49-4bdc-92a1-b5129e1152c6 None admin] PATH_INFO: `/v3/projects/31e91310659149fe8d4d8752fcf76b07` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:17:04.230479 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95f3cea-3a49-4bdc-92a1-b5129e1152c6 None admin] RBAC: Authorizing `identity:get_project(project_id=31e91310659149fe8d4d8752fcf76b07)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:17:04.231927 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95f3cea-3a49-4bdc-92a1-b5129e1152c6 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:17:04.233563 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 574/1145] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Mar 30 01:17:04 2022] GET /identity/v3/projects/31e91310659149fe8d4d8752fcf76b07 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:17:04.240132 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed76f15f-e93e-4279-a2f0-4f771e0e7a34 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:17:04.333106 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed76f15f-e93e-4279-a2f0-4f771e0e7a34 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:17:04.364796 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7040e30d-858f-4a60-ad14-1dc5c42f35bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:17:04.365380 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040e30d-858f-4a60-ad14-1dc5c42f35bf None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:17:04.365660 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040e30d-858f-4a60-ad14-1dc5c42f35bf None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:17:04.365933 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040e30d-858f-4a60-ad14-1dc5c42f35bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:17:04.366775 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7040e30d-858f-4a60-ad14-1dc5c42f35bf None admin] RBAC: Adding query filter params (role.id=36909bbf31d04993bb2a9fe587b572dc, scope.project.id=31e91310659149fe8d4d8752fcf76b07, user.id=40aac46cb20a465eb6f41d189a3ea7d9) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:17:04.367088 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7040e30d-858f-4a60-ad14-1dc5c42f35bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:17:04.368499 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7040e30d-858f-4a60-ad14-1dc5c42f35bf None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:17:04.373660 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 572/1146] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Mar 30 01:17:04 2022] GET /identity/v3/role_assignments?user.id=40aac46cb20a465eb6f41d189a3ea7d9&scope.project.id=31e91310659149fe8d4d8752fcf76b07&role.id=36909bbf31d04993bb2a9fe587b572dc => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:17:06.601376 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98bec4b-65dd-4806-8f26-552561934eb3 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:17:06.601928 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98bec4b-65dd-4806-8f26-552561934eb3 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:17:06.601928 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98bec4b-65dd-4806-8f26-552561934eb3 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:17:06.603746 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 575/1147] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:17:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:17:06.608931 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef06d0de-7f69-403b-9afd-d3ecd2252968 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:17:06.609849 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef06d0de-7f69-403b-9afd-d3ecd2252968 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:17:06.610106 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef06d0de-7f69-403b-9afd-d3ecd2252968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:17:06.627489 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-ef06d0de-7f69-403b-9afd-d3ecd2252968 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:17:06.628666 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-ef06d0de-7f69-403b-9afd-d3ecd2252968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:17:06.694047 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 573/1148] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:17:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 01:17:06.716142 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98bec4b-65dd-4806-8f26-552561934eb3 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:17:06.810674 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98bec4b-65dd-4806-8f26-552561934eb3 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:17:06.842411 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e346ed-abab-4f8e-9e33-936927ef6eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:17:06.843221 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e346ed-abab-4f8e-9e33-936927ef6eb3 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:17:06.843506 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e346ed-abab-4f8e-9e33-936927ef6eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:17:06.843784 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e346ed-abab-4f8e-9e33-936927ef6eb3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:17:06.853420 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e346ed-abab-4f8e-9e33-936927ef6eb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:17:06.860715 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-24e346ed-abab-4f8e-9e33-936927ef6eb3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 30 01:17:06.861851 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 576/1149] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Mar 30 01:17:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:17:06.867564 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef06d0de-7f69-403b-9afd-d3ecd2252968 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:17:06.960401 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef06d0de-7f69-403b-9afd-d3ecd2252968 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:17:06.992769 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa170db-7560-4c6b-8e09-e5fc9bd3a738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:17:06.993418 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa170db-7560-4c6b-8e09-e5fc9bd3a738 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:17:06.993705 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa170db-7560-4c6b-8e09-e5fc9bd3a738 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:17:06.993982 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa170db-7560-4c6b-8e09-e5fc9bd3a738 None admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:17:06.994737 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa170db-7560-4c6b-8e09-e5fc9bd3a738 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:17:06.995049 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa170db-7560-4c6b-8e09-e5fc9bd3a738 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:17:06.996400 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa170db-7560-4c6b-8e09-e5fc9bd3a738 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:17:07.004304 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 574/1150] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Mar 30 01:17:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:17:07.009984 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e346ed-abab-4f8e-9e33-936927ef6eb3 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:17:07.102944 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e346ed-abab-4f8e-9e33-936927ef6eb3 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:17:07.134128 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da46a6-8244-4cfc-867e-1d55f2cb3675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:17:07.135063 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da46a6-8244-4cfc-867e-1d55f2cb3675 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:17:07.135347 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da46a6-8244-4cfc-867e-1d55f2cb3675 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:17:07.135618 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da46a6-8244-4cfc-867e-1d55f2cb3675 None admin] PATH_INFO: `/v3/users/40aac46cb20a465eb6f41d189a3ea7d9` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:17:07.136776 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69da46a6-8244-4cfc-867e-1d55f2cb3675 None admin] RBAC: Authorizing `identity:get_user(user_id=40aac46cb20a465eb6f41d189a3ea7d9)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:17:07.138186 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69da46a6-8244-4cfc-867e-1d55f2cb3675 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:17:07.139768 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 577/1151] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Mar 30 01:17:07 2022] GET /identity/v3/users/40aac46cb20a465eb6f41d189a3ea7d9 => generated 286 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:17:07.145307 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa170db-7560-4c6b-8e09-e5fc9bd3a738 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:17:07.239305 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa170db-7560-4c6b-8e09-e5fc9bd3a738 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:17:07.271054 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d94e4-264a-4665-8235-41edeaa3e2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:17:07.271891 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d94e4-264a-4665-8235-41edeaa3e2a5 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:17:07.272176 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d94e4-264a-4665-8235-41edeaa3e2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:17:07.272455 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d94e4-264a-4665-8235-41edeaa3e2a5 None admin] PATH_INFO: `/v3/projects/31e91310659149fe8d4d8752fcf76b07` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:17:07.273624 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805d94e4-264a-4665-8235-41edeaa3e2a5 None admin] RBAC: Authorizing `identity:get_project(project_id=31e91310659149fe8d4d8752fcf76b07)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:17:07.275060 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805d94e4-264a-4665-8235-41edeaa3e2a5 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:17:07.276708 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 575/1152] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Mar 30 01:17:07 2022] GET /identity/v3/projects/31e91310659149fe8d4d8752fcf76b07 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:17:07.282601 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da46a6-8244-4cfc-867e-1d55f2cb3675 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:17:07.376462 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da46a6-8244-4cfc-867e-1d55f2cb3675 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:17:07.408413 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d660a73-d7fe-48ac-84ad-1cbd436acf27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:17:07.409782 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d660a73-d7fe-48ac-84ad-1cbd436acf27 None admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:17:07.410060 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d660a73-d7fe-48ac-84ad-1cbd436acf27 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:17:07.410335 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d660a73-d7fe-48ac-84ad-1cbd436acf27 None admin] PATH_INFO: `/v3/projects/31e91310659149fe8d4d8752fcf76b07/users/40aac46cb20a465eb6f41d189a3ea7d9/roles/36909bbf31d04993bb2a9fe587b572dc` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:17:07.412318 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d660a73-d7fe-48ac-84ad-1cbd436acf27 None admin] RBAC: Authorizing `identity:create_grant(project_id=31e91310659149fe8d4d8752fcf76b07, user_id=40aac46cb20a465eb6f41d189a3ea7d9, role_id=36909bbf31d04993bb2a9fe587b572dc)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:17:07.413736 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d660a73-d7fe-48ac-84ad-1cbd436acf27 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:17:07.426884 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 578/1153] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Mar 30 01:17:07 2022] PUT /identity/v3/projects/31e91310659149fe8d4d8752fcf76b07/users/40aac46cb20a465eb6f41d189a3ea7d9/roles/36909bbf31d04993bb2a9fe587b572dc => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:17:09.702072 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7542af-156f-4e83-9a42-6a99ee42d9e7 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:17:09.702556 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7542af-156f-4e83-9a42-6a99ee42d9e7 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:17:09.702642 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7542af-156f-4e83-9a42-6a99ee42d9e7 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:17:09.704394 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 576/1154] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:17:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:17:09.710053 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03bedf0-852e-4ee5-8820-ebf27c0a37fc None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:17:09.710484 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03bedf0-852e-4ee5-8820-ebf27c0a37fc None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:17:09.710617 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03bedf0-852e-4ee5-8820-ebf27c0a37fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:17:09.727577 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-b03bedf0-852e-4ee5-8820-ebf27c0a37fc None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:17:09.728775 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-b03bedf0-852e-4ee5-8820-ebf27c0a37fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:17:09.793529 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 579/1155] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:17:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 30 01:17:09.817868 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7542af-156f-4e83-9a42-6a99ee42d9e7 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:17:09.914668 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7542af-156f-4e83-9a42-6a99ee42d9e7 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:17:09.945764 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b79279-0514-4095-bd69-d48b081a1eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:17:09.946524 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b79279-0514-4095-bd69-d48b081a1eea None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:17:09.946829 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b79279-0514-4095-bd69-d48b081a1eea None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:17:09.947100 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b79279-0514-4095-bd69-d48b081a1eea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:17:09.957226 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b79279-0514-4095-bd69-d48b081a1eea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:17:09.963957 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-30b79279-0514-4095-bd69-d48b081a1eea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 30 01:17:09.965102 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 577/1156] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Mar 30 01:17:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:17:09.971088 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03bedf0-852e-4ee5-8820-ebf27c0a37fc None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:17:10.062546 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03bedf0-852e-4ee5-8820-ebf27c0a37fc None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:17:10.095448 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c5c0f5-2401-4d0f-9cd5-593b75834d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:17:10.096102 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c5c0f5-2401-4d0f-9cd5-593b75834d43 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:17:10.096408 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c5c0f5-2401-4d0f-9cd5-593b75834d43 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:17:10.096716 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c5c0f5-2401-4d0f-9cd5-593b75834d43 None admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:17:10.097492 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c5c0f5-2401-4d0f-9cd5-593b75834d43 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:17:10.097799 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c5c0f5-2401-4d0f-9cd5-593b75834d43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:17:10.099211 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c5c0f5-2401-4d0f-9cd5-593b75834d43 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:17:10.106898 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 580/1157] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Mar 30 01:17:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:17:10.112443 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b79279-0514-4095-bd69-d48b081a1eea None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:17:10.208590 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b79279-0514-4095-bd69-d48b081a1eea None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:17:10.239652 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d334edb-27e5-46ed-b66f-95c64a2dae81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:17:10.240495 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d334edb-27e5-46ed-b66f-95c64a2dae81 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:17:10.240770 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d334edb-27e5-46ed-b66f-95c64a2dae81 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:17:10.241039 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d334edb-27e5-46ed-b66f-95c64a2dae81 None admin] PATH_INFO: `/v3/users/40aac46cb20a465eb6f41d189a3ea7d9` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:17:10.242190 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d334edb-27e5-46ed-b66f-95c64a2dae81 None admin] RBAC: Authorizing `identity:get_user(user_id=40aac46cb20a465eb6f41d189a3ea7d9)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:17:10.243625 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d334edb-27e5-46ed-b66f-95c64a2dae81 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:17:10.245212 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 578/1158] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Mar 30 01:17:10 2022] GET /identity/v3/users/40aac46cb20a465eb6f41d189a3ea7d9 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:17:10.250963 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c5c0f5-2401-4d0f-9cd5-593b75834d43 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:17:10.346104 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c5c0f5-2401-4d0f-9cd5-593b75834d43 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:17:10.378857 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e667ab-b45b-4a2e-a2f9-9730184feab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:17:10.379487 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e667ab-b45b-4a2e-a2f9-9730184feab8 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:17:10.379772 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e667ab-b45b-4a2e-a2f9-9730184feab8 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:17:10.380044 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e667ab-b45b-4a2e-a2f9-9730184feab8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:17:10.443632 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e667ab-b45b-4a2e-a2f9-9730184feab8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:17:10.445075 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e667ab-b45b-4a2e-a2f9-9730184feab8 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:17:10.538623 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 581/1159] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Mar 30 01:17:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 30 01:17:10.544499 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d334edb-27e5-46ed-b66f-95c64a2dae81 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:17:10.638988 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d334edb-27e5-46ed-b66f-95c64a2dae81 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:17:10.670483 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81db7012-4a7c-4c40-8a73-d0979c58683e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:17:10.671365 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db7012-4a7c-4c40-8a73-d0979c58683e None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:17:10.671649 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db7012-4a7c-4c40-8a73-d0979c58683e None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:17:10.671924 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db7012-4a7c-4c40-8a73-d0979c58683e None admin] PATH_INFO: `/v3/projects/31e91310659149fe8d4d8752fcf76b07` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:17:10.673084 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81db7012-4a7c-4c40-8a73-d0979c58683e None admin] RBAC: Authorizing `identity:get_project(project_id=31e91310659149fe8d4d8752fcf76b07)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:17:10.675081 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81db7012-4a7c-4c40-8a73-d0979c58683e None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:17:10.676749 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 579/1160] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Mar 30 01:17:10 2022] GET /identity/v3/projects/31e91310659149fe8d4d8752fcf76b07 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:17:10.682802 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e667ab-b45b-4a2e-a2f9-9730184feab8 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:17:10.775542 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e667ab-b45b-4a2e-a2f9-9730184feab8 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:17:10.810372 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aac4579-77a7-4efa-84f9-7af6dc3cb3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:17:10.810971 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac4579-77a7-4efa-84f9-7af6dc3cb3a3 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:17:10.811256 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac4579-77a7-4efa-84f9-7af6dc3cb3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:17:10.811530 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac4579-77a7-4efa-84f9-7af6dc3cb3a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:17:10.812354 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aac4579-77a7-4efa-84f9-7af6dc3cb3a3 None admin] RBAC: Adding query filter params (role.id=36909bbf31d04993bb2a9fe587b572dc, scope.project.id=31e91310659149fe8d4d8752fcf76b07, user.id=40aac46cb20a465eb6f41d189a3ea7d9) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:17:10.812661 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aac4579-77a7-4efa-84f9-7af6dc3cb3a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:17:10.814087 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aac4579-77a7-4efa-84f9-7af6dc3cb3a3 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:17:10.820448 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 582/1161] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Mar 30 01:17:10 2022] GET /identity/v3/role_assignments?user.id=40aac46cb20a465eb6f41d189a3ea7d9&scope.project.id=31e91310659149fe8d4d8752fcf76b07&role.id=36909bbf31d04993bb2a9fe587b572dc => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:17:13.130376 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff40241-5361-4819-84ab-37d16ae123e5 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:17:13.130985 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff40241-5361-4819-84ab-37d16ae123e5 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:17:13.130985 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff40241-5361-4819-84ab-37d16ae123e5 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:17:13.132739 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 580/1162] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:17:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:17:13.137914 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9041cf-75d6-4b5f-9928-8a7e1e663073 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:17:13.138308 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9041cf-75d6-4b5f-9928-8a7e1e663073 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:17:13.138466 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9041cf-75d6-4b5f-9928-8a7e1e663073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:17:13.155130 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-0d9041cf-75d6-4b5f-9928-8a7e1e663073 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:17:13.156308 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-0d9041cf-75d6-4b5f-9928-8a7e1e663073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:17:13.218839 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 583/1163] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:17:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 01:17:13.241349 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff40241-5361-4819-84ab-37d16ae123e5 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:17:13.339326 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff40241-5361-4819-84ab-37d16ae123e5 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:17:13.372602 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d2d944-3fc2-4e8f-a708-db4a44e2bdd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:17:13.373236 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d2d944-3fc2-4e8f-a708-db4a44e2bdd6 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:17:13.373519 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d2d944-3fc2-4e8f-a708-db4a44e2bdd6 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:17:13.373795 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d2d944-3fc2-4e8f-a708-db4a44e2bdd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:17:13.438420 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d2d944-3fc2-4e8f-a708-db4a44e2bdd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:17:13.439860 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d2d944-3fc2-4e8f-a708-db4a44e2bdd6 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:17:13.536449 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 581/1164] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Mar 30 01:17:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 30 01:17:13.542440 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9041cf-75d6-4b5f-9928-8a7e1e663073 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:17:13.635581 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9041cf-75d6-4b5f-9928-8a7e1e663073 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:17:13.667639 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8465bd61-cafa-438d-948c-ef850d6c703d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:17:13.668424 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465bd61-cafa-438d-948c-ef850d6c703d None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:17:13.668703 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465bd61-cafa-438d-948c-ef850d6c703d None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:17:13.668975 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465bd61-cafa-438d-948c-ef850d6c703d None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:17:13.676214 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8465bd61-cafa-438d-948c-ef850d6c703d None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:17:13.677650 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8465bd61-cafa-438d-948c-ef850d6c703d None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:17:13.690764 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-8465bd61-cafa-438d-948c-ef850d6c703d None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Mar 30 01:17:13.691862 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 584/1165] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Mar 30 01:17:13 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:17:13.697773 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d2d944-3fc2-4e8f-a708-db4a44e2bdd6 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:17:13.792717 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d2d944-3fc2-4e8f-a708-db4a44e2bdd6 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:17:13.824950 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffccc837-2319-483d-a015-31abf881d948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:17:13.825591 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffccc837-2319-483d-a015-31abf881d948 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:17:13.825870 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffccc837-2319-483d-a015-31abf881d948 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:17:13.826145 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffccc837-2319-483d-a015-31abf881d948 None admin] PATH_INFO: `/v3/domains` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:17:13.826881 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffccc837-2319-483d-a015-31abf881d948 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:17:13.827184 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffccc837-2319-483d-a015-31abf881d948 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:17:13.828527 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffccc837-2319-483d-a015-31abf881d948 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:17:13.835544 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 582/1166] 10.222.0.30 () {56 vars in 1115 bytes} [Wed Mar 30 01:17:13 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:17:16.086718 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c5d930-ee05-4f65-8f86-2a8917c655c4 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:17:16.087275 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c5d930-ee05-4f65-8f86-2a8917c655c4 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:17:16.087275 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c5d930-ee05-4f65-8f86-2a8917c655c4 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:17:16.089064 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 585/1167] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:17:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:17:16.094353 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bfeb00-1529-4a92-a451-d74d508e882f None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:17:16.094790 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bfeb00-1529-4a92-a451-d74d508e882f None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:17:16.094939 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bfeb00-1529-4a92-a451-d74d508e882f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:17:16.111378 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-d3bfeb00-1529-4a92-a451-d74d508e882f None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:17:16.112802 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-d3bfeb00-1529-4a92-a451-d74d508e882f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:17:16.176334 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 583/1168] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:17:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 30 01:17:16.199546 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c5d930-ee05-4f65-8f86-2a8917c655c4 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:17:16.297309 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c5d930-ee05-4f65-8f86-2a8917c655c4 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:17:16.329411 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd27ef9-68ee-4b1f-9e3e-f3412d9a8a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:17:16.330058 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd27ef9-68ee-4b1f-9e3e-f3412d9a8a6a None admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:17:16.330395 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd27ef9-68ee-4b1f-9e3e-f3412d9a8a6a None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:17:16.330676 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd27ef9-68ee-4b1f-9e3e-f3412d9a8a6a None admin] PATH_INFO: `/v3/domains` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:17:16.331543 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd27ef9-68ee-4b1f-9e3e-f3412d9a8a6a None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:17:16.332907 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd27ef9-68ee-4b1f-9e3e-f3412d9a8a6a None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:17:16.347188 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 586/1169] 10.222.0.30 () {60 vars in 1138 bytes} [Wed Mar 30 01:17:16 2022] POST /identity/v3/domains => generated 267 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:17:18.620679 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9827c1-98ce-4cd1-a97d-7c4908a293ef None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:17:18.621069 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9827c1-98ce-4cd1-a97d-7c4908a293ef None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:17:18.621233 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9827c1-98ce-4cd1-a97d-7c4908a293ef None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:17:18.623038 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 584/1170] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:17:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:17:18.628655 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aeee68-da09-4199-846a-7f45aa91be49 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:17:18.629031 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aeee68-da09-4199-846a-7f45aa91be49 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:17:18.629211 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aeee68-da09-4199-846a-7f45aa91be49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:17:18.645666 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-b9aeee68-da09-4199-846a-7f45aa91be49 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:17:18.646887 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-b9aeee68-da09-4199-846a-7f45aa91be49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:17:18.710450 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 587/1171] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:17:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 30 01:17:18.734313 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9827c1-98ce-4cd1-a97d-7c4908a293ef None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:17:18.832895 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9827c1-98ce-4cd1-a97d-7c4908a293ef None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:17:18.865453 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e9bf36-a904-45c0-8560-142b27601968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:17:18.866291 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e9bf36-a904-45c0-8560-142b27601968 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:17:18.866573 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e9bf36-a904-45c0-8560-142b27601968 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:17:18.866885 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e9bf36-a904-45c0-8560-142b27601968 None admin] PATH_INFO: `/v3/domains/0eeb440fe9a84d2782f04aa31d10faf0` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:17:18.876761 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e9bf36-a904-45c0-8560-142b27601968 None admin] RBAC: Authorizing `identity:get_domain(domain_id=0eeb440fe9a84d2782f04aa31d10faf0)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:17:18.879114 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e9bf36-a904-45c0-8560-142b27601968 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:17:18.880706 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 585/1172] 10.222.0.30 () {56 vars in 1183 bytes} [Wed Mar 30 01:17:18 2022] GET /identity/v3/domains/0eeb440fe9a84d2782f04aa31d10faf0 => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:17:18.886603 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aeee68-da09-4199-846a-7f45aa91be49 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:17:18.980152 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aeee68-da09-4199-846a-7f45aa91be49 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:17:19.012254 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff320f4-2d0a-49e2-8439-b42dad9268d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:17:19.012898 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff320f4-2d0a-49e2-8439-b42dad9268d1 None admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:17:19.013182 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff320f4-2d0a-49e2-8439-b42dad9268d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:17:19.013460 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff320f4-2d0a-49e2-8439-b42dad9268d1 None admin] PATH_INFO: `/v3/projects` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:17:19.014169 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff320f4-2d0a-49e2-8439-b42dad9268d1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:17:19.015618 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff320f4-2d0a-49e2-8439-b42dad9268d1 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:17:19.040633 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 588/1173] 10.222.0.30 () {60 vars in 1141 bytes} [Wed Mar 30 01:17:18 2022] POST /identity/v3/projects => generated 361 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 01:17:21.351297 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c3a66-d8ad-4bf5-9024-dc7dc5ce7df5 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:17:21.351868 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c3a66-d8ad-4bf5-9024-dc7dc5ce7df5 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:17:21.351868 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c3a66-d8ad-4bf5-9024-dc7dc5ce7df5 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:17:21.353586 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 586/1174] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:17:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:17:21.358668 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2769eeb-0138-433e-819c-ed856b49b97b None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:17:21.359103 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2769eeb-0138-433e-819c-ed856b49b97b None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:17:21.359743 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2769eeb-0138-433e-819c-ed856b49b97b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:17:21.376597 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-c2769eeb-0138-433e-819c-ed856b49b97b None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:17:21.377765 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-c2769eeb-0138-433e-819c-ed856b49b97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:17:21.439409 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 589/1175] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:17:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 01:17:21.463926 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943c3a66-d8ad-4bf5-9024-dc7dc5ce7df5 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:17:21.560627 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943c3a66-d8ad-4bf5-9024-dc7dc5ce7df5 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:17:21.591999 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf9588-7198-4192-8311-e701785b9083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:17:21.592858 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf9588-7198-4192-8311-e701785b9083 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:17:21.593138 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf9588-7198-4192-8311-e701785b9083 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:17:21.593410 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf9588-7198-4192-8311-e701785b9083 None admin] PATH_INFO: `/v3/domains/0eeb440fe9a84d2782f04aa31d10faf0` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:17:21.594559 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cf9588-7198-4192-8311-e701785b9083 None admin] RBAC: Authorizing `identity:get_domain(domain_id=0eeb440fe9a84d2782f04aa31d10faf0)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:17:21.596697 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cf9588-7198-4192-8311-e701785b9083 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:17:21.598275 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 587/1176] 10.222.0.30 () {56 vars in 1183 bytes} [Wed Mar 30 01:17:21 2022] GET /identity/v3/domains/0eeb440fe9a84d2782f04aa31d10faf0 => generated 267 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:17:21.604113 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2769eeb-0138-433e-819c-ed856b49b97b None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:17:21.698537 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2769eeb-0138-433e-819c-ed856b49b97b None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:17:21.731478 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90918ed-0181-4ebe-86ea-c6188c63973d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:17:21.732136 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90918ed-0181-4ebe-86ea-c6188c63973d None admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:17:21.732419 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90918ed-0181-4ebe-86ea-c6188c63973d None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:17:21.732696 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90918ed-0181-4ebe-86ea-c6188c63973d None admin] PATH_INFO: `/v3/users` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:17:21.733388 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90918ed-0181-4ebe-86ea-c6188c63973d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:17:21.734841 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90918ed-0181-4ebe-86ea-c6188c63973d None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:17:21.756853 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 590/1177] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Mar 30 01:17:21 2022] POST /identity/v3/users => generated 311 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:17:24.049734 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cddc623-ed31-4c99-b3f6-13e6793eac8d None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:17:24.050241 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cddc623-ed31-4c99-b3f6-13e6793eac8d None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:17:24.050352 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cddc623-ed31-4c99-b3f6-13e6793eac8d None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:17:24.052061 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 588/1178] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:17:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:17:24.057089 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a2958d-fa22-4a35-83ae-dc42d3b5c9f8 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:17:24.057485 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a2958d-fa22-4a35-83ae-dc42d3b5c9f8 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:17:24.057641 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a2958d-fa22-4a35-83ae-dc42d3b5c9f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:17:24.075787 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-27a2958d-fa22-4a35-83ae-dc42d3b5c9f8 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:17:24.076967 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-27a2958d-fa22-4a35-83ae-dc42d3b5c9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:17:24.274105 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 591/1179] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:17:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 01:17:24.297840 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cddc623-ed31-4c99-b3f6-13e6793eac8d None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:17:24.394744 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cddc623-ed31-4c99-b3f6-13e6793eac8d None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:17:24.426837 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a00e15-bc4c-4695-8d5e-69958c016302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:17:24.427603 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a00e15-bc4c-4695-8d5e-69958c016302 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:17:24.427880 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a00e15-bc4c-4695-8d5e-69958c016302 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:17:24.428150 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a00e15-bc4c-4695-8d5e-69958c016302 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:17:24.438135 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a00e15-bc4c-4695-8d5e-69958c016302 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:17:24.444948 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-c9a00e15-bc4c-4695-8d5e-69958c016302 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 30 01:17:24.446100 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 589/1180] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Mar 30 01:17:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:17:24.452082 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a2958d-fa22-4a35-83ae-dc42d3b5c9f8 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:17:24.544638 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a2958d-fa22-4a35-83ae-dc42d3b5c9f8 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:17:24.575503 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cb5cc1-3b2e-444d-841b-6ab0b5eba167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:17:24.576154 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb5cc1-3b2e-444d-841b-6ab0b5eba167 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:17:24.576430 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb5cc1-3b2e-444d-841b-6ab0b5eba167 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:17:24.576696 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb5cc1-3b2e-444d-841b-6ab0b5eba167 None admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:17:24.577418 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cb5cc1-3b2e-444d-841b-6ab0b5eba167 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:17:24.577714 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cb5cc1-3b2e-444d-841b-6ab0b5eba167 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:17:24.579090 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cb5cc1-3b2e-444d-841b-6ab0b5eba167 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:17:24.587218 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 592/1181] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Mar 30 01:17:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:17:24.592915 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a00e15-bc4c-4695-8d5e-69958c016302 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:17:24.687857 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a00e15-bc4c-4695-8d5e-69958c016302 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:17:24.720359 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb61efb-7e84-46b8-a240-a2fcfe42f60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:17:24.721853 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb61efb-7e84-46b8-a240-a2fcfe42f60b None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:17:24.722126 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb61efb-7e84-46b8-a240-a2fcfe42f60b None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:17:24.722398 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb61efb-7e84-46b8-a240-a2fcfe42f60b None admin] PATH_INFO: `/v3/users/f6750ada7f2547db99b9452c519d7553` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:17:24.734905 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb61efb-7e84-46b8-a240-a2fcfe42f60b None admin] RBAC: Authorizing `identity:get_user(user_id=f6750ada7f2547db99b9452c519d7553)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:17:24.736378 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb61efb-7e84-46b8-a240-a2fcfe42f60b None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:17:24.738258 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 590/1182] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Mar 30 01:17:24 2022] GET /identity/v3/users/f6750ada7f2547db99b9452c519d7553 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:17:24.744167 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cb5cc1-3b2e-444d-841b-6ab0b5eba167 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:17:24.840433 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cb5cc1-3b2e-444d-841b-6ab0b5eba167 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:17:24.871664 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3f53ba-6cc0-430a-83d3-b4cbeb4742cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:17:24.872299 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f53ba-6cc0-430a-83d3-b4cbeb4742cc None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:17:24.872577 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f53ba-6cc0-430a-83d3-b4cbeb4742cc None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:17:24.872849 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f53ba-6cc0-430a-83d3-b4cbeb4742cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:17:24.934948 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3f53ba-6cc0-430a-83d3-b4cbeb4742cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:17:24.936374 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3f53ba-6cc0-430a-83d3-b4cbeb4742cc None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:17:25.026886 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 593/1183] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Mar 30 01:17:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 30 01:17:25.032873 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb61efb-7e84-46b8-a240-a2fcfe42f60b None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:17:25.141104 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb61efb-7e84-46b8-a240-a2fcfe42f60b None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:17:25.173650 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ea2584-8e92-4bf1-afa9-a2c3204b4b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:17:25.175011 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea2584-8e92-4bf1-afa9-a2c3204b4b59 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:17:25.175291 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea2584-8e92-4bf1-afa9-a2c3204b4b59 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:17:25.175562 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea2584-8e92-4bf1-afa9-a2c3204b4b59 None admin] PATH_INFO: `/v3/projects/a83b789b345c460d96ecef7857f29094` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:17:25.176708 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ea2584-8e92-4bf1-afa9-a2c3204b4b59 None admin] RBAC: Authorizing `identity:get_project(project_id=a83b789b345c460d96ecef7857f29094)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:17:25.178111 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ea2584-8e92-4bf1-afa9-a2c3204b4b59 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:17:25.179797 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 591/1184] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Mar 30 01:17:25 2022] GET /identity/v3/projects/a83b789b345c460d96ecef7857f29094 => generated 361 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:17:25.185856 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3f53ba-6cc0-430a-83d3-b4cbeb4742cc None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:17:25.278480 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3f53ba-6cc0-430a-83d3-b4cbeb4742cc None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:17:25.309921 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037e596c-e72e-4267-9563-f2da8dfa0164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:17:25.310556 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e596c-e72e-4267-9563-f2da8dfa0164 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:17:25.310863 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e596c-e72e-4267-9563-f2da8dfa0164 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:17:25.311135 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e596c-e72e-4267-9563-f2da8dfa0164 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:17:25.311938 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037e596c-e72e-4267-9563-f2da8dfa0164 None admin] RBAC: Adding query filter params (role.id=36909bbf31d04993bb2a9fe587b572dc, scope.project.id=a83b789b345c460d96ecef7857f29094, user.id=f6750ada7f2547db99b9452c519d7553) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:17:25.312240 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037e596c-e72e-4267-9563-f2da8dfa0164 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:17:25.313654 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037e596c-e72e-4267-9563-f2da8dfa0164 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:17:25.318979 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 594/1185] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Mar 30 01:17:25 2022] GET /identity/v3/role_assignments?user.id=f6750ada7f2547db99b9452c519d7553&scope.project.id=a83b789b345c460d96ecef7857f29094&role.id=36909bbf31d04993bb2a9fe587b572dc => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:17:27.630006 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f285065d-38f0-489e-ae8f-cdbae33762e7 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:17:27.630467 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f285065d-38f0-489e-ae8f-cdbae33762e7 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:17:27.630564 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f285065d-38f0-489e-ae8f-cdbae33762e7 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:17:27.632352 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 592/1186] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:17:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:17:27.637706 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96401b2-d33e-4dc9-bb34-687e06bfaf9e None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:17:27.638101 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96401b2-d33e-4dc9-bb34-687e06bfaf9e None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:17:27.638251 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96401b2-d33e-4dc9-bb34-687e06bfaf9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:17:27.655325 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-f96401b2-d33e-4dc9-bb34-687e06bfaf9e None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:17:27.656502 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-f96401b2-d33e-4dc9-bb34-687e06bfaf9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:17:27.719634 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 595/1187] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:17:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 01:17:27.742443 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f285065d-38f0-489e-ae8f-cdbae33762e7 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:17:27.837947 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f285065d-38f0-489e-ae8f-cdbae33762e7 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:17:27.869026 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01b5a30-d169-4b9c-9ca1-335e5ffdb53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:17:27.869740 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b5a30-d169-4b9c-9ca1-335e5ffdb53b None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:17:27.870023 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b5a30-d169-4b9c-9ca1-335e5ffdb53b None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:17:27.870297 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b5a30-d169-4b9c-9ca1-335e5ffdb53b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:17:27.880260 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01b5a30-d169-4b9c-9ca1-335e5ffdb53b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:17:27.887033 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-c01b5a30-d169-4b9c-9ca1-335e5ffdb53b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 30 01:17:27.888171 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 593/1188] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Mar 30 01:17:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:17:27.894665 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96401b2-d33e-4dc9-bb34-687e06bfaf9e None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:17:27.987382 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96401b2-d33e-4dc9-bb34-687e06bfaf9e None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:17:28.019251 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b2f05-6690-4b14-9cbb-2851cc273ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:17:28.019902 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b2f05-6690-4b14-9cbb-2851cc273ce2 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:17:28.020186 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b2f05-6690-4b14-9cbb-2851cc273ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:17:28.020460 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b2f05-6690-4b14-9cbb-2851cc273ce2 None admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:17:28.021200 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0b2f05-6690-4b14-9cbb-2851cc273ce2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:17:28.021503 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0b2f05-6690-4b14-9cbb-2851cc273ce2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:17:28.022893 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0b2f05-6690-4b14-9cbb-2851cc273ce2 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:17:28.030735 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 596/1189] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Mar 30 01:17:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:17:28.037118 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01b5a30-d169-4b9c-9ca1-335e5ffdb53b None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:17:28.131077 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01b5a30-d169-4b9c-9ca1-335e5ffdb53b None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:17:28.162408 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d50de35-7dd1-446e-8842-1a8c5323d6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:17:28.163280 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50de35-7dd1-446e-8842-1a8c5323d6db None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:17:28.163560 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50de35-7dd1-446e-8842-1a8c5323d6db None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:17:28.163832 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50de35-7dd1-446e-8842-1a8c5323d6db None admin] PATH_INFO: `/v3/users/f6750ada7f2547db99b9452c519d7553` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:17:28.165016 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d50de35-7dd1-446e-8842-1a8c5323d6db None admin] RBAC: Authorizing `identity:get_user(user_id=f6750ada7f2547db99b9452c519d7553)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:17:28.166432 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d50de35-7dd1-446e-8842-1a8c5323d6db None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:17:28.168047 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 594/1190] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Mar 30 01:17:28 2022] GET /identity/v3/users/f6750ada7f2547db99b9452c519d7553 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:17:28.174338 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b2f05-6690-4b14-9cbb-2851cc273ce2 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:17:28.268230 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b2f05-6690-4b14-9cbb-2851cc273ce2 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:17:28.299782 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acc9373-d3b3-4056-8260-d47fb5d77f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:17:28.300615 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc9373-d3b3-4056-8260-d47fb5d77f91 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:17:28.300899 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc9373-d3b3-4056-8260-d47fb5d77f91 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:17:28.301177 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc9373-d3b3-4056-8260-d47fb5d77f91 None admin] PATH_INFO: `/v3/projects/a83b789b345c460d96ecef7857f29094` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:17:28.302342 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acc9373-d3b3-4056-8260-d47fb5d77f91 None admin] RBAC: Authorizing `identity:get_project(project_id=a83b789b345c460d96ecef7857f29094)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:17:28.303788 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acc9373-d3b3-4056-8260-d47fb5d77f91 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:17:28.305429 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 597/1191] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Mar 30 01:17:28 2022] GET /identity/v3/projects/a83b789b345c460d96ecef7857f29094 => generated 361 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:17:28.311191 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d50de35-7dd1-446e-8842-1a8c5323d6db None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:17:28.406888 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d50de35-7dd1-446e-8842-1a8c5323d6db None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:17:28.438023 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf16e8-0d76-4c63-b1f9-af035356df05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:17:28.438913 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf16e8-0d76-4c63-b1f9-af035356df05 None admin] REQUEST_METHOD: `PUT` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:17:28.439778 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf16e8-0d76-4c63-b1f9-af035356df05 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:17:28.440052 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf16e8-0d76-4c63-b1f9-af035356df05 None admin] PATH_INFO: `/v3/projects/a83b789b345c460d96ecef7857f29094/users/f6750ada7f2547db99b9452c519d7553/roles/36909bbf31d04993bb2a9fe587b572dc` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:17:28.441969 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edf16e8-0d76-4c63-b1f9-af035356df05 None admin] RBAC: Authorizing `identity:create_grant(project_id=a83b789b345c460d96ecef7857f29094, user_id=f6750ada7f2547db99b9452c519d7553, role_id=36909bbf31d04993bb2a9fe587b572dc)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:17:28.443395 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edf16e8-0d76-4c63-b1f9-af035356df05 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:17:28.455751 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 595/1192] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Mar 30 01:17:28 2022] PUT /identity/v3/projects/a83b789b345c460d96ecef7857f29094/users/f6750ada7f2547db99b9452c519d7553/roles/36909bbf31d04993bb2a9fe587b572dc => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:17:30.707982 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3757e2d4-6237-40f7-9605-37430adb0be6 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:17:30.708514 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3757e2d4-6237-40f7-9605-37430adb0be6 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:17:30.708514 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3757e2d4-6237-40f7-9605-37430adb0be6 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:17:30.710308 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 598/1193] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:17:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:17:30.715510 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2118cd58-76dc-497a-a433-89bdeb7c4bd6 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:17:30.715918 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2118cd58-76dc-497a-a433-89bdeb7c4bd6 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:17:30.716063 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2118cd58-76dc-497a-a433-89bdeb7c4bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:17:30.733004 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-2118cd58-76dc-497a-a433-89bdeb7c4bd6 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:17:30.734163 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-2118cd58-76dc-497a-a433-89bdeb7c4bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:17:30.796597 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 596/1194] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:17:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 01:17:30.820030 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3757e2d4-6237-40f7-9605-37430adb0be6 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:17:30.914756 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3757e2d4-6237-40f7-9605-37430adb0be6 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:17:30.945829 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3c3948-849a-479f-b6fd-187d037aa26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:17:30.946610 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c3948-849a-479f-b6fd-187d037aa26d None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:17:30.946918 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c3948-849a-479f-b6fd-187d037aa26d None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:17:30.947259 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c3948-849a-479f-b6fd-187d037aa26d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:17:30.958267 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3c3948-849a-479f-b6fd-187d037aa26d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:17:30.964976 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-1d3c3948-849a-479f-b6fd-187d037aa26d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 30 01:17:30.966121 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 599/1195] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Mar 30 01:17:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:17:30.972189 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2118cd58-76dc-497a-a433-89bdeb7c4bd6 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:17:31.064921 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2118cd58-76dc-497a-a433-89bdeb7c4bd6 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:17:31.096815 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c2003e-d43e-46be-9a2c-30edaf25ee1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:17:31.097458 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c2003e-d43e-46be-9a2c-30edaf25ee1d None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:17:31.097738 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c2003e-d43e-46be-9a2c-30edaf25ee1d None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:17:31.098009 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c2003e-d43e-46be-9a2c-30edaf25ee1d None admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:17:31.098771 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c2003e-d43e-46be-9a2c-30edaf25ee1d None admin] RBAC: Adding query filter params (name=admin) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:17:31.099079 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c2003e-d43e-46be-9a2c-30edaf25ee1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:17:31.100425 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c2003e-d43e-46be-9a2c-30edaf25ee1d None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:17:31.108027 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 597/1196] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Mar 30 01:17:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:17:31.113604 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3c3948-849a-479f-b6fd-187d037aa26d None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:17:31.207207 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3c3948-849a-479f-b6fd-187d037aa26d None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:17:31.238278 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97c3d96-1821-42d9-9a80-965d4efebd51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:17:31.239144 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c3d96-1821-42d9-9a80-965d4efebd51 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:17:31.239424 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c3d96-1821-42d9-9a80-965d4efebd51 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:17:31.239694 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c3d96-1821-42d9-9a80-965d4efebd51 None admin] PATH_INFO: `/v3/users/f6750ada7f2547db99b9452c519d7553` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:17:31.240859 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97c3d96-1821-42d9-9a80-965d4efebd51 None admin] RBAC: Authorizing `identity:get_user(user_id=f6750ada7f2547db99b9452c519d7553)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:17:31.242254 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97c3d96-1821-42d9-9a80-965d4efebd51 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:17:31.243853 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 600/1197] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Mar 30 01:17:31 2022] GET /identity/v3/users/f6750ada7f2547db99b9452c519d7553 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:17:31.249532 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c2003e-d43e-46be-9a2c-30edaf25ee1d None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:17:31.344332 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c2003e-d43e-46be-9a2c-30edaf25ee1d None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:17:31.377659 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe4b9eb-264f-4287-bb54-eeb5318332b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:17:31.378290 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe4b9eb-264f-4287-bb54-eeb5318332b3 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:17:31.378580 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe4b9eb-264f-4287-bb54-eeb5318332b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:17:31.378892 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe4b9eb-264f-4287-bb54-eeb5318332b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:17:31.441774 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe4b9eb-264f-4287-bb54-eeb5318332b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:17:31.443234 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe4b9eb-264f-4287-bb54-eeb5318332b3 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:17:31.536389 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 598/1198] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Mar 30 01:17:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 30 01:17:31.542327 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97c3d96-1821-42d9-9a80-965d4efebd51 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:17:31.637645 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97c3d96-1821-42d9-9a80-965d4efebd51 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:17:31.669800 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b9230-3edf-4772-b627-5508a3adaa65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:17:31.670672 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b9230-3edf-4772-b627-5508a3adaa65 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:17:31.670987 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b9230-3edf-4772-b627-5508a3adaa65 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:17:31.671262 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b9230-3edf-4772-b627-5508a3adaa65 None admin] PATH_INFO: `/v3/projects/a83b789b345c460d96ecef7857f29094` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:17:31.672422 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3b9230-3edf-4772-b627-5508a3adaa65 None admin] RBAC: Authorizing `identity:get_project(project_id=a83b789b345c460d96ecef7857f29094)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:17:31.674140 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3b9230-3edf-4772-b627-5508a3adaa65 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:17:31.675846 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 601/1199] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Mar 30 01:17:31 2022] GET /identity/v3/projects/a83b789b345c460d96ecef7857f29094 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:17:31.681839 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe4b9eb-264f-4287-bb54-eeb5318332b3 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:17:31.776328 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe4b9eb-264f-4287-bb54-eeb5318332b3 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:17:31.807781 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6dc256-521c-4914-8c5b-4d78a9af87f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:17:31.808366 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6dc256-521c-4914-8c5b-4d78a9af87f0 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:17:31.808649 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6dc256-521c-4914-8c5b-4d78a9af87f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:17:31.808926 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6dc256-521c-4914-8c5b-4d78a9af87f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:17:31.809738 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6dc256-521c-4914-8c5b-4d78a9af87f0 None admin] RBAC: Adding query filter params (role.id=36909bbf31d04993bb2a9fe587b572dc, scope.project.id=a83b789b345c460d96ecef7857f29094, user.id=f6750ada7f2547db99b9452c519d7553) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:17:31.810050 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6dc256-521c-4914-8c5b-4d78a9af87f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:17:31.811498 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6dc256-521c-4914-8c5b-4d78a9af87f0 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:17:31.817528 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 599/1200] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Mar 30 01:17:31 2022] GET /identity/v3/role_assignments?user.id=f6750ada7f2547db99b9452c519d7553&scope.project.id=a83b789b345c460d96ecef7857f29094&role.id=36909bbf31d04993bb2a9fe587b572dc => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:18:33.051797 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e4e479-bad6-4907-900f-b266fa18d2b9 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:18:33.052484 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e4e479-bad6-4907-900f-b266fa18d2b9 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:18:33.052484 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e4e479-bad6-4907-900f-b266fa18d2b9 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:18:33.054208 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 602/1201] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:18:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:18:33.059431 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bca7d4-beb4-4d33-908b-b4ed2b6e3297 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:18:33.060232 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bca7d4-beb4-4d33-908b-b4ed2b6e3297 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:18:33.060664 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bca7d4-beb4-4d33-908b-b4ed2b6e3297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:18:33.082085 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-95bca7d4-beb4-4d33-908b-b4ed2b6e3297 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:18:33.083312 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-95bca7d4-beb4-4d33-908b-b4ed2b6e3297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:18:33.167564 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 600/1202] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:18:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 30 01:18:33.193584 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e4e479-bad6-4907-900f-b266fa18d2b9 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:18:33.307009 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e4e479-bad6-4907-900f-b266fa18d2b9 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:18:33.346028 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db170afe-7bf0-4467-9f23-2d1059752319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:18:33.347311 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db170afe-7bf0-4467-9f23-2d1059752319 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:18:33.347626 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db170afe-7bf0-4467-9f23-2d1059752319 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:18:33.347902 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db170afe-7bf0-4467-9f23-2d1059752319 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:18:33.365291 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db170afe-7bf0-4467-9f23-2d1059752319 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:18:33.367067 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db170afe-7bf0-4467-9f23-2d1059752319 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:18:33.385342 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-db170afe-7bf0-4467-9f23-2d1059752319 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:18:33.392295 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 603/1203] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:18:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:18:33.393522 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bca7d4-beb4-4d33-908b-b4ed2b6e3297 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:18:33.509888 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bca7d4-beb4-4d33-908b-b4ed2b6e3297 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:18:33.561566 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104280df-63c6-468e-ae04-76575d883af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:18:33.562276 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104280df-63c6-468e-ae04-76575d883af2 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:18:33.562645 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104280df-63c6-468e-ae04-76575d883af2 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:18:33.562950 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104280df-63c6-468e-ae04-76575d883af2 None admin] PATH_INFO: `/v3/domains` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:18:33.563689 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104280df-63c6-468e-ae04-76575d883af2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:18:33.563997 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104280df-63c6-468e-ae04-76575d883af2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:18:33.565378 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104280df-63c6-468e-ae04-76575d883af2 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:18:33.580304 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 601/1204] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:18:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:18:33.587419 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db170afe-7bf0-4467-9f23-2d1059752319 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:18:33.718344 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db170afe-7bf0-4467-9f23-2d1059752319 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:18:33.766832 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f057a7b3-1f18-4c1e-8eb4-20ec02a7454b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:18:33.767547 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f057a7b3-1f18-4c1e-8eb4-20ec02a7454b None admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:18:33.767911 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f057a7b3-1f18-4c1e-8eb4-20ec02a7454b None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:18:33.768193 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f057a7b3-1f18-4c1e-8eb4-20ec02a7454b None admin] PATH_INFO: `/v3/users` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:18:33.768968 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f057a7b3-1f18-4c1e-8eb4-20ec02a7454b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:18:33.772635 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f057a7b3-1f18-4c1e-8eb4-20ec02a7454b None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:18:33.797198 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 604/1205] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Mar 30 01:18:33 2022] POST /identity/v3/users => generated 251 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:18:36.347212 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9abcf-f2e9-4dd3-bc09-ba433602433c None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:18:36.347789 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9abcf-f2e9-4dd3-bc09-ba433602433c None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:18:36.347789 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9abcf-f2e9-4dd3-bc09-ba433602433c None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:18:36.350020 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 602/1206] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:18:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:18:36.357197 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708a90a-7db6-445b-98b5-347bf23e5c1e None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:18:36.357197 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708a90a-7db6-445b-98b5-347bf23e5c1e None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:18:36.357197 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708a90a-7db6-445b-98b5-347bf23e5c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:18:36.374210 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-5708a90a-7db6-445b-98b5-347bf23e5c1e None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:18:36.375687 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-5708a90a-7db6-445b-98b5-347bf23e5c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:18:36.448871 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 605/1207] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:18:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 01:18:36.473647 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e9abcf-f2e9-4dd3-bc09-ba433602433c None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:18:36.594478 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e9abcf-f2e9-4dd3-bc09-ba433602433c None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:18:36.632184 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c92f87-6673-46b3-a035-475b830fb930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:18:36.633067 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c92f87-6673-46b3-a035-475b830fb930 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:18:36.633367 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c92f87-6673-46b3-a035-475b830fb930 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:18:36.633648 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c92f87-6673-46b3-a035-475b830fb930 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:18:36.646030 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c92f87-6673-46b3-a035-475b830fb930 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:18:36.654215 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-42c92f87-6673-46b3-a035-475b830fb930 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 30 01:18:36.656813 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 603/1208] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Mar 30 01:18:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:18:36.662941 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5708a90a-7db6-445b-98b5-347bf23e5c1e None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:18:36.772853 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5708a90a-7db6-445b-98b5-347bf23e5c1e None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:18:36.809889 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82335c52-c9f2-4707-9813-f8a5b468c18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:18:36.810555 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82335c52-c9f2-4707-9813-f8a5b468c18a None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:18:36.810874 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82335c52-c9f2-4707-9813-f8a5b468c18a None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:18:36.811173 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82335c52-c9f2-4707-9813-f8a5b468c18a None admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:18:36.812043 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82335c52-c9f2-4707-9813-f8a5b468c18a None admin] RBAC: Adding query filter params (name=service) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:18:36.812325 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82335c52-c9f2-4707-9813-f8a5b468c18a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:18:36.813699 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82335c52-c9f2-4707-9813-f8a5b468c18a None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:18:36.827241 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 606/1209] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Mar 30 01:18:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:18:36.829142 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c92f87-6673-46b3-a035-475b830fb930 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:18:36.943893 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c92f87-6673-46b3-a035-475b830fb930 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:18:36.979084 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5803780-7f8c-46b9-9bb4-aff8ae9d3dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:18:36.979893 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5803780-7f8c-46b9-9bb4-aff8ae9d3dd8 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:18:36.980154 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5803780-7f8c-46b9-9bb4-aff8ae9d3dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:18:36.980423 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5803780-7f8c-46b9-9bb4-aff8ae9d3dd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:18:36.992030 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5803780-7f8c-46b9-9bb4-aff8ae9d3dd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:18:36.993528 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5803780-7f8c-46b9-9bb4-aff8ae9d3dd8 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:18:37.011290 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-c5803780-7f8c-46b9-9bb4-aff8ae9d3dd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:18:37.012721 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 604/1210] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:18:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:18:37.018951 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82335c52-c9f2-4707-9813-f8a5b468c18a None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:18:37.128905 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82335c52-c9f2-4707-9813-f8a5b468c18a None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:18:37.166430 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca2e9cb-1cf3-43e3-99dd-85fc81a5af54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:18:37.167209 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca2e9cb-1cf3-43e3-99dd-85fc81a5af54 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:18:37.167422 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca2e9cb-1cf3-43e3-99dd-85fc81a5af54 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:18:37.167696 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca2e9cb-1cf3-43e3-99dd-85fc81a5af54 None admin] PATH_INFO: `/v3/domains` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:18:37.168407 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca2e9cb-1cf3-43e3-99dd-85fc81a5af54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:18:37.168719 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca2e9cb-1cf3-43e3-99dd-85fc81a5af54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:18:37.170147 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca2e9cb-1cf3-43e3-99dd-85fc81a5af54 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:18:37.183280 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 607/1211] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:18:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:18:37.189049 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5803780-7f8c-46b9-9bb4-aff8ae9d3dd8 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:18:37.294031 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5803780-7f8c-46b9-9bb4-aff8ae9d3dd8 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:18:37.329869 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d004ed9-24fe-4e01-bd13-a3a8632cc5a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:18:37.331107 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d004ed9-24fe-4e01-bd13-a3a8632cc5a3 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:18:37.331628 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d004ed9-24fe-4e01-bd13-a3a8632cc5a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:18:37.332066 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d004ed9-24fe-4e01-bd13-a3a8632cc5a3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:18:37.340257 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d004ed9-24fe-4e01-bd13-a3a8632cc5a3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:18:37.341925 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d004ed9-24fe-4e01-bd13-a3a8632cc5a3 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:18:37.355903 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-5d004ed9-24fe-4e01-bd13-a3a8632cc5a3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 30 01:18:37.357178 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 605/1212] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:18:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:18:37.363384 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca2e9cb-1cf3-43e3-99dd-85fc81a5af54 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:18:37.463972 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca2e9cb-1cf3-43e3-99dd-85fc81a5af54 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:18:37.500037 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4587d1a0-c3fb-4055-a829-48a7bd336924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:18:37.500789 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4587d1a0-c3fb-4055-a829-48a7bd336924 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:18:37.501061 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4587d1a0-c3fb-4055-a829-48a7bd336924 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:18:37.501305 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4587d1a0-c3fb-4055-a829-48a7bd336924 None admin] PATH_INFO: `/v3/users` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:18:37.502190 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4587d1a0-c3fb-4055-a829-48a7bd336924 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:18:37.502490 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4587d1a0-c3fb-4055-a829-48a7bd336924 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:18:37.503919 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4587d1a0-c3fb-4055-a829-48a7bd336924 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:18:37.527160 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 608/1213] 10.222.0.30 () {56 vars in 1143 bytes} [Wed Mar 30 01:18:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:18:37.529159 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d004ed9-24fe-4e01-bd13-a3a8632cc5a3 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:18:37.640199 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d004ed9-24fe-4e01-bd13-a3a8632cc5a3 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:18:37.682027 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f5b28-a388-45d3-a9ff-b6968492b9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:18:37.682885 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f5b28-a388-45d3-a9ff-b6968492b9bb None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:18:37.683270 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f5b28-a388-45d3-a9ff-b6968492b9bb None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:18:37.683646 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f5b28-a388-45d3-a9ff-b6968492b9bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:18:37.755045 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4f5b28-a388-45d3-a9ff-b6968492b9bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:18:37.756718 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4f5b28-a388-45d3-a9ff-b6968492b9bb None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:18:37.870398 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 606/1214] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Mar 30 01:18:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 30 01:18:37.876476 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4587d1a0-c3fb-4055-a829-48a7bd336924 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:18:37.991327 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4587d1a0-c3fb-4055-a829-48a7bd336924 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:18:38.031505 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f570f8-f036-41c4-bbfe-e46b81433a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:18:38.032402 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f570f8-f036-41c4-bbfe-e46b81433a4b None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:18:38.032672 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f570f8-f036-41c4-bbfe-e46b81433a4b None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:18:38.032966 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f570f8-f036-41c4-bbfe-e46b81433a4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:18:38.044696 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f570f8-f036-41c4-bbfe-e46b81433a4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:18:38.046977 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f570f8-f036-41c4-bbfe-e46b81433a4b None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:18:38.065426 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-d8f570f8-f036-41c4-bbfe-e46b81433a4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:18:38.071741 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 609/1215] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:18:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:18:38.072990 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f5b28-a388-45d3-a9ff-b6968492b9bb None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:18:38.185761 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f5b28-a388-45d3-a9ff-b6968492b9bb None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:18:38.223148 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325d4a8b-7ced-4d15-addf-39386aa0dfa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:18:38.223902 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d4a8b-7ced-4d15-addf-39386aa0dfa1 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:18:38.224251 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d4a8b-7ced-4d15-addf-39386aa0dfa1 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:18:38.224605 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d4a8b-7ced-4d15-addf-39386aa0dfa1 None admin] PATH_INFO: `/v3/domains` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:18:38.225427 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325d4a8b-7ced-4d15-addf-39386aa0dfa1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:18:38.225777 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325d4a8b-7ced-4d15-addf-39386aa0dfa1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:18:38.227263 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325d4a8b-7ced-4d15-addf-39386aa0dfa1 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:18:38.244245 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 607/1216] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:18:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:18:38.245574 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f570f8-f036-41c4-bbfe-e46b81433a4b None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:18:38.354359 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f570f8-f036-41c4-bbfe-e46b81433a4b None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:18:38.393214 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ff3c0-a643-4d16-8286-023080fb56d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:18:38.394368 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ff3c0-a643-4d16-8286-023080fb56d6 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:18:38.394905 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ff3c0-a643-4d16-8286-023080fb56d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:18:38.395295 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ff3c0-a643-4d16-8286-023080fb56d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:18:38.403332 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3ff3c0-a643-4d16-8286-023080fb56d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:18:38.405326 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3ff3c0-a643-4d16-8286-023080fb56d6 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:18:38.419630 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-6d3ff3c0-a643-4d16-8286-023080fb56d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 30 01:18:38.421273 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 610/1217] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Mar 30 01:18:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 01:18:38.427609 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325d4a8b-7ced-4d15-addf-39386aa0dfa1 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:18:38.551814 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325d4a8b-7ced-4d15-addf-39386aa0dfa1 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:18:38.590193 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79677712-2c4f-41aa-b916-2aca916041e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:18:38.590900 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79677712-2c4f-41aa-b916-2aca916041e4 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:18:38.591201 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79677712-2c4f-41aa-b916-2aca916041e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:18:38.591480 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79677712-2c4f-41aa-b916-2aca916041e4 None admin] PATH_INFO: `/v3/projects` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:18:38.592302 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79677712-2c4f-41aa-b916-2aca916041e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:18:38.593098 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79677712-2c4f-41aa-b916-2aca916041e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:18:38.594624 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79677712-2c4f-41aa-b916-2aca916041e4 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:18:38.607697 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 608/1218] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Mar 30 01:18:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:18:38.614032 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ff3c0-a643-4d16-8286-023080fb56d6 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:18:38.724122 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ff3c0-a643-4d16-8286-023080fb56d6 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:18:38.761846 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd037f2-fd76-4b7e-87d8-ce677868dd1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:18:38.762607 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd037f2-fd76-4b7e-87d8-ce677868dd1e None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:18:38.762923 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd037f2-fd76-4b7e-87d8-ce677868dd1e None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:18:38.763203 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd037f2-fd76-4b7e-87d8-ce677868dd1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:18:38.764057 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd037f2-fd76-4b7e-87d8-ce677868dd1e None admin] RBAC: Adding query filter params (role.id=4121aef9b31c4671aebb65fda1c11185, scope.project.id=0c9a4444228d4be89a4ba8aa53099531, user.id=7343cd5457264dabb4c2b3a62df59431) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:18:38.764934 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd037f2-fd76-4b7e-87d8-ce677868dd1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:18:38.766741 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd037f2-fd76-4b7e-87d8-ce677868dd1e None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:18:38.772777 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 611/1219] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Mar 30 01:18:38 2022] GET /identity/v3/role_assignments?user.id=7343cd5457264dabb4c2b3a62df59431&scope.project.id=0c9a4444228d4be89a4ba8aa53099531&role.id=4121aef9b31c4671aebb65fda1c11185 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:18:41.257034 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51200d62-2238-4668-afa6-54b822452ba7 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:18:41.257658 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51200d62-2238-4668-afa6-54b822452ba7 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:18:41.257658 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51200d62-2238-4668-afa6-54b822452ba7 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:18:41.260009 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 609/1220] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:18:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:18:41.268389 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f07f628-4828-4513-9b7c-046e67590571 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:18:41.268389 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f07f628-4828-4513-9b7c-046e67590571 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:18:41.268389 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f07f628-4828-4513-9b7c-046e67590571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:18:41.284872 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-8f07f628-4828-4513-9b7c-046e67590571 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:18:41.286080 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-8f07f628-4828-4513-9b7c-046e67590571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:18:41.355772 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 612/1221] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:18:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 01:18:41.379000 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51200d62-2238-4668-afa6-54b822452ba7 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:18:41.500732 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51200d62-2238-4668-afa6-54b822452ba7 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:18:41.542114 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24684b72-7e76-438b-97a7-c65818d9e4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:18:41.542945 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24684b72-7e76-438b-97a7-c65818d9e4bc None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:18:41.543236 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24684b72-7e76-438b-97a7-c65818d9e4bc None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:18:41.543501 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24684b72-7e76-438b-97a7-c65818d9e4bc None admin] PATH_INFO: `/v3/roles/service` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:18:41.554112 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24684b72-7e76-438b-97a7-c65818d9e4bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:18:41.561913 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-24684b72-7e76-438b-97a7-c65818d9e4bc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 30 01:18:41.564124 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 610/1222] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Mar 30 01:18:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:18:41.569226 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f07f628-4828-4513-9b7c-046e67590571 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:18:41.676212 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f07f628-4828-4513-9b7c-046e67590571 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:18:41.713792 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8036fea3-6e59-431f-ae11-fcdbf433866f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:18:41.714458 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8036fea3-6e59-431f-ae11-fcdbf433866f None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:18:41.714766 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8036fea3-6e59-431f-ae11-fcdbf433866f None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:18:41.715042 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8036fea3-6e59-431f-ae11-fcdbf433866f None admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:18:41.715809 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8036fea3-6e59-431f-ae11-fcdbf433866f None admin] RBAC: Adding query filter params (name=service) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:18:41.716075 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8036fea3-6e59-431f-ae11-fcdbf433866f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:18:41.718000 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8036fea3-6e59-431f-ae11-fcdbf433866f None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:18:41.725568 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 613/1223] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Mar 30 01:18:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:18:41.731674 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24684b72-7e76-438b-97a7-c65818d9e4bc None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:18:41.845635 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24684b72-7e76-438b-97a7-c65818d9e4bc None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:18:41.884943 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f156cbbc-9f4c-41c6-9ee7-7f67e547e420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:18:41.885972 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f156cbbc-9f4c-41c6-9ee7-7f67e547e420 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:18:41.886239 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f156cbbc-9f4c-41c6-9ee7-7f67e547e420 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:18:41.886630 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f156cbbc-9f4c-41c6-9ee7-7f67e547e420 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:18:41.898013 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f156cbbc-9f4c-41c6-9ee7-7f67e547e420 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:18:41.899482 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f156cbbc-9f4c-41c6-9ee7-7f67e547e420 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:18:41.919839 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-f156cbbc-9f4c-41c6-9ee7-7f67e547e420 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:18:41.922666 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 611/1224] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:18:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 01:18:41.928288 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8036fea3-6e59-431f-ae11-fcdbf433866f None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:18:42.036096 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8036fea3-6e59-431f-ae11-fcdbf433866f None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:18:42.073878 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60ffb43-b497-4820-8dae-c65d193232f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:18:42.074616 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ffb43-b497-4820-8dae-c65d193232f5 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:18:42.074958 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ffb43-b497-4820-8dae-c65d193232f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:18:42.075244 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ffb43-b497-4820-8dae-c65d193232f5 None admin] PATH_INFO: `/v3/domains` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:18:42.076039 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60ffb43-b497-4820-8dae-c65d193232f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:18:42.076329 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60ffb43-b497-4820-8dae-c65d193232f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:18:42.077919 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60ffb43-b497-4820-8dae-c65d193232f5 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:18:42.089524 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 614/1225] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:18:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:18:42.096123 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f156cbbc-9f4c-41c6-9ee7-7f67e547e420 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:18:42.201254 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f156cbbc-9f4c-41c6-9ee7-7f67e547e420 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:18:42.239165 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ee6ee-986c-40f0-9ff5-3115e6d20885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:18:42.240045 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ee6ee-986c-40f0-9ff5-3115e6d20885 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:18:42.240395 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ee6ee-986c-40f0-9ff5-3115e6d20885 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:18:42.240749 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ee6ee-986c-40f0-9ff5-3115e6d20885 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:18:42.249664 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795ee6ee-986c-40f0-9ff5-3115e6d20885 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:18:42.251197 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795ee6ee-986c-40f0-9ff5-3115e6d20885 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:18:42.266409 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-795ee6ee-986c-40f0-9ff5-3115e6d20885 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 30 01:18:42.267662 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 612/1226] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:18:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:18:42.274829 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60ffb43-b497-4820-8dae-c65d193232f5 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:18:42.383526 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60ffb43-b497-4820-8dae-c65d193232f5 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:18:42.421507 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a466b096-8adc-4c49-9fcb-1ee55f6c48e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:18:42.422233 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466b096-8adc-4c49-9fcb-1ee55f6c48e7 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:18:42.422563 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466b096-8adc-4c49-9fcb-1ee55f6c48e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:18:42.422918 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466b096-8adc-4c49-9fcb-1ee55f6c48e7 None admin] PATH_INFO: `/v3/users` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:18:42.423818 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a466b096-8adc-4c49-9fcb-1ee55f6c48e7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:18:42.424191 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a466b096-8adc-4c49-9fcb-1ee55f6c48e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:18:42.425729 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a466b096-8adc-4c49-9fcb-1ee55f6c48e7 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:18:42.444023 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 615/1227] 10.222.0.30 () {56 vars in 1143 bytes} [Wed Mar 30 01:18:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:18:42.449638 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ee6ee-986c-40f0-9ff5-3115e6d20885 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:18:42.561726 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ee6ee-986c-40f0-9ff5-3115e6d20885 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:18:42.599925 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c2a042-9760-4ccb-8a20-cf8234907da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:18:42.600878 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2a042-9760-4ccb-8a20-cf8234907da1 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:18:42.601161 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2a042-9760-4ccb-8a20-cf8234907da1 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:18:42.601437 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2a042-9760-4ccb-8a20-cf8234907da1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:18:42.612549 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c2a042-9760-4ccb-8a20-cf8234907da1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:18:42.614001 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c2a042-9760-4ccb-8a20-cf8234907da1 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:18:42.634782 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-d3c2a042-9760-4ccb-8a20-cf8234907da1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:18:42.636197 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 613/1228] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:18:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:18:42.643838 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a466b096-8adc-4c49-9fcb-1ee55f6c48e7 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:18:42.744051 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a466b096-8adc-4c49-9fcb-1ee55f6c48e7 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:18:42.779892 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5a53e8-b033-4358-8996-28e44e512828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:18:42.780883 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a53e8-b033-4358-8996-28e44e512828 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:18:42.781220 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a53e8-b033-4358-8996-28e44e512828 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:18:42.781461 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a53e8-b033-4358-8996-28e44e512828 None admin] PATH_INFO: `/v3/domains` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:18:42.782251 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5a53e8-b033-4358-8996-28e44e512828 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:18:42.782597 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5a53e8-b033-4358-8996-28e44e512828 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:18:42.784097 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5a53e8-b033-4358-8996-28e44e512828 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:18:42.801434 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 616/1229] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:18:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:18:42.802679 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c2a042-9760-4ccb-8a20-cf8234907da1 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:18:42.909293 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c2a042-9760-4ccb-8a20-cf8234907da1 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:18:42.947475 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4523d85-2de4-4571-90d8-e5ba8d83093d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:18:42.948326 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4523d85-2de4-4571-90d8-e5ba8d83093d None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:18:42.948697 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4523d85-2de4-4571-90d8-e5ba8d83093d None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:18:42.949074 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4523d85-2de4-4571-90d8-e5ba8d83093d None admin] PATH_INFO: `/v3/projects/service` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:18:42.956845 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4523d85-2de4-4571-90d8-e5ba8d83093d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:18:42.958560 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4523d85-2de4-4571-90d8-e5ba8d83093d None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:18:42.973929 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-f4523d85-2de4-4571-90d8-e5ba8d83093d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 30 01:18:42.975173 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 614/1230] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Mar 30 01:18:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:18:42.981442 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5a53e8-b033-4358-8996-28e44e512828 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:18:43.091595 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5a53e8-b033-4358-8996-28e44e512828 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:18:43.128327 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac109c3-7ea5-46f2-85c8-ab07ce455860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:18:43.129096 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac109c3-7ea5-46f2-85c8-ab07ce455860 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:18:43.129381 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac109c3-7ea5-46f2-85c8-ab07ce455860 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:18:43.129687 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac109c3-7ea5-46f2-85c8-ab07ce455860 None admin] PATH_INFO: `/v3/projects` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:18:43.130546 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac109c3-7ea5-46f2-85c8-ab07ce455860 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:18:43.130898 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac109c3-7ea5-46f2-85c8-ab07ce455860 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:18:43.132332 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac109c3-7ea5-46f2-85c8-ab07ce455860 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:18:43.144885 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 617/1231] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Mar 30 01:18:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:18:43.151466 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4523d85-2de4-4571-90d8-e5ba8d83093d None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:18:43.258750 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4523d85-2de4-4571-90d8-e5ba8d83093d None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:18:43.295599 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb478d47-fce4-45f6-b8da-b70a088bfb17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:18:43.297084 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb478d47-fce4-45f6-b8da-b70a088bfb17 None admin] REQUEST_METHOD: `PUT` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:18:43.297084 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb478d47-fce4-45f6-b8da-b70a088bfb17 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:18:43.297084 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb478d47-fce4-45f6-b8da-b70a088bfb17 None admin] PATH_INFO: `/v3/projects/0c9a4444228d4be89a4ba8aa53099531/users/7343cd5457264dabb4c2b3a62df59431/roles/4121aef9b31c4671aebb65fda1c11185` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:18:43.312003 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb478d47-fce4-45f6-b8da-b70a088bfb17 None admin] RBAC: Authorizing `identity:create_grant(project_id=0c9a4444228d4be89a4ba8aa53099531, user_id=7343cd5457264dabb4c2b3a62df59431, role_id=4121aef9b31c4671aebb65fda1c11185)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:18:43.313432 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb478d47-fce4-45f6-b8da-b70a088bfb17 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:18:43.331944 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 615/1232] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Mar 30 01:18:43 2022] PUT /identity/v3/projects/0c9a4444228d4be89a4ba8aa53099531/users/7343cd5457264dabb4c2b3a62df59431/roles/4121aef9b31c4671aebb65fda1c11185 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:18:45.742770 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6196645-6c3a-4f9a-8d43-30a54ac34686 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:18:45.743360 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6196645-6c3a-4f9a-8d43-30a54ac34686 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:18:45.743456 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6196645-6c3a-4f9a-8d43-30a54ac34686 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:18:45.745316 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 618/1233] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:18:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 01:18:45.751291 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c300b0-af8d-495c-9792-42f4c98ae9ec None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:18:45.751784 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c300b0-af8d-495c-9792-42f4c98ae9ec None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:18:45.751955 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c300b0-af8d-495c-9792-42f4c98ae9ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:18:45.770657 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-b7c300b0-af8d-495c-9792-42f4c98ae9ec None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:18:45.772086 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-b7c300b0-af8d-495c-9792-42f4c98ae9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:18:45.847634 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 616/1234] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:18:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 01:18:45.873572 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6196645-6c3a-4f9a-8d43-30a54ac34686 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:18:45.977414 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6196645-6c3a-4f9a-8d43-30a54ac34686 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:18:46.017535 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7771a723-9032-4878-9686-5eb4a93eec49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:18:46.018325 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771a723-9032-4878-9686-5eb4a93eec49 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:18:46.018657 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771a723-9032-4878-9686-5eb4a93eec49 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:18:46.018968 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771a723-9032-4878-9686-5eb4a93eec49 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:18:46.029625 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7771a723-9032-4878-9686-5eb4a93eec49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:18:46.036937 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-7771a723-9032-4878-9686-5eb4a93eec49 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 30 01:18:46.038340 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 619/1235] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Mar 30 01:18:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 01:18:46.044660 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c300b0-af8d-495c-9792-42f4c98ae9ec None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:18:46.156002 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c300b0-af8d-495c-9792-42f4c98ae9ec None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:18:46.191655 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f2876b-5615-4e92-bad7-35c71cb07367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:18:46.192350 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f2876b-5615-4e92-bad7-35c71cb07367 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:18:46.192669 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f2876b-5615-4e92-bad7-35c71cb07367 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:18:46.192908 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f2876b-5615-4e92-bad7-35c71cb07367 None admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:18:46.193667 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f2876b-5615-4e92-bad7-35c71cb07367 None admin] RBAC: Adding query filter params (name=service) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:18:46.194000 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f2876b-5615-4e92-bad7-35c71cb07367 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:18:46.195387 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f2876b-5615-4e92-bad7-35c71cb07367 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:18:46.204422 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 617/1236] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Mar 30 01:18:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:18:46.210240 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7771a723-9032-4878-9686-5eb4a93eec49 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:18:46.317638 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7771a723-9032-4878-9686-5eb4a93eec49 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:18:46.355764 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a49ee3c-089f-4ef2-a928-9980d2a992c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:18:46.356610 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a49ee3c-089f-4ef2-a928-9980d2a992c4 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:18:46.357011 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a49ee3c-089f-4ef2-a928-9980d2a992c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:18:46.357244 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a49ee3c-089f-4ef2-a928-9980d2a992c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:18:46.368294 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a49ee3c-089f-4ef2-a928-9980d2a992c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:18:46.369741 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a49ee3c-089f-4ef2-a928-9980d2a992c4 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:18:46.387259 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-6a49ee3c-089f-4ef2-a928-9980d2a992c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:18:46.388885 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 620/1237] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:18:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:18:46.395324 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f2876b-5615-4e92-bad7-35c71cb07367 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:18:46.497165 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f2876b-5615-4e92-bad7-35c71cb07367 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:18:46.536173 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4617f05f-ad3e-4428-b25e-423c040c4a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:18:46.536835 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4617f05f-ad3e-4428-b25e-423c040c4a67 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:18:46.537145 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4617f05f-ad3e-4428-b25e-423c040c4a67 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:18:46.537501 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4617f05f-ad3e-4428-b25e-423c040c4a67 None admin] PATH_INFO: `/v3/domains` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:18:46.538207 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4617f05f-ad3e-4428-b25e-423c040c4a67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:18:46.538424 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4617f05f-ad3e-4428-b25e-423c040c4a67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:18:46.539813 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4617f05f-ad3e-4428-b25e-423c040c4a67 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:18:46.552748 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 618/1238] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:18:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:18:46.558921 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a49ee3c-089f-4ef2-a928-9980d2a992c4 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:18:46.663648 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a49ee3c-089f-4ef2-a928-9980d2a992c4 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:18:46.699287 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae803c43-d72e-48ea-8f4f-23cf7d09e0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:18:46.700033 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae803c43-d72e-48ea-8f4f-23cf7d09e0c7 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:18:46.700306 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae803c43-d72e-48ea-8f4f-23cf7d09e0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:18:46.700577 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae803c43-d72e-48ea-8f4f-23cf7d09e0c7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:18:46.709304 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae803c43-d72e-48ea-8f4f-23cf7d09e0c7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:18:46.710770 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae803c43-d72e-48ea-8f4f-23cf7d09e0c7 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:18:46.724334 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-ae803c43-d72e-48ea-8f4f-23cf7d09e0c7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 30 01:18:46.725513 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 621/1239] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:18:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:18:46.732016 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4617f05f-ad3e-4428-b25e-423c040c4a67 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:18:46.841169 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4617f05f-ad3e-4428-b25e-423c040c4a67 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:18:46.879133 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1071b97c-fb22-417d-a193-1cd5912930a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:18:46.879808 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1071b97c-fb22-417d-a193-1cd5912930a8 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:18:46.880131 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1071b97c-fb22-417d-a193-1cd5912930a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:18:46.880499 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1071b97c-fb22-417d-a193-1cd5912930a8 None admin] PATH_INFO: `/v3/users` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:18:46.881541 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1071b97c-fb22-417d-a193-1cd5912930a8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:18:46.881921 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1071b97c-fb22-417d-a193-1cd5912930a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:18:46.883763 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1071b97c-fb22-417d-a193-1cd5912930a8 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:18:46.909856 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 619/1240] 10.222.0.30 () {56 vars in 1143 bytes} [Wed Mar 30 01:18:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:18:46.911022 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae803c43-d72e-48ea-8f4f-23cf7d09e0c7 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:18:47.023591 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae803c43-d72e-48ea-8f4f-23cf7d09e0c7 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:18:47.059376 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af93782e-d63f-46c1-8710-e73c43e8918c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:18:47.060089 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93782e-d63f-46c1-8710-e73c43e8918c None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:18:47.060501 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93782e-d63f-46c1-8710-e73c43e8918c None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:18:47.060832 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93782e-d63f-46c1-8710-e73c43e8918c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:18:47.130271 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af93782e-d63f-46c1-8710-e73c43e8918c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:18:47.131694 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af93782e-d63f-46c1-8710-e73c43e8918c None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:18:47.232379 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 622/1241] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Mar 30 01:18:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Mar 30 01:18:47.238940 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1071b97c-fb22-417d-a193-1cd5912930a8 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:18:47.346034 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1071b97c-fb22-417d-a193-1cd5912930a8 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:18:47.381482 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb422a0a-33d0-4040-a94d-a0c926624412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:18:47.382223 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb422a0a-33d0-4040-a94d-a0c926624412 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:18:47.382478 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb422a0a-33d0-4040-a94d-a0c926624412 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:18:47.382774 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb422a0a-33d0-4040-a94d-a0c926624412 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:18:47.393712 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb422a0a-33d0-4040-a94d-a0c926624412 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:18:47.395337 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb422a0a-33d0-4040-a94d-a0c926624412 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:18:47.413453 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-fb422a0a-33d0-4040-a94d-a0c926624412 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:18:47.417570 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 620/1242] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:18:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 01:18:47.423698 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af93782e-d63f-46c1-8710-e73c43e8918c None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:18:47.535448 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af93782e-d63f-46c1-8710-e73c43e8918c None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:18:47.573818 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b94b583-cb7c-40d4-97b6-b21757839c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:18:47.574500 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b94b583-cb7c-40d4-97b6-b21757839c9d None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:18:47.574817 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b94b583-cb7c-40d4-97b6-b21757839c9d None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:18:47.575093 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b94b583-cb7c-40d4-97b6-b21757839c9d None admin] PATH_INFO: `/v3/domains` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:18:47.575814 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b94b583-cb7c-40d4-97b6-b21757839c9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:18:47.576119 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b94b583-cb7c-40d4-97b6-b21757839c9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:18:47.578434 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b94b583-cb7c-40d4-97b6-b21757839c9d None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:18:47.590542 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 623/1243] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:18:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:18:47.597704 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb422a0a-33d0-4040-a94d-a0c926624412 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:18:47.703650 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb422a0a-33d0-4040-a94d-a0c926624412 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:18:47.743614 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a20e0a9-a5f8-4bdf-b341-b51a130d8c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:18:47.744409 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20e0a9-a5f8-4bdf-b341-b51a130d8c85 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:18:47.744693 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20e0a9-a5f8-4bdf-b341-b51a130d8c85 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:18:47.744971 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20e0a9-a5f8-4bdf-b341-b51a130d8c85 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:18:47.751917 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a20e0a9-a5f8-4bdf-b341-b51a130d8c85 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:18:47.753360 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a20e0a9-a5f8-4bdf-b341-b51a130d8c85 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:18:47.768648 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-1a20e0a9-a5f8-4bdf-b341-b51a130d8c85 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 30 01:18:47.769846 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 621/1244] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Mar 30 01:18:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:18:47.776016 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b94b583-cb7c-40d4-97b6-b21757839c9d None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:18:47.885465 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b94b583-cb7c-40d4-97b6-b21757839c9d None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:18:47.924264 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9439e3cc-9931-4889-9c5c-42d5d036a77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:18:47.924917 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439e3cc-9931-4889-9c5c-42d5d036a77c None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:18:47.925183 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439e3cc-9931-4889-9c5c-42d5d036a77c None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:18:47.925461 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439e3cc-9931-4889-9c5c-42d5d036a77c None admin] PATH_INFO: `/v3/projects` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:18:47.926231 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9439e3cc-9931-4889-9c5c-42d5d036a77c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:18:47.926539 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9439e3cc-9931-4889-9c5c-42d5d036a77c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:18:47.928008 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9439e3cc-9931-4889-9c5c-42d5d036a77c None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:18:47.941953 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 624/1245] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Mar 30 01:18:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:18:47.948467 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a20e0a9-a5f8-4bdf-b341-b51a130d8c85 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:18:48.058143 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a20e0a9-a5f8-4bdf-b341-b51a130d8c85 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:18:48.093925 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acd2464-33e7-4f06-a44c-16af60ced177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:18:48.094588 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd2464-33e7-4f06-a44c-16af60ced177 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:18:48.094904 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd2464-33e7-4f06-a44c-16af60ced177 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:18:48.095184 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd2464-33e7-4f06-a44c-16af60ced177 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:18:48.096032 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acd2464-33e7-4f06-a44c-16af60ced177 None admin] RBAC: Adding query filter params (role.id=4121aef9b31c4671aebb65fda1c11185, scope.project.id=0c9a4444228d4be89a4ba8aa53099531, user.id=7343cd5457264dabb4c2b3a62df59431) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:18:48.096319 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acd2464-33e7-4f06-a44c-16af60ced177 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:18:48.097742 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acd2464-33e7-4f06-a44c-16af60ced177 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:18:48.103881 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 622/1246] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Mar 30 01:18:47 2022] GET /identity/v3/role_assignments?user.id=7343cd5457264dabb4c2b3a62df59431&scope.project.id=0c9a4444228d4be89a4ba8aa53099531&role.id=4121aef9b31c4671aebb65fda1c11185 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:18:50.682228 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f93768-eea7-475b-87f2-af54d59085d2 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:18:50.682794 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f93768-eea7-475b-87f2-af54d59085d2 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:18:50.682902 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f93768-eea7-475b-87f2-af54d59085d2 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:18:50.684824 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 625/1247] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:18:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:18:50.691944 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a8f76-3344-4b89-8742-3d2e9541e359 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:18:50.692372 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a8f76-3344-4b89-8742-3d2e9541e359 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:18:50.692591 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a8f76-3344-4b89-8742-3d2e9541e359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:18:50.712611 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-b31a8f76-3344-4b89-8742-3d2e9541e359 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:18:50.713944 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-b31a8f76-3344-4b89-8742-3d2e9541e359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:18:50.785629 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 623/1248] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:18:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 01:18:50.811994 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f93768-eea7-475b-87f2-af54d59085d2 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:18:50.921491 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f93768-eea7-475b-87f2-af54d59085d2 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:18:50.960752 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b8aabf-ad5a-4131-bad0-333b00ab663c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:18:50.961627 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8aabf-ad5a-4131-bad0-333b00ab663c None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:18:50.961976 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8aabf-ad5a-4131-bad0-333b00ab663c None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:18:50.962260 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8aabf-ad5a-4131-bad0-333b00ab663c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:18:50.973625 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b8aabf-ad5a-4131-bad0-333b00ab663c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:18:50.980856 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-50b8aabf-ad5a-4131-bad0-333b00ab663c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 30 01:18:50.982123 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 626/1249] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Mar 30 01:18:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 01:18:50.989293 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31a8f76-3344-4b89-8742-3d2e9541e359 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:18:51.095815 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31a8f76-3344-4b89-8742-3d2e9541e359 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:18:51.134333 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53edc4b9-1d42-4730-8835-4c7d990c351f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:18:51.135036 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53edc4b9-1d42-4730-8835-4c7d990c351f None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:18:51.135321 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53edc4b9-1d42-4730-8835-4c7d990c351f None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:18:51.135601 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53edc4b9-1d42-4730-8835-4c7d990c351f None admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:18:51.136390 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53edc4b9-1d42-4730-8835-4c7d990c351f None admin] RBAC: Adding query filter params (name=admin) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:18:51.136658 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53edc4b9-1d42-4730-8835-4c7d990c351f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:18:51.138185 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53edc4b9-1d42-4730-8835-4c7d990c351f None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:18:51.147946 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 624/1250] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Mar 30 01:18:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:18:51.154929 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b8aabf-ad5a-4131-bad0-333b00ab663c None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:18:51.264407 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b8aabf-ad5a-4131-bad0-333b00ab663c None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:18:51.299132 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f3cb6-a8b2-47c1-9630-71ef3a16dc59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:18:51.299989 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f3cb6-a8b2-47c1-9630-71ef3a16dc59 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:18:51.300276 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f3cb6-a8b2-47c1-9630-71ef3a16dc59 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:18:51.300548 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f3cb6-a8b2-47c1-9630-71ef3a16dc59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:18:51.312381 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780f3cb6-a8b2-47c1-9630-71ef3a16dc59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:18:51.314048 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780f3cb6-a8b2-47c1-9630-71ef3a16dc59 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:18:51.331355 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-780f3cb6-a8b2-47c1-9630-71ef3a16dc59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:18:51.332610 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 627/1251] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:18:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 01:18:51.338609 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53edc4b9-1d42-4730-8835-4c7d990c351f None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:18:51.441794 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53edc4b9-1d42-4730-8835-4c7d990c351f None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:18:51.474684 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec7d79c-7e2d-4832-9701-a9d3df9e1281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:18:51.475399 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec7d79c-7e2d-4832-9701-a9d3df9e1281 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:18:51.475685 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec7d79c-7e2d-4832-9701-a9d3df9e1281 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:18:51.475958 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec7d79c-7e2d-4832-9701-a9d3df9e1281 None admin] PATH_INFO: `/v3/domains` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:18:51.476694 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec7d79c-7e2d-4832-9701-a9d3df9e1281 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:18:51.477001 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec7d79c-7e2d-4832-9701-a9d3df9e1281 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:18:51.478392 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec7d79c-7e2d-4832-9701-a9d3df9e1281 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:18:51.491638 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 625/1252] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:18:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:18:51.497323 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f3cb6-a8b2-47c1-9630-71ef3a16dc59 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:18:51.608567 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f3cb6-a8b2-47c1-9630-71ef3a16dc59 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:18:51.642059 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a1b4f4-26d8-4055-9a2e-584eac7f0dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:18:51.642890 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a1b4f4-26d8-4055-9a2e-584eac7f0dfc None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:18:51.643170 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a1b4f4-26d8-4055-9a2e-584eac7f0dfc None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:18:51.643443 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a1b4f4-26d8-4055-9a2e-584eac7f0dfc None admin] PATH_INFO: `/v3/users/placement` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:18:51.650968 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a1b4f4-26d8-4055-9a2e-584eac7f0dfc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:18:51.652411 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a1b4f4-26d8-4055-9a2e-584eac7f0dfc None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:18:51.668287 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-41a1b4f4-26d8-4055-9a2e-584eac7f0dfc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 30 01:18:51.669623 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 628/1253] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:18:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 01:18:51.675951 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec7d79c-7e2d-4832-9701-a9d3df9e1281 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:18:51.773173 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec7d79c-7e2d-4832-9701-a9d3df9e1281 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:18:51.811881 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a57cd1-2e1e-43c6-bfa6-a35d94e3d0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:18:51.812547 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a57cd1-2e1e-43c6-bfa6-a35d94e3d0c9 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:18:51.812823 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a57cd1-2e1e-43c6-bfa6-a35d94e3d0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:18:51.813093 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a57cd1-2e1e-43c6-bfa6-a35d94e3d0c9 None admin] PATH_INFO: `/v3/users` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:18:51.813919 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a57cd1-2e1e-43c6-bfa6-a35d94e3d0c9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:18:51.814220 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a57cd1-2e1e-43c6-bfa6-a35d94e3d0c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:18:51.815658 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a57cd1-2e1e-43c6-bfa6-a35d94e3d0c9 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:18:51.831994 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 626/1254] 10.222.0.30 () {56 vars in 1143 bytes} [Wed Mar 30 01:18:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:18:51.837666 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a1b4f4-26d8-4055-9a2e-584eac7f0dfc None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:18:51.933543 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a1b4f4-26d8-4055-9a2e-584eac7f0dfc None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:18:51.964414 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03555113-add1-4711-8c2f-e986f27ad43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:18:51.965044 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03555113-add1-4711-8c2f-e986f27ad43a None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:18:51.965328 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03555113-add1-4711-8c2f-e986f27ad43a None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:18:51.965604 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03555113-add1-4711-8c2f-e986f27ad43a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:18:52.028569 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03555113-add1-4711-8c2f-e986f27ad43a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:18:52.030542 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03555113-add1-4711-8c2f-e986f27ad43a None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:18:52.120830 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 629/1255] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Mar 30 01:18:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 30 01:18:52.127349 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a57cd1-2e1e-43c6-bfa6-a35d94e3d0c9 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:18:52.221410 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a57cd1-2e1e-43c6-bfa6-a35d94e3d0c9 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:18:52.253950 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d90d7d-5fd5-4456-b042-bb6b4b7af56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:18:52.254748 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d90d7d-5fd5-4456-b042-bb6b4b7af56b None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:18:52.255034 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d90d7d-5fd5-4456-b042-bb6b4b7af56b None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:18:52.255309 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d90d7d-5fd5-4456-b042-bb6b4b7af56b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:18:52.264993 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d90d7d-5fd5-4456-b042-bb6b4b7af56b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:18:52.266419 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d90d7d-5fd5-4456-b042-bb6b4b7af56b None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:18:52.283106 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-d5d90d7d-5fd5-4456-b042-bb6b4b7af56b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:18:52.284245 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 627/1256] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:18:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:18:52.289692 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03555113-add1-4711-8c2f-e986f27ad43a None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:18:52.382838 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03555113-add1-4711-8c2f-e986f27ad43a None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:18:52.414712 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a30cd-9297-4215-a1e6-1309727d46b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:18:52.415376 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a30cd-9297-4215-a1e6-1309727d46b6 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:18:52.415658 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a30cd-9297-4215-a1e6-1309727d46b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:18:52.415933 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a30cd-9297-4215-a1e6-1309727d46b6 None admin] PATH_INFO: `/v3/domains` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:18:52.416638 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658a30cd-9297-4215-a1e6-1309727d46b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:18:52.416939 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658a30cd-9297-4215-a1e6-1309727d46b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:18:52.418291 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658a30cd-9297-4215-a1e6-1309727d46b6 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:18:52.429537 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 630/1257] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:18:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:18:52.434982 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d90d7d-5fd5-4456-b042-bb6b4b7af56b None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:18:52.533946 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d90d7d-5fd5-4456-b042-bb6b4b7af56b None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:18:52.570945 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10819c5-6957-4147-a09a-8327bbcb649e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:18:52.571726 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10819c5-6957-4147-a09a-8327bbcb649e None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:18:52.572008 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10819c5-6957-4147-a09a-8327bbcb649e None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:18:52.572280 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10819c5-6957-4147-a09a-8327bbcb649e None admin] PATH_INFO: `/v3/projects/service` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:18:52.579232 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10819c5-6957-4147-a09a-8327bbcb649e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:18:52.580654 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10819c5-6957-4147-a09a-8327bbcb649e None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:18:52.594122 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-e10819c5-6957-4147-a09a-8327bbcb649e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 30 01:18:52.595315 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 628/1258] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Mar 30 01:18:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:18:52.601342 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a30cd-9297-4215-a1e6-1309727d46b6 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:18:52.693907 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a30cd-9297-4215-a1e6-1309727d46b6 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:18:52.725036 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8346ae2d-3a89-42b6-9c98-7a78129161e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:18:52.725675 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8346ae2d-3a89-42b6-9c98-7a78129161e6 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:18:52.725955 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8346ae2d-3a89-42b6-9c98-7a78129161e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:18:52.726227 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8346ae2d-3a89-42b6-9c98-7a78129161e6 None admin] PATH_INFO: `/v3/projects` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:18:52.727021 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8346ae2d-3a89-42b6-9c98-7a78129161e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:18:52.727326 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8346ae2d-3a89-42b6-9c98-7a78129161e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:18:52.728733 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8346ae2d-3a89-42b6-9c98-7a78129161e6 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:18:52.741169 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 631/1259] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Mar 30 01:18:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:18:52.747218 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10819c5-6957-4147-a09a-8327bbcb649e None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:18:52.842615 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10819c5-6957-4147-a09a-8327bbcb649e None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:18:52.874291 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443a9a3e-60f8-46da-8c15-760dc2ef6d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:18:52.874944 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a9a3e-60f8-46da-8c15-760dc2ef6d7f None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:18:52.875224 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a9a3e-60f8-46da-8c15-760dc2ef6d7f None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:18:52.875494 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a9a3e-60f8-46da-8c15-760dc2ef6d7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:18:52.876306 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443a9a3e-60f8-46da-8c15-760dc2ef6d7f None admin] RBAC: Adding query filter params (role.id=36909bbf31d04993bb2a9fe587b572dc, scope.project.id=0c9a4444228d4be89a4ba8aa53099531, user.id=7343cd5457264dabb4c2b3a62df59431) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:18:52.876611 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443a9a3e-60f8-46da-8c15-760dc2ef6d7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:18:52.878009 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443a9a3e-60f8-46da-8c15-760dc2ef6d7f None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:18:52.883100 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 629/1260] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Mar 30 01:18:52 2022] GET /identity/v3/role_assignments?user.id=7343cd5457264dabb4c2b3a62df59431&scope.project.id=0c9a4444228d4be89a4ba8aa53099531&role.id=36909bbf31d04993bb2a9fe587b572dc => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:18:55.173200 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96870de2-78ce-43e1-bd18-6410a1cec016 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:18:55.173761 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96870de2-78ce-43e1-bd18-6410a1cec016 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:18:55.173761 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96870de2-78ce-43e1-bd18-6410a1cec016 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:18:55.175537 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 632/1261] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:18:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:18:55.180830 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a203a344-893e-4d39-9659-ad0eeabe632d None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:18:55.181240 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a203a344-893e-4d39-9659-ad0eeabe632d None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:18:55.181376 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a203a344-893e-4d39-9659-ad0eeabe632d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:18:55.197590 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-a203a344-893e-4d39-9659-ad0eeabe632d None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:18:55.198779 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-a203a344-893e-4d39-9659-ad0eeabe632d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:18:55.260855 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 630/1262] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:18:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 01:18:55.284506 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96870de2-78ce-43e1-bd18-6410a1cec016 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:18:55.378041 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96870de2-78ce-43e1-bd18-6410a1cec016 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:18:55.410054 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06902fc0-1229-48e6-b22d-fa4a63c550d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:18:55.410846 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06902fc0-1229-48e6-b22d-fa4a63c550d8 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:18:55.411125 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06902fc0-1229-48e6-b22d-fa4a63c550d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:18:55.411392 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06902fc0-1229-48e6-b22d-fa4a63c550d8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:18:55.421322 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06902fc0-1229-48e6-b22d-fa4a63c550d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:18:55.428055 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-06902fc0-1229-48e6-b22d-fa4a63c550d8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 30 01:18:55.429129 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 633/1263] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Mar 30 01:18:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 01:18:55.434968 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a203a344-893e-4d39-9659-ad0eeabe632d None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:18:55.530967 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a203a344-893e-4d39-9659-ad0eeabe632d None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:18:55.571697 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9c7982-4ef6-4947-8e9c-b3133c1f794a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:18:55.572415 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9c7982-4ef6-4947-8e9c-b3133c1f794a None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:18:55.572738 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9c7982-4ef6-4947-8e9c-b3133c1f794a None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:18:55.572989 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9c7982-4ef6-4947-8e9c-b3133c1f794a None admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:18:55.573694 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9c7982-4ef6-4947-8e9c-b3133c1f794a None admin] RBAC: Adding query filter params (name=admin) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:18:55.574018 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9c7982-4ef6-4947-8e9c-b3133c1f794a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:18:55.575489 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9c7982-4ef6-4947-8e9c-b3133c1f794a None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:18:55.584221 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 631/1264] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Mar 30 01:18:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:18:55.590129 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06902fc0-1229-48e6-b22d-fa4a63c550d8 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:18:55.686600 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06902fc0-1229-48e6-b22d-fa4a63c550d8 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:18:55.718166 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72538abf-86b4-449f-856d-abf11dda2dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:18:55.718974 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72538abf-86b4-449f-856d-abf11dda2dd6 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:18:55.719262 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72538abf-86b4-449f-856d-abf11dda2dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:18:55.719540 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72538abf-86b4-449f-856d-abf11dda2dd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:18:55.729516 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72538abf-86b4-449f-856d-abf11dda2dd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:18:55.730984 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72538abf-86b4-449f-856d-abf11dda2dd6 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:18:55.746646 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-72538abf-86b4-449f-856d-abf11dda2dd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:18:55.747807 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 634/1265] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:18:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:18:55.754333 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9c7982-4ef6-4947-8e9c-b3133c1f794a None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:18:55.850174 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9c7982-4ef6-4947-8e9c-b3133c1f794a None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:18:55.881821 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f673e413-0746-40e4-9eb9-0ac1c171953a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:18:55.882473 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673e413-0746-40e4-9eb9-0ac1c171953a None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:18:55.882783 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673e413-0746-40e4-9eb9-0ac1c171953a None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:18:55.883066 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673e413-0746-40e4-9eb9-0ac1c171953a None admin] PATH_INFO: `/v3/domains` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:18:55.883778 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f673e413-0746-40e4-9eb9-0ac1c171953a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:18:55.884088 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f673e413-0746-40e4-9eb9-0ac1c171953a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:18:55.885446 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f673e413-0746-40e4-9eb9-0ac1c171953a None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:18:55.896621 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 632/1266] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:18:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:18:55.902197 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72538abf-86b4-449f-856d-abf11dda2dd6 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:18:55.995788 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72538abf-86b4-449f-856d-abf11dda2dd6 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:18:56.027349 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda5e52-b8cd-4f39-971b-a99129171cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:18:56.028385 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda5e52-b8cd-4f39-971b-a99129171cc1 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:18:56.028666 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda5e52-b8cd-4f39-971b-a99129171cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:18:56.028937 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda5e52-b8cd-4f39-971b-a99129171cc1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:18:56.036280 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddda5e52-b8cd-4f39-971b-a99129171cc1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:18:56.037703 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddda5e52-b8cd-4f39-971b-a99129171cc1 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:18:56.051204 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-ddda5e52-b8cd-4f39-971b-a99129171cc1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 30 01:18:56.052314 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 635/1267] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:18:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:18:56.057940 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f673e413-0746-40e4-9eb9-0ac1c171953a None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:18:56.150347 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f673e413-0746-40e4-9eb9-0ac1c171953a None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:18:56.182958 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f48a7bf-5c98-4273-a22a-6bf1d6901bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:18:56.183616 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f48a7bf-5c98-4273-a22a-6bf1d6901bc4 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:18:56.183899 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f48a7bf-5c98-4273-a22a-6bf1d6901bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:18:56.184176 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f48a7bf-5c98-4273-a22a-6bf1d6901bc4 None admin] PATH_INFO: `/v3/users` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:18:56.185004 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f48a7bf-5c98-4273-a22a-6bf1d6901bc4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:18:56.185313 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f48a7bf-5c98-4273-a22a-6bf1d6901bc4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:18:56.186880 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f48a7bf-5c98-4273-a22a-6bf1d6901bc4 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:18:56.203588 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 633/1268] 10.222.0.30 () {56 vars in 1143 bytes} [Wed Mar 30 01:18:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:18:56.209175 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda5e52-b8cd-4f39-971b-a99129171cc1 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:18:56.301556 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda5e52-b8cd-4f39-971b-a99129171cc1 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:18:56.332722 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b5f1f4-47e9-43c0-903b-2ce3c6a3fc37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:18:56.333481 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b5f1f4-47e9-43c0-903b-2ce3c6a3fc37 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:18:56.333759 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b5f1f4-47e9-43c0-903b-2ce3c6a3fc37 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:18:56.334031 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b5f1f4-47e9-43c0-903b-2ce3c6a3fc37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:18:56.344558 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b5f1f4-47e9-43c0-903b-2ce3c6a3fc37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:18:56.345984 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b5f1f4-47e9-43c0-903b-2ce3c6a3fc37 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:18:56.362025 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-f9b5f1f4-47e9-43c0-903b-2ce3c6a3fc37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:18:56.363168 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 636/1269] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:18:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:18:56.368696 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f48a7bf-5c98-4273-a22a-6bf1d6901bc4 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:18:56.463465 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f48a7bf-5c98-4273-a22a-6bf1d6901bc4 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:18:56.496031 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9607dc17-7d03-42af-89af-fd3337b36cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:18:56.496673 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9607dc17-7d03-42af-89af-fd3337b36cdd None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:18:56.496957 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9607dc17-7d03-42af-89af-fd3337b36cdd None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:18:56.497237 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9607dc17-7d03-42af-89af-fd3337b36cdd None admin] PATH_INFO: `/v3/domains` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:18:56.497971 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9607dc17-7d03-42af-89af-fd3337b36cdd None admin] RBAC: Adding query filter params (name=Default) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:18:56.498388 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9607dc17-7d03-42af-89af-fd3337b36cdd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:18:56.499771 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9607dc17-7d03-42af-89af-fd3337b36cdd None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:18:56.510807 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 634/1270] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:18:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:18:56.516622 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b5f1f4-47e9-43c0-903b-2ce3c6a3fc37 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:18:56.619117 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b5f1f4-47e9-43c0-903b-2ce3c6a3fc37 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:18:56.650252 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816a1b2-bd7e-4aa4-adf9-98e8de20a07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:18:56.651072 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816a1b2-bd7e-4aa4-adf9-98e8de20a07d None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:18:56.651357 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816a1b2-bd7e-4aa4-adf9-98e8de20a07d None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:18:56.651633 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816a1b2-bd7e-4aa4-adf9-98e8de20a07d None admin] PATH_INFO: `/v3/projects/service` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:18:56.659515 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2816a1b2-bd7e-4aa4-adf9-98e8de20a07d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:18:56.660958 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2816a1b2-bd7e-4aa4-adf9-98e8de20a07d None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:18:56.674603 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-2816a1b2-bd7e-4aa4-adf9-98e8de20a07d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 30 01:18:56.675777 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 637/1271] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Mar 30 01:18:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:18:56.681734 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9607dc17-7d03-42af-89af-fd3337b36cdd None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:18:56.777490 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9607dc17-7d03-42af-89af-fd3337b36cdd None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:18:56.809916 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d301e5-8696-4cb7-b9e3-98f6fe56bbf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:18:56.811163 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d301e5-8696-4cb7-b9e3-98f6fe56bbf4 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:18:56.811637 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d301e5-8696-4cb7-b9e3-98f6fe56bbf4 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:18:56.812044 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d301e5-8696-4cb7-b9e3-98f6fe56bbf4 None admin] PATH_INFO: `/v3/projects` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:18:56.812817 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d301e5-8696-4cb7-b9e3-98f6fe56bbf4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:18:56.813126 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d301e5-8696-4cb7-b9e3-98f6fe56bbf4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:18:56.814541 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d301e5-8696-4cb7-b9e3-98f6fe56bbf4 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:18:56.826006 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 635/1272] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Mar 30 01:18:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:18:56.831891 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816a1b2-bd7e-4aa4-adf9-98e8de20a07d None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:18:56.927884 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816a1b2-bd7e-4aa4-adf9-98e8de20a07d None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:18:56.960352 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce42e0e5-0347-4b62-8e9d-5fd8c61e2033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:18:56.961225 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce42e0e5-0347-4b62-8e9d-5fd8c61e2033 None admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:18:56.961505 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce42e0e5-0347-4b62-8e9d-5fd8c61e2033 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:18:56.961776 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce42e0e5-0347-4b62-8e9d-5fd8c61e2033 None admin] PATH_INFO: `/v3/projects/0c9a4444228d4be89a4ba8aa53099531/users/7343cd5457264dabb4c2b3a62df59431/roles/36909bbf31d04993bb2a9fe587b572dc` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:18:56.963730 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce42e0e5-0347-4b62-8e9d-5fd8c61e2033 None admin] RBAC: Authorizing `identity:create_grant(project_id=0c9a4444228d4be89a4ba8aa53099531, user_id=7343cd5457264dabb4c2b3a62df59431, role_id=36909bbf31d04993bb2a9fe587b572dc)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:18:56.965153 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce42e0e5-0347-4b62-8e9d-5fd8c61e2033 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:18:56.977576 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 638/1273] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Mar 30 01:18:56 2022] PUT /identity/v3/projects/0c9a4444228d4be89a4ba8aa53099531/users/7343cd5457264dabb4c2b3a62df59431/roles/36909bbf31d04993bb2a9fe587b572dc => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:18:59.228101 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1931f-8dbf-4ae2-9235-9d553d416e69 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:18:59.228649 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1931f-8dbf-4ae2-9235-9d553d416e69 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:18:59.228649 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1931f-8dbf-4ae2-9235-9d553d416e69 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:18:59.230409 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 636/1274] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:18:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:18:59.235984 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6344f6e1-0926-4e1c-ab18-ea6ba801901f None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:18:59.236358 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6344f6e1-0926-4e1c-ab18-ea6ba801901f None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:18:59.236545 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6344f6e1-0926-4e1c-ab18-ea6ba801901f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:18:59.253549 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-6344f6e1-0926-4e1c-ab18-ea6ba801901f None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:18:59.254749 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-6344f6e1-0926-4e1c-ab18-ea6ba801901f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:18:59.317751 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 639/1275] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:18:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 01:18:59.341085 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee1931f-8dbf-4ae2-9235-9d553d416e69 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:18:59.438601 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee1931f-8dbf-4ae2-9235-9d553d416e69 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:18:59.472470 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0043d15-86ad-4073-8302-edf9d0696ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:18:59.473256 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0043d15-86ad-4073-8302-edf9d0696ccb None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:18:59.473537 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0043d15-86ad-4073-8302-edf9d0696ccb None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:18:59.473808 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0043d15-86ad-4073-8302-edf9d0696ccb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:18:59.484108 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0043d15-86ad-4073-8302-edf9d0696ccb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 01:18:59.490794 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-a0043d15-86ad-4073-8302-edf9d0696ccb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 30 01:18:59.491967 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 637/1276] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Mar 30 01:18:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:18:59.498786 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6344f6e1-0926-4e1c-ab18-ea6ba801901f None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:18:59.608523 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6344f6e1-0926-4e1c-ab18-ea6ba801901f None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:18:59.640900 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13230dee-d121-4fc3-9e50-d58c138fd0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:18:59.641553 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13230dee-d121-4fc3-9e50-d58c138fd0d2 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:18:59.641832 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13230dee-d121-4fc3-9e50-d58c138fd0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:18:59.642101 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13230dee-d121-4fc3-9e50-d58c138fd0d2 None admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:18:59.642859 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13230dee-d121-4fc3-9e50-d58c138fd0d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:18:59.643164 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13230dee-d121-4fc3-9e50-d58c138fd0d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:18:59.644515 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13230dee-d121-4fc3-9e50-d58c138fd0d2 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:18:59.652207 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 640/1277] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Mar 30 01:18:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:18:59.657952 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0043d15-86ad-4073-8302-edf9d0696ccb None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:18:59.751790 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0043d15-86ad-4073-8302-edf9d0696ccb None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:18:59.783799 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1097c8c-b4b5-4630-8ac1-99dfa235e28b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:18:59.784568 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1097c8c-b4b5-4630-8ac1-99dfa235e28b None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:18:59.784847 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1097c8c-b4b5-4630-8ac1-99dfa235e28b None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:18:59.785123 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1097c8c-b4b5-4630-8ac1-99dfa235e28b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:18:59.795710 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1097c8c-b4b5-4630-8ac1-99dfa235e28b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:18:59.797260 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1097c8c-b4b5-4630-8ac1-99dfa235e28b None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:18:59.813631 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-f1097c8c-b4b5-4630-8ac1-99dfa235e28b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:18:59.814789 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 638/1278] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:18:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:18:59.824283 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13230dee-d121-4fc3-9e50-d58c138fd0d2 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:18:59.920652 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13230dee-d121-4fc3-9e50-d58c138fd0d2 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:18:59.952512 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d78bf-2b0d-4739-90f9-f68cc9478f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:18:59.953159 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d78bf-2b0d-4739-90f9-f68cc9478f4a None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:18:59.953445 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d78bf-2b0d-4739-90f9-f68cc9478f4a None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:18:59.953722 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d78bf-2b0d-4739-90f9-f68cc9478f4a None admin] PATH_INFO: `/v3/domains` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:18:59.954430 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5d78bf-2b0d-4739-90f9-f68cc9478f4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:18:59.954755 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5d78bf-2b0d-4739-90f9-f68cc9478f4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:18:59.956107 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5d78bf-2b0d-4739-90f9-f68cc9478f4a None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:18:59.967614 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 641/1279] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:18:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:18:59.973040 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1097c8c-b4b5-4630-8ac1-99dfa235e28b None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:19:00.066319 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1097c8c-b4b5-4630-8ac1-99dfa235e28b None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:19:00.099078 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac60a2-a6c2-4450-bd05-ebefedf7505a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:19:00.099860 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac60a2-a6c2-4450-bd05-ebefedf7505a None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:19:00.100140 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac60a2-a6c2-4450-bd05-ebefedf7505a None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:19:00.100411 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac60a2-a6c2-4450-bd05-ebefedf7505a None admin] PATH_INFO: `/v3/users/placement` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:19:00.109177 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac60a2-a6c2-4450-bd05-ebefedf7505a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:19:00.110590 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac60a2-a6c2-4450-bd05-ebefedf7505a None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:19:00.123678 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-9fac60a2-a6c2-4450-bd05-ebefedf7505a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 30 01:19:00.124820 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 639/1280] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:18:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:19:00.130553 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d78bf-2b0d-4739-90f9-f68cc9478f4a None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:19:00.225011 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d78bf-2b0d-4739-90f9-f68cc9478f4a None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:19:00.256916 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699e277b-b3c2-4f80-8b1e-691e755daf08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:19:00.257566 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699e277b-b3c2-4f80-8b1e-691e755daf08 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:19:00.257848 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699e277b-b3c2-4f80-8b1e-691e755daf08 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:19:00.258124 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699e277b-b3c2-4f80-8b1e-691e755daf08 None admin] PATH_INFO: `/v3/users` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:19:00.258966 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699e277b-b3c2-4f80-8b1e-691e755daf08 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:19:00.259273 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699e277b-b3c2-4f80-8b1e-691e755daf08 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:19:00.260688 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699e277b-b3c2-4f80-8b1e-691e755daf08 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:19:00.276855 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 642/1281] 10.222.0.30 () {56 vars in 1143 bytes} [Wed Mar 30 01:19:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:19:00.283571 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac60a2-a6c2-4450-bd05-ebefedf7505a None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:19:00.382464 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac60a2-a6c2-4450-bd05-ebefedf7505a None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:19:00.416039 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963e4747-c1bf-4e57-86b0-0d349a1d2fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:19:00.416733 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e4747-c1bf-4e57-86b0-0d349a1d2fbf None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:19:00.417017 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e4747-c1bf-4e57-86b0-0d349a1d2fbf None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:19:00.417291 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e4747-c1bf-4e57-86b0-0d349a1d2fbf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:19:00.482829 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963e4747-c1bf-4e57-86b0-0d349a1d2fbf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:19:00.484253 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963e4747-c1bf-4e57-86b0-0d349a1d2fbf None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:19:00.581977 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 640/1282] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Mar 30 01:19:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 30 01:19:00.587695 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699e277b-b3c2-4f80-8b1e-691e755daf08 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:19:00.681709 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699e277b-b3c2-4f80-8b1e-691e755daf08 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:19:00.714878 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7342be1-4c62-4a82-9d12-632752d2bbd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:19:00.715656 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7342be1-4c62-4a82-9d12-632752d2bbd7 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:19:00.715940 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7342be1-4c62-4a82-9d12-632752d2bbd7 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:19:00.716215 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7342be1-4c62-4a82-9d12-632752d2bbd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:19:00.726819 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7342be1-4c62-4a82-9d12-632752d2bbd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:19:00.728251 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7342be1-4c62-4a82-9d12-632752d2bbd7 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:19:00.744608 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-b7342be1-4c62-4a82-9d12-632752d2bbd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 01:19:00.745757 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 643/1283] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:19:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:19:00.751546 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963e4747-c1bf-4e57-86b0-0d349a1d2fbf None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:19:00.845290 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963e4747-c1bf-4e57-86b0-0d349a1d2fbf None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:19:00.876850 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5ada78-177d-4698-b5b2-ee9cabb25691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:19:00.877489 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ada78-177d-4698-b5b2-ee9cabb25691 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:19:00.877769 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ada78-177d-4698-b5b2-ee9cabb25691 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:19:00.878041 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ada78-177d-4698-b5b2-ee9cabb25691 None admin] PATH_INFO: `/v3/domains` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:19:00.878763 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5ada78-177d-4698-b5b2-ee9cabb25691 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:19:00.879068 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5ada78-177d-4698-b5b2-ee9cabb25691 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:19:00.880409 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5ada78-177d-4698-b5b2-ee9cabb25691 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:19:00.891064 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 641/1284] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Mar 30 01:19:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:19:00.896498 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7342be1-4c62-4a82-9d12-632752d2bbd7 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:19:00.991478 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7342be1-4c62-4a82-9d12-632752d2bbd7 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:19:01.022828 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aebefd-1525-4385-821c-d72ab4111392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:19:01.023597 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aebefd-1525-4385-821c-d72ab4111392 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:19:01.023881 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aebefd-1525-4385-821c-d72ab4111392 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:19:01.024157 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aebefd-1525-4385-821c-d72ab4111392 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:19:01.031616 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aebefd-1525-4385-821c-d72ab4111392 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:19:01.033048 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aebefd-1525-4385-821c-d72ab4111392 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:19:01.046316 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING keystone.server.flask.application [None req-26aebefd-1525-4385-821c-d72ab4111392 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 30 01:19:01.047471 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 644/1285] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Mar 30 01:19:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:19:01.053143 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5ada78-177d-4698-b5b2-ee9cabb25691 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:19:01.145688 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5ada78-177d-4698-b5b2-ee9cabb25691 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:19:01.177336 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213d00b9-e9c0-49bc-ac27-729f50a39652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:19:01.177973 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d00b9-e9c0-49bc-ac27-729f50a39652 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:19:01.178252 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d00b9-e9c0-49bc-ac27-729f50a39652 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:19:01.178525 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d00b9-e9c0-49bc-ac27-729f50a39652 None admin] PATH_INFO: `/v3/projects` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:19:01.179316 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213d00b9-e9c0-49bc-ac27-729f50a39652 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:19:01.179621 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213d00b9-e9c0-49bc-ac27-729f50a39652 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:19:01.181020 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213d00b9-e9c0-49bc-ac27-729f50a39652 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:19:01.192230 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 642/1286] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Mar 30 01:19:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:19:01.198037 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aebefd-1525-4385-821c-d72ab4111392 None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:19:01.291713 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aebefd-1525-4385-821c-d72ab4111392 None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:19:01.323203 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa2fc48-cd1a-48ff-a507-e3aaf88fdecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:19:01.323833 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2fc48-cd1a-48ff-a507-e3aaf88fdecd None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:19:01.324113 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2fc48-cd1a-48ff-a507-e3aaf88fdecd None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:19:01.324382 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2fc48-cd1a-48ff-a507-e3aaf88fdecd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:19:01.325185 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa2fc48-cd1a-48ff-a507-e3aaf88fdecd None admin] RBAC: Adding query filter params (role.id=36909bbf31d04993bb2a9fe587b572dc, scope.project.id=0c9a4444228d4be89a4ba8aa53099531, user.id=7343cd5457264dabb4c2b3a62df59431) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:19:01.325491 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa2fc48-cd1a-48ff-a507-e3aaf88fdecd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:19:01.327245 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa2fc48-cd1a-48ff-a507-e3aaf88fdecd None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:19:01.332702 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 645/1287] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Mar 30 01:19:01 2022] GET /identity/v3/role_assignments?user.id=7343cd5457264dabb4c2b3a62df59431&scope.project.id=0c9a4444228d4be89a4ba8aa53099531&role.id=36909bbf31d04993bb2a9fe587b572dc => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:19:03.611879 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e924c-8723-4b05-bd8e-62e0b3434561 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:19:03.612411 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e924c-8723-4b05-bd8e-62e0b3434561 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:19:03.612411 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e924c-8723-4b05-bd8e-62e0b3434561 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:19:03.615157 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 643/1288] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:19:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:19:03.619415 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e953324-d6f9-4366-a588-67473dfeb022 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:19:03.619795 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e953324-d6f9-4366-a588-67473dfeb022 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:19:03.619974 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e953324-d6f9-4366-a588-67473dfeb022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:19:03.636711 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-5e953324-d6f9-4366-a588-67473dfeb022 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:19:03.637896 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-5e953324-d6f9-4366-a588-67473dfeb022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:19:03.700728 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 646/1289] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:19:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 01:19:03.723967 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e924c-8723-4b05-bd8e-62e0b3434561 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:19:03.822586 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e924c-8723-4b05-bd8e-62e0b3434561 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:19:03.855831 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ff1172-17c9-440f-8976-63b8ef3bd75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:19:03.856602 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff1172-17c9-440f-8976-63b8ef3bd75e None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:19:03.856881 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff1172-17c9-440f-8976-63b8ef3bd75e None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:19:03.857151 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff1172-17c9-440f-8976-63b8ef3bd75e None admin] PATH_INFO: `/v3/services/placement` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:19:03.857790 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ff1172-17c9-440f-8976-63b8ef3bd75e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:19:03.859290 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ff1172-17c9-440f-8976-63b8ef3bd75e None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:19:03.869806 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-96ff1172-17c9-440f-8976-63b8ef3bd75e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Mar 30 01:19:03.870899 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 644/1290] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Mar 30 01:19:03 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:19:03.877621 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e953324-d6f9-4366-a588-67473dfeb022 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:19:03.971542 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e953324-d6f9-4366-a588-67473dfeb022 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:19:04.003348 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7371a8f-80e8-4a30-85d5-9ab7066a3fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:19:04.003999 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7371a8f-80e8-4a30-85d5-9ab7066a3fd7 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:19:04.004284 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7371a8f-80e8-4a30-85d5-9ab7066a3fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:19:04.004561 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7371a8f-80e8-4a30-85d5-9ab7066a3fd7 None admin] PATH_INFO: `/v3/services` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:19:04.005257 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7371a8f-80e8-4a30-85d5-9ab7066a3fd7 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:19:04.005563 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7371a8f-80e8-4a30-85d5-9ab7066a3fd7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:19:04.006963 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7371a8f-80e8-4a30-85d5-9ab7066a3fd7 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:19:04.011544 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 647/1291] 10.222.0.30 () {56 vars in 1116 bytes} [Wed Mar 30 01:19:03 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:19:04.017950 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ff1172-17c9-440f-8976-63b8ef3bd75e None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:19:04.111632 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ff1172-17c9-440f-8976-63b8ef3bd75e None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:19:04.144225 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e24c07-6505-45e4-bd24-d574149e1cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:19:04.144815 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e24c07-6505-45e4-bd24-d574149e1cc8 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:19:04.145094 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e24c07-6505-45e4-bd24-d574149e1cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:19:04.145367 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e24c07-6505-45e4-bd24-d574149e1cc8 None admin] PATH_INFO: `/v3/services` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:19:04.146051 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e24c07-6505-45e4-bd24-d574149e1cc8 None admin] RBAC: Adding query filter params (type=placement) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:19:04.146354 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e24c07-6505-45e4-bd24-d574149e1cc8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:19:04.147803 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e24c07-6505-45e4-bd24-d574149e1cc8 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:19:04.152011 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 645/1292] 10.222.0.30 () {56 vars in 1116 bytes} [Wed Mar 30 01:19:04 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:19:06.422393 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b22014-3807-4907-9792-ac5445e2b61b None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:19:06.422997 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b22014-3807-4907-9792-ac5445e2b61b None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:19:06.422997 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b22014-3807-4907-9792-ac5445e2b61b None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:19:06.424744 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 648/1293] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:19:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:19:06.429815 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ccf4a-5dea-4b3a-84f6-bacb14549e5e None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:19:06.430230 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ccf4a-5dea-4b3a-84f6-bacb14549e5e None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:19:06.430373 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ccf4a-5dea-4b3a-84f6-bacb14549e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:19:06.447519 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-2b6ccf4a-5dea-4b3a-84f6-bacb14549e5e None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:19:06.448682 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-2b6ccf4a-5dea-4b3a-84f6-bacb14549e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:19:06.511529 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 646/1294] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:19:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 01:19:06.536410 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b22014-3807-4907-9792-ac5445e2b61b None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:19:06.638025 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b22014-3807-4907-9792-ac5445e2b61b None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:19:06.670211 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e904b3-b8d1-452d-a5ea-7c8726c157bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:19:06.670889 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e904b3-b8d1-452d-a5ea-7c8726c157bb None admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:19:06.671170 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e904b3-b8d1-452d-a5ea-7c8726c157bb None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:19:06.671931 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e904b3-b8d1-452d-a5ea-7c8726c157bb None admin] PATH_INFO: `/v3/services` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:19:06.672689 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e904b3-b8d1-452d-a5ea-7c8726c157bb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:19:06.673985 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e904b3-b8d1-452d-a5ea-7c8726c157bb None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:19:06.686527 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 649/1295] 10.222.0.30 () {60 vars in 1141 bytes} [Wed Mar 30 01:19:06 2022] POST /identity/v3/services => generated 246 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 01:19:08.954640 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c6c52-16b0-4e16-8967-ffb8b78f2eb2 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:19:08.955179 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c6c52-16b0-4e16-8967-ffb8b78f2eb2 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:19:08.955179 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c6c52-16b0-4e16-8967-ffb8b78f2eb2 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:19:08.956917 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 647/1296] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:19:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:19:08.961975 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ea5ae-666f-46f1-b394-d19ba16d5470 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:19:08.962415 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ea5ae-666f-46f1-b394-d19ba16d5470 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:19:08.962540 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ea5ae-666f-46f1-b394-d19ba16d5470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:19:08.979041 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-063ea5ae-666f-46f1-b394-d19ba16d5470 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:19:08.980226 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-063ea5ae-666f-46f1-b394-d19ba16d5470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:19:09.050289 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 650/1297] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:19:08 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 01:19:09.072970 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c6c52-16b0-4e16-8967-ffb8b78f2eb2 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:19:09.172539 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c6c52-16b0-4e16-8967-ffb8b78f2eb2 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:19:09.204604 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4541de-39e8-4649-bb1e-10611a2c80e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:19:09.205419 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4541de-39e8-4649-bb1e-10611a2c80e7 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:19:09.205654 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4541de-39e8-4649-bb1e-10611a2c80e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:19:09.205933 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4541de-39e8-4649-bb1e-10611a2c80e7 None admin] PATH_INFO: `/v3/services/placement` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:19:09.206572 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4541de-39e8-4649-bb1e-10611a2c80e7 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:19:09.207951 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4541de-39e8-4649-bb1e-10611a2c80e7 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:19:09.219375 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-cf4541de-39e8-4649-bb1e-10611a2c80e7 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Mar 30 01:19:09.220506 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 648/1298] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Mar 30 01:19:09 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 01:19:09.226313 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063ea5ae-666f-46f1-b394-d19ba16d5470 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:19:09.319430 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063ea5ae-666f-46f1-b394-d19ba16d5470 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:19:09.351256 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f7c182-9664-4027-813f-ff7dc1370ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:19:09.351914 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f7c182-9664-4027-813f-ff7dc1370ddf None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:19:09.352196 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f7c182-9664-4027-813f-ff7dc1370ddf None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:19:09.352472 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f7c182-9664-4027-813f-ff7dc1370ddf None admin] PATH_INFO: `/v3/services` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:19:09.353169 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f7c182-9664-4027-813f-ff7dc1370ddf None admin] RBAC: Adding query filter params (name=placement) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:19:09.353475 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f7c182-9664-4027-813f-ff7dc1370ddf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:19:09.354870 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f7c182-9664-4027-813f-ff7dc1370ddf None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:19:09.360308 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 651/1299] 10.222.0.30 () {56 vars in 1116 bytes} [Wed Mar 30 01:19:09 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:19:09.366225 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4541de-39e8-4649-bb1e-10611a2c80e7 None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:19:09.461140 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4541de-39e8-4649-bb1e-10611a2c80e7 None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:19:09.492846 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ece23f-f484-4154-8ba0-20edc5154de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:19:09.493487 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ece23f-f484-4154-8ba0-20edc5154de6 None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:19:09.493766 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ece23f-f484-4154-8ba0-20edc5154de6 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:19:09.494039 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ece23f-f484-4154-8ba0-20edc5154de6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:19:09.494836 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ece23f-f484-4154-8ba0-20edc5154de6 None admin] RBAC: Adding query filter params (interface=public, service_id=1199c2cd3071454f87d644e5d70977c8, region_id=RegionOne) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:19:09.495147 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ece23f-f484-4154-8ba0-20edc5154de6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:19:09.496498 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ece23f-f484-4154-8ba0-20edc5154de6 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:19:09.501997 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 649/1300] 10.222.0.30 () {56 vars in 1251 bytes} [Wed Mar 30 01:19:09 2022] GET /identity/v3/endpoints?service_id=1199c2cd3071454f87d644e5d70977c8&interface=public®ion_id=RegionOne => generated 194 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:19:09.507405 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f7c182-9664-4027-813f-ff7dc1370ddf None admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:19:09.602307 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f7c182-9664-4027-813f-ff7dc1370ddf None admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:19:09.634472 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03413824-4a02-4d4b-96b1-d10d708564f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:19:09.635164 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03413824-4a02-4d4b-96b1-d10d708564f8 None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:19:09.635448 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03413824-4a02-4d4b-96b1-d10d708564f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:19:09.635730 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03413824-4a02-4d4b-96b1-d10d708564f8 None admin] PATH_INFO: `/v3/services` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:19:09.636400 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03413824-4a02-4d4b-96b1-d10d708564f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:19:09.637760 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03413824-4a02-4d4b-96b1-d10d708564f8 None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:19:09.645157 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 652/1301] 10.222.0.30 () {56 vars in 1087 bytes} [Wed Mar 30 01:19:09 2022] GET /identity/v3/services => generated 2191 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:19:11.951696 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e0946-66ad-4842-8559-46a4e4b93806 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:19:11.952193 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e0946-66ad-4842-8559-46a4e4b93806 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:19:11.952193 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e0946-66ad-4842-8559-46a4e4b93806 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:19:11.954486 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 650/1302] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:19:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:19:11.959537 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb351d8-800a-4ecf-a739-1c43b22bad49 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:19:11.959911 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb351d8-800a-4ecf-a739-1c43b22bad49 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:19:11.960098 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb351d8-800a-4ecf-a739-1c43b22bad49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:19:11.976513 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-ddb351d8-800a-4ecf-a739-1c43b22bad49 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:19:11.977687 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-ddb351d8-800a-4ecf-a739-1c43b22bad49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:19:12.041165 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 653/1303] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:19:11 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 01:19:12.064412 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e0946-66ad-4842-8559-46a4e4b93806 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:19:12.159026 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e0946-66ad-4842-8559-46a4e4b93806 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:19:12.191008 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0008271-34a8-4128-aa28-e4090b51e85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:19:12.191779 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0008271-34a8-4128-aa28-e4090b51e85b None admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:19:12.192056 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0008271-34a8-4128-aa28-e4090b51e85b None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:19:12.192324 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0008271-34a8-4128-aa28-e4090b51e85b None admin] PATH_INFO: `/v3/services/placement` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:19:12.192956 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0008271-34a8-4128-aa28-e4090b51e85b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:19:12.194297 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0008271-34a8-4128-aa28-e4090b51e85b None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:19:12.205601 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING keystone.server.flask.application [None req-c0008271-34a8-4128-aa28-e4090b51e85b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Mar 30 01:19:12.206676 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 651/1304] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Mar 30 01:19:12 2022] GET /identity/v3/services/placement => generated 90 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 01:19:12.212485 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb351d8-800a-4ecf-a739-1c43b22bad49 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:19:12.306410 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb351d8-800a-4ecf-a739-1c43b22bad49 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:19:12.338887 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313cc715-5b84-400f-bea4-57780bfe80da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:19:12.339537 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313cc715-5b84-400f-bea4-57780bfe80da None admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:19:12.339819 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313cc715-5b84-400f-bea4-57780bfe80da None admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:19:12.340091 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313cc715-5b84-400f-bea4-57780bfe80da None admin] PATH_INFO: `/v3/services` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:19:12.340778 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313cc715-5b84-400f-bea4-57780bfe80da None admin] RBAC: Adding query filter params (name=placement) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:19:12.341082 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313cc715-5b84-400f-bea4-57780bfe80da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:19:12.342434 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313cc715-5b84-400f-bea4-57780bfe80da None admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:19:12.347534 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 654/1305] 10.222.0.30 () {56 vars in 1116 bytes} [Wed Mar 30 01:19:12 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:19:12.353012 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0008271-34a8-4128-aa28-e4090b51e85b None admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:19:12.449111 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0008271-34a8-4128-aa28-e4090b51e85b None admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:19:12.481628 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5504d59b-491c-4c8a-83f6-36735014c049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:19:12.482207 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5504d59b-491c-4c8a-83f6-36735014c049 None admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:19:12.482490 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5504d59b-491c-4c8a-83f6-36735014c049 None admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:19:12.482796 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5504d59b-491c-4c8a-83f6-36735014c049 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:19:12.483542 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5504d59b-491c-4c8a-83f6-36735014c049 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:19:12.485743 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5504d59b-491c-4c8a-83f6-36735014c049 None admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:19:12.504178 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 652/1306] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Mar 30 01:19:12 2022] POST /identity/v3/endpoints => generated 331 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:20:16.723572 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8125b89a-f5ec-4eee-8056-ff4e6faab09e None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:20:16.724512 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8125b89a-f5ec-4eee-8056-ff4e6faab09e None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:20:16.724948 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8125b89a-f5ec-4eee-8056-ff4e6faab09e None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:20:16.731447 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 655/1307] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:20:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:20:16.732784 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55fe442-d440-469e-995a-cc60eecb32ea None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:20:16.733577 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55fe442-d440-469e-995a-cc60eecb32ea None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:20:16.734031 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55fe442-d440-469e-995a-cc60eecb32ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:20:16.876376 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-f55fe442-d440-469e-995a-cc60eecb32ea None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:20:16.877605 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-f55fe442-d440-469e-995a-cc60eecb32ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:20:17.025215 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 653/1308] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:20:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 01:20:17.078821 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be2f560-2cd4-451c-b6c2-8f3209dc4d94 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:20:17.079185 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be2f560-2cd4-451c-b6c2-8f3209dc4d94 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:20:17.079540 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be2f560-2cd4-451c-b6c2-8f3209dc4d94 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:20:17.083686 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 656/1309] 10.222.0.30 () {54 vars in 963 bytes} [Wed Mar 30 01:20:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 01:20:17.090163 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab8ed0f-3661-4b70-9918-34aa803129ff None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:20:17.090465 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab8ed0f-3661-4b70-9918-34aa803129ff None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:20:17.090935 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab8ed0f-3661-4b70-9918-34aa803129ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:20:17.170652 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-dab8ed0f-3661-4b70-9918-34aa803129ff None None] MFA Rules not processed for user `41745b7f8a804e75b490a0a34977b23b`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:20:17.172140 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-dab8ed0f-3661-4b70-9918-34aa803129ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:20:17.254638 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 654/1310] 10.222.0.30 () {58 vars in 1060 bytes} [Wed Mar 30 01:20:17 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 01:20:17.264321 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be2f560-2cd4-451c-b6c2-8f3209dc4d94 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:20:17.266073 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-6be2f560-2cd4-451c-b6c2-8f3209dc4d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:20:17.375985 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be2f560-2cd4-451c-b6c2-8f3209dc4d94 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:20:17.454527 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54783912-ac93-421e-a2ff-2b0b3743f4f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:20:17.455207 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54783912-ac93-421e-a2ff-2b0b3743f4f0 service neutron] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:20:17.455492 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54783912-ac93-421e-a2ff-2b0b3743f4f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:20:17.455767 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54783912-ac93-421e-a2ff-2b0b3743f4f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:20:17.457551 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-54783912-ac93-421e-a2ff-2b0b3743f4f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:20:17.576651 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54783912-ac93-421e-a2ff-2b0b3743f4f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:20:17.578142 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54783912-ac93-421e-a2ff-2b0b3743f4f0 service neutron] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:20:17.601748 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 657/1311] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:20:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 30 01:20:20.282199 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af81e4f1-cf5c-42af-aa54-a986be57b547 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:20:20.283106 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af81e4f1-cf5c-42af-aa54-a986be57b547 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:20:20.283384 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af81e4f1-cf5c-42af-aa54-a986be57b547 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:20:20.285353 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 655/1312] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:20:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:20:20.291200 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1dfb9-5d54-4e83-b6ed-ecad17035838 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:20:20.291633 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1dfb9-5d54-4e83-b6ed-ecad17035838 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:20:20.291789 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1dfb9-5d54-4e83-b6ed-ecad17035838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:20:20.364220 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-c0e1dfb9-5d54-4e83-b6ed-ecad17035838 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:20:20.365420 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-c0e1dfb9-5d54-4e83-b6ed-ecad17035838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:20:20.463557 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 658/1313] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:20:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:20:20.501353 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af81e4f1-cf5c-42af-aa54-a986be57b547 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:20:20.503017 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-af81e4f1-cf5c-42af-aa54-a986be57b547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:20:20.610756 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af81e4f1-cf5c-42af-aa54-a986be57b547 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:20:20.690662 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8941285-718b-4952-8c18-721cebce238c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:20:20.691398 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8941285-718b-4952-8c18-721cebce238c service neutron] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:20:20.691682 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8941285-718b-4952-8c18-721cebce238c service neutron] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:20:20.691957 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8941285-718b-4952-8c18-721cebce238c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:20:20.693583 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-f8941285-718b-4952-8c18-721cebce238c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:20:20.803282 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8941285-718b-4952-8c18-721cebce238c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:20:20.804726 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8941285-718b-4952-8c18-721cebce238c service neutron] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:20:20.823176 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 656/1314] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:20:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:20:23.466952 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bccb0f-4e06-4007-b05a-624e33c1f192 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:20:23.467517 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bccb0f-4e06-4007-b05a-624e33c1f192 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:20:23.467517 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bccb0f-4e06-4007-b05a-624e33c1f192 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:20:23.469268 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 659/1315] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:20:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:20:23.474645 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f73b933-e9ff-4514-8d0e-05ade2dcc654 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:20:23.475078 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f73b933-e9ff-4514-8d0e-05ade2dcc654 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:20:23.475266 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f73b933-e9ff-4514-8d0e-05ade2dcc654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:20:23.538387 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-4f73b933-e9ff-4514-8d0e-05ade2dcc654 None None] MFA Rules not processed for user `6cf69a2898a141f6bb15a9b7af982ed8`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:20:23.539607 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-4f73b933-e9ff-4514-8d0e-05ade2dcc654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:20:23.631315 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 657/1316] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:20:23 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 01:20:23.688155 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb71f1d0-2cca-4f07-871a-c95f772dd1af None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:20:23.688443 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb71f1d0-2cca-4f07-871a-c95f772dd1af None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:20:23.688724 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb71f1d0-2cca-4f07-871a-c95f772dd1af None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:20:23.690501 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 660/1317] 10.222.0.30 () {54 vars in 963 bytes} [Wed Mar 30 01:20:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:20:23.696385 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe4712-2bf8-443f-8afc-bf1d614bc825 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:20:23.696677 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe4712-2bf8-443f-8afc-bf1d614bc825 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:20:23.696956 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe4712-2bf8-443f-8afc-bf1d614bc825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:20:23.772006 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-a2fe4712-2bf8-443f-8afc-bf1d614bc825 None None] MFA Rules not processed for user `41745b7f8a804e75b490a0a34977b23b`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:20:23.773140 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-a2fe4712-2bf8-443f-8afc-bf1d614bc825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:20:23.846445 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 658/1318] 10.222.0.30 () {58 vars in 1060 bytes} [Wed Mar 30 01:20:23 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:20:23.856487 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb71f1d0-2cca-4f07-871a-c95f772dd1af None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:20:23.858029 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-fb71f1d0-2cca-4f07-871a-c95f772dd1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:20:23.956819 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb71f1d0-2cca-4f07-871a-c95f772dd1af None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:20:24.028621 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78cb4c1-87a9-4e1c-8e66-ff0d01ce00c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:20:24.029206 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78cb4c1-87a9-4e1c-8e66-ff0d01ce00c9 service neutron] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:20:24.029493 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78cb4c1-87a9-4e1c-8e66-ff0d01ce00c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:20:24.029772 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78cb4c1-87a9-4e1c-8e66-ff0d01ce00c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:20:24.031440 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-a78cb4c1-87a9-4e1c-8e66-ff0d01ce00c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:20:24.136230 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78cb4c1-87a9-4e1c-8e66-ff0d01ce00c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:20:24.138346 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78cb4c1-87a9-4e1c-8e66-ff0d01ce00c9 service neutron] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:20:24.160459 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 661/1319] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:20:23 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:20:27.354796 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b3cd1-789f-4f62-933d-ac1451ef7e98 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:20:27.355355 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b3cd1-789f-4f62-933d-ac1451ef7e98 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:20:27.355355 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b3cd1-789f-4f62-933d-ac1451ef7e98 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:20:27.357291 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 659/1320] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:20:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:20:27.362537 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf179a-7363-44c5-8036-92cb9bd81938 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:20:27.362948 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf179a-7363-44c5-8036-92cb9bd81938 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:20:27.363138 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf179a-7363-44c5-8036-92cb9bd81938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:20:27.426211 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-23bf179a-7363-44c5-8036-92cb9bd81938 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:20:27.427437 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-23bf179a-7363-44c5-8036-92cb9bd81938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:20:27.521828 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 662/1321] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:20:27 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:20:27.564103 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9b3cd1-789f-4f62-933d-ac1451ef7e98 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:20:27.565613 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-ca9b3cd1-789f-4f62-933d-ac1451ef7e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:20:27.665543 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9b3cd1-789f-4f62-933d-ac1451ef7e98 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:20:27.736011 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c26f35-89b7-4f42-93e2-6fa54be41520 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:20:27.736651 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c26f35-89b7-4f42-93e2-6fa54be41520 service neutron] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:20:27.736935 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c26f35-89b7-4f42-93e2-6fa54be41520 service neutron] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:20:27.737210 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c26f35-89b7-4f42-93e2-6fa54be41520 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:20:27.738875 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-50c26f35-89b7-4f42-93e2-6fa54be41520 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:20:27.844147 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c26f35-89b7-4f42-93e2-6fa54be41520 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:20:27.845564 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c26f35-89b7-4f42-93e2-6fa54be41520 service neutron] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:20:27.862608 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 660/1322] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:20:27 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:20:30.822252 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9c8d8-feb1-4da6-9be2-ab0118744a08 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:20:30.822823 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9c8d8-feb1-4da6-9be2-ab0118744a08 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:20:30.822823 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9c8d8-feb1-4da6-9be2-ab0118744a08 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:20:30.824871 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 663/1323] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:20:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:20:30.830022 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e93447-54d5-4664-b943-edeeea820c1e None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:20:30.830425 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e93447-54d5-4664-b943-edeeea820c1e None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:20:30.830581 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e93447-54d5-4664-b943-edeeea820c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:20:30.894307 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-23e93447-54d5-4664-b943-edeeea820c1e None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:20:30.895452 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-23e93447-54d5-4664-b943-edeeea820c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:20:30.991858 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 661/1324] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:20:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:20:31.027207 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d9c8d8-feb1-4da6-9be2-ab0118744a08 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:20:31.029333 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-09d9c8d8-feb1-4da6-9be2-ab0118744a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:20:31.131112 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d9c8d8-feb1-4da6-9be2-ab0118744a08 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:20:31.203831 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5622ff-47cb-450b-8161-3335fbe1bfab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:20:31.204498 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5622ff-47cb-450b-8161-3335fbe1bfab service neutron] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:20:31.204788 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5622ff-47cb-450b-8161-3335fbe1bfab service neutron] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:20:31.205065 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5622ff-47cb-450b-8161-3335fbe1bfab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:20:31.206723 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-cb5622ff-47cb-450b-8161-3335fbe1bfab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:20:31.329197 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5622ff-47cb-450b-8161-3335fbe1bfab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:20:31.330657 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5622ff-47cb-450b-8161-3335fbe1bfab service neutron] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:20:31.350054 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 664/1325] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:20:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:20:33.745435 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf0b4a-898e-497a-9f0d-652a05aa2ba7 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:20:33.745983 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf0b4a-898e-497a-9f0d-652a05aa2ba7 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:20:33.745983 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf0b4a-898e-497a-9f0d-652a05aa2ba7 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:20:33.748722 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 662/1326] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:20:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:20:33.754041 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac39cf3-9274-4694-873e-5c5723bdcf96 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:20:33.754494 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac39cf3-9274-4694-873e-5c5723bdcf96 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:20:33.754627 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac39cf3-9274-4694-873e-5c5723bdcf96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:20:33.819289 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-bac39cf3-9274-4694-873e-5c5723bdcf96 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:20:33.820489 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-bac39cf3-9274-4694-873e-5c5723bdcf96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:20:33.913368 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 665/1327] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:20:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:20:33.950281 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cf0b4a-898e-497a-9f0d-652a05aa2ba7 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:20:33.951912 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-d4cf0b4a-898e-497a-9f0d-652a05aa2ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:20:34.051948 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cf0b4a-898e-497a-9f0d-652a05aa2ba7 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:20:34.122852 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd167e-db41-42ff-83de-29078dd13331 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:20:34.123498 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd167e-db41-42ff-83de-29078dd13331 service neutron] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:20:34.123784 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd167e-db41-42ff-83de-29078dd13331 service neutron] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:20:34.124059 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd167e-db41-42ff-83de-29078dd13331 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:20:34.125685 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-70bd167e-db41-42ff-83de-29078dd13331 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:20:34.232834 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bd167e-db41-42ff-83de-29078dd13331 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:20:34.234188 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bd167e-db41-42ff-83de-29078dd13331 service neutron] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:20:34.252497 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 663/1328] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:20:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:20:36.611791 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd499d7-1d50-49fe-bbca-8d417fce3351 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:20:36.612322 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd499d7-1d50-49fe-bbca-8d417fce3351 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:20:36.612322 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd499d7-1d50-49fe-bbca-8d417fce3351 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:20:36.614319 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 666/1329] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:20:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:20:36.619376 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa10b0-dda0-42e2-b14c-138cbcb95123 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:20:36.619746 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa10b0-dda0-42e2-b14c-138cbcb95123 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:20:36.619935 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa10b0-dda0-42e2-b14c-138cbcb95123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:20:36.686781 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-5ffa10b0-dda0-42e2-b14c-138cbcb95123 None None] MFA Rules not processed for user `6cf69a2898a141f6bb15a9b7af982ed8`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:20:36.687989 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-5ffa10b0-dda0-42e2-b14c-138cbcb95123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:20:36.782686 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 664/1330] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:20:36 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:20:36.820536 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd499d7-1d50-49fe-bbca-8d417fce3351 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:20:36.822062 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-fbd499d7-1d50-49fe-bbca-8d417fce3351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:20:36.921373 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd499d7-1d50-49fe-bbca-8d417fce3351 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:20:36.992481 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682e3333-80cc-4d8f-ab26-671b4536d40c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:20:36.993134 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e3333-80cc-4d8f-ab26-671b4536d40c service neutron] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:20:36.993416 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e3333-80cc-4d8f-ab26-671b4536d40c service neutron] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:20:36.993688 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e3333-80cc-4d8f-ab26-671b4536d40c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:20:36.996359 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-682e3333-80cc-4d8f-ab26-671b4536d40c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:20:37.100641 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682e3333-80cc-4d8f-ab26-671b4536d40c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:20:37.101897 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682e3333-80cc-4d8f-ab26-671b4536d40c service neutron] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:20:37.119116 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 667/1331] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:20:36 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:20:39.659919 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a64fa-8097-47d2-886d-5d3ba7990018 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:20:39.660443 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a64fa-8097-47d2-886d-5d3ba7990018 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:20:39.660539 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a64fa-8097-47d2-886d-5d3ba7990018 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:20:39.662309 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 665/1332] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:20:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:20:39.667638 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bc9dcd-3e12-4ef3-afb7-16f31180c88f None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:20:39.668033 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bc9dcd-3e12-4ef3-afb7-16f31180c88f None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:20:39.668664 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bc9dcd-3e12-4ef3-afb7-16f31180c88f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:20:39.732821 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-d4bc9dcd-3e12-4ef3-afb7-16f31180c88f None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:20:39.734013 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-d4bc9dcd-3e12-4ef3-afb7-16f31180c88f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:20:39.828114 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 668/1333] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:20:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:20:39.865027 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a64fa-8097-47d2-886d-5d3ba7990018 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:20:39.866476 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-5d1a64fa-8097-47d2-886d-5d3ba7990018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:20:39.974114 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a64fa-8097-47d2-886d-5d3ba7990018 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:20:40.050750 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6591ee7f-3bc0-48d7-a0e1-64d1816dafd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:20:40.051400 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6591ee7f-3bc0-48d7-a0e1-64d1816dafd7 service neutron] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:20:40.051684 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6591ee7f-3bc0-48d7-a0e1-64d1816dafd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:20:40.051969 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6591ee7f-3bc0-48d7-a0e1-64d1816dafd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:20:40.053633 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-6591ee7f-3bc0-48d7-a0e1-64d1816dafd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:20:40.164360 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6591ee7f-3bc0-48d7-a0e1-64d1816dafd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:20:40.165781 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6591ee7f-3bc0-48d7-a0e1-64d1816dafd7 service neutron] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:20:40.183669 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 666/1334] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:20:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:20:42.518935 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06e240-46d6-4753-84d4-71a863cf6f50 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:20:42.519470 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06e240-46d6-4753-84d4-71a863cf6f50 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:20:42.519470 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06e240-46d6-4753-84d4-71a863cf6f50 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:20:42.521265 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 669/1335] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:20:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:20:42.526446 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b3ea7-b169-4125-b37d-1a8a3c7393d5 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:20:42.526847 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b3ea7-b169-4125-b37d-1a8a3c7393d5 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:20:42.527032 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b3ea7-b169-4125-b37d-1a8a3c7393d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:20:42.590031 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-1b0b3ea7-b169-4125-b37d-1a8a3c7393d5 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:20:42.591485 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-1b0b3ea7-b169-4125-b37d-1a8a3c7393d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:20:42.685027 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 667/1336] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:20:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:20:42.724238 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac06e240-46d6-4753-84d4-71a863cf6f50 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:20:42.725847 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-ac06e240-46d6-4753-84d4-71a863cf6f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:20:42.827865 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac06e240-46d6-4753-84d4-71a863cf6f50 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:20:42.898748 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d752f1-777c-48e9-a1f0-e6ea3a98c486 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:20:42.899401 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d752f1-777c-48e9-a1f0-e6ea3a98c486 service neutron] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:20:42.899682 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d752f1-777c-48e9-a1f0-e6ea3a98c486 service neutron] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:20:42.899958 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d752f1-777c-48e9-a1f0-e6ea3a98c486 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:20:42.901584 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-e6d752f1-777c-48e9-a1f0-e6ea3a98c486 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:20:43.006152 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d752f1-777c-48e9-a1f0-e6ea3a98c486 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:20:43.007622 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d752f1-777c-48e9-a1f0-e6ea3a98c486 service neutron] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:20:43.024857 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 670/1337] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:20:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:20:45.784380 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dcf142-a880-4b52-b4cc-9937b367c936 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:20:45.796131 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dcf142-a880-4b52-b4cc-9937b367c936 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:20:45.796131 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dcf142-a880-4b52-b4cc-9937b367c936 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:20:45.796131 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 668/1338] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:20:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:20:45.796434 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd87d6-a3d0-4337-9c75-39e592d671e6 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:20:45.796434 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd87d6-a3d0-4337-9c75-39e592d671e6 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:20:45.796434 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd87d6-a3d0-4337-9c75-39e592d671e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:20:45.860507 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-1dfd87d6-a3d0-4337-9c75-39e592d671e6 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:20:45.861707 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-1dfd87d6-a3d0-4337-9c75-39e592d671e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:20:45.954069 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 671/1339] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:20:45 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:20:45.990994 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dcf142-a880-4b52-b4cc-9937b367c936 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:20:45.992507 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-60dcf142-a880-4b52-b4cc-9937b367c936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:20:46.092422 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dcf142-a880-4b52-b4cc-9937b367c936 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:20:46.160766 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f3bbad-16a0-4af2-b804-963a96902f02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:20:46.161400 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f3bbad-16a0-4af2-b804-963a96902f02 service neutron] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:20:46.161679 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f3bbad-16a0-4af2-b804-963a96902f02 service neutron] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:20:46.161949 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f3bbad-16a0-4af2-b804-963a96902f02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:20:46.163651 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-64f3bbad-16a0-4af2-b804-963a96902f02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:20:46.270334 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f3bbad-16a0-4af2-b804-963a96902f02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:20:46.271724 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f3bbad-16a0-4af2-b804-963a96902f02 service neutron] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:20:46.289460 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 669/1340] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:20:45 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:20:50.641545 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b4887-6a29-4caa-a864-745ae0dcf08c None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:20:50.642022 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b4887-6a29-4caa-a864-745ae0dcf08c None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:20:50.642124 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b4887-6a29-4caa-a864-745ae0dcf08c None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:20:50.643919 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 672/1341] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:20:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:20:50.649006 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db1fff-0e36-4374-b39e-7c5208bda89e None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:20:50.649408 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db1fff-0e36-4374-b39e-7c5208bda89e None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:20:50.649565 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db1fff-0e36-4374-b39e-7c5208bda89e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:20:50.719771 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-64db1fff-0e36-4374-b39e-7c5208bda89e None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:20:50.720954 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-64db1fff-0e36-4374-b39e-7c5208bda89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:20:50.821800 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 670/1342] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:20:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:20:50.862344 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16b4887-6a29-4caa-a864-745ae0dcf08c None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:20:50.864505 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-e16b4887-6a29-4caa-a864-745ae0dcf08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:20:50.959907 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16b4887-6a29-4caa-a864-745ae0dcf08c None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:20:50.963528 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048511dc-c79a-4b3c-994d-e0e9cac96bbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:20:50.964282 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048511dc-c79a-4b3c-994d-e0e9cac96bbd service neutron] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:20:50.964571 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048511dc-c79a-4b3c-994d-e0e9cac96bbd service neutron] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:20:50.964846 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048511dc-c79a-4b3c-994d-e0e9cac96bbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:20:50.974538 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048511dc-c79a-4b3c-994d-e0e9cac96bbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:20:50.976004 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048511dc-c79a-4b3c-994d-e0e9cac96bbd service neutron] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:20:50.986224 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 673/1343] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:20:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:20:53.880778 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e7d15-73c5-49f3-b9f1-78f1de59d3cf None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:20:53.881307 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e7d15-73c5-49f3-b9f1-78f1de59d3cf None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:20:53.881307 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e7d15-73c5-49f3-b9f1-78f1de59d3cf None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:20:53.883140 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 671/1344] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:20:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:20:53.889115 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72434ba-26ca-4706-aa87-75a18eb5681f None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:20:53.889540 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72434ba-26ca-4706-aa87-75a18eb5681f None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:20:53.889667 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72434ba-26ca-4706-aa87-75a18eb5681f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:20:53.916793 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-d72434ba-26ca-4706-aa87-75a18eb5681f None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:20:53.917962 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-d72434ba-26ca-4706-aa87-75a18eb5681f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:20:53.994037 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 674/1345] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:20:53 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:20:54.032685 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7e7d15-73c5-49f3-b9f1-78f1de59d3cf None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:20:54.043192 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7e7d15-73c5-49f3-b9f1-78f1de59d3cf None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:20:54.047574 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0beb34c-5c1a-4d94-a0ba-7d77ea192c3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:20:54.048207 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0beb34c-5c1a-4d94-a0ba-7d77ea192c3f service neutron] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:20:54.048489 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0beb34c-5c1a-4d94-a0ba-7d77ea192c3f service neutron] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:20:54.048765 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0beb34c-5c1a-4d94-a0ba-7d77ea192c3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:20:54.057761 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0beb34c-5c1a-4d94-a0ba-7d77ea192c3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:20:54.059462 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0beb34c-5c1a-4d94-a0ba-7d77ea192c3f service neutron] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:20:54.069030 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 672/1346] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:20:54 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:20:58.773829 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f4a42-43f6-474f-a949-094ee3a3dde3 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:20:58.774349 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f4a42-43f6-474f-a949-094ee3a3dde3 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:20:58.774529 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f4a42-43f6-474f-a949-094ee3a3dde3 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:20:58.776514 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 675/1347] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:20:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:20:58.782209 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8dee40-18f1-4355-8069-d124f2323d79 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:20:58.782659 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8dee40-18f1-4355-8069-d124f2323d79 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:20:58.782823 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8dee40-18f1-4355-8069-d124f2323d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:20:58.800628 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-ac8dee40-18f1-4355-8069-d124f2323d79 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:20:58.801827 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-ac8dee40-18f1-4355-8069-d124f2323d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:20:58.812634 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 673/1348] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:20:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:20:58.850548 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59f4a42-43f6-474f-a949-094ee3a3dde3 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:20:58.861065 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59f4a42-43f6-474f-a949-094ee3a3dde3 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:20:58.864587 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c619e493-4f95-41d8-b07c-c4a77a216acd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:20:58.865222 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c619e493-4f95-41d8-b07c-c4a77a216acd service neutron] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:20:58.865506 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c619e493-4f95-41d8-b07c-c4a77a216acd service neutron] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:20:58.865785 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c619e493-4f95-41d8-b07c-c4a77a216acd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:20:58.875448 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c619e493-4f95-41d8-b07c-c4a77a216acd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:20:58.876822 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c619e493-4f95-41d8-b07c-c4a77a216acd service neutron] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:20:58.886535 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 676/1349] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:20:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:21:04.313096 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed367af-06e6-4246-bed6-35079acee43f None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:21:04.313607 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed367af-06e6-4246-bed6-35079acee43f None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:21:04.313720 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed367af-06e6-4246-bed6-35079acee43f None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:21:04.315835 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 674/1350] 10.222.0.30 () {54 vars in 921 bytes} [Wed Mar 30 01:21:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:21:04.322938 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db56c31-562a-444c-9661-9837b05b4502 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:21:04.322938 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db56c31-562a-444c-9661-9837b05b4502 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:21:04.322938 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db56c31-562a-444c-9661-9837b05b4502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:21:04.460748 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-0db56c31-562a-444c-9661-9837b05b4502 None None] MFA Rules not processed for user `7343cd5457264dabb4c2b3a62df59431`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:21:04.462350 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-0db56c31-562a-444c-9661-9837b05b4502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:21:04.549316 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 677/1351] 10.222.0.30 () {58 vars in 1018 bytes} [Wed Mar 30 01:21:04 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:21:08.995157 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c728eec1-6326-4e52-9c05-552a1fee3e17 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:21:08.995659 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c728eec1-6326-4e52-9c05-552a1fee3e17 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:21:08.995659 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c728eec1-6326-4e52-9c05-552a1fee3e17 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:21:08.997955 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 675/1352] 10.222.0.30 () {54 vars in 921 bytes} [Wed Mar 30 01:21:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:21:09.003038 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ffc242-acb4-45fb-b5cf-a6848078024e None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:21:09.003924 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ffc242-acb4-45fb-b5cf-a6848078024e None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:21:09.004403 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ffc242-acb4-45fb-b5cf-a6848078024e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:21:09.034733 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-f1ffc242-acb4-45fb-b5cf-a6848078024e None None] MFA Rules not processed for user `7343cd5457264dabb4c2b3a62df59431`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:21:09.036882 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-f1ffc242-acb4-45fb-b5cf-a6848078024e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:21:09.046435 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 678/1353] 10.222.0.30 () {58 vars in 1018 bytes} [Wed Mar 30 01:21:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:21:10.507382 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca33e45-d2cd-40f8-8065-229daa983cb3 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:21:10.507920 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca33e45-d2cd-40f8-8065-229daa983cb3 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:21:10.508031 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca33e45-d2cd-40f8-8065-229daa983cb3 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:21:10.509892 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 676/1354] 10.222.0.30 () {54 vars in 921 bytes} [Wed Mar 30 01:21:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:21:10.515204 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a085f185-a8bc-4cc7-96cc-624c264e3f42 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:21:10.515751 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a085f185-a8bc-4cc7-96cc-624c264e3f42 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:21:10.515866 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a085f185-a8bc-4cc7-96cc-624c264e3f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:21:10.537665 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-a085f185-a8bc-4cc7-96cc-624c264e3f42 None None] MFA Rules not processed for user `7343cd5457264dabb4c2b3a62df59431`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:21:10.538935 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-a085f185-a8bc-4cc7-96cc-624c264e3f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:21:10.548575 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 679/1355] 10.222.0.30 () {58 vars in 1018 bytes} [Wed Mar 30 01:21:10 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:21:14.427729 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe366db-741c-4823-859e-f51922b4bd8a None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:21:14.428227 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe366db-741c-4823-859e-f51922b4bd8a None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:21:14.428227 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe366db-741c-4823-859e-f51922b4bd8a None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:21:14.430208 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 677/1356] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:21:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:21:14.435790 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00652575-6595-4bc2-ac30-a63ee664e38c None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:21:14.436184 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00652575-6595-4bc2-ac30-a63ee664e38c None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:21:14.436332 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00652575-6595-4bc2-ac30-a63ee664e38c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:21:14.453746 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-00652575-6595-4bc2-ac30-a63ee664e38c None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:21:14.454944 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-00652575-6595-4bc2-ac30-a63ee664e38c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:21:14.463345 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 680/1357] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:21:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:21:14.510969 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d4f655-2f67-4a15-838f-c835f78f1ce1 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:21:14.511256 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d4f655-2f67-4a15-838f-c835f78f1ce1 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:21:14.511533 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d4f655-2f67-4a15-838f-c835f78f1ce1 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:21:14.513955 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 678/1358] 10.222.0.30 () {54 vars in 960 bytes} [Wed Mar 30 01:21:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:21:14.525985 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470ae686-4e54-4346-a499-904c3ac3cfd6 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:21:14.530809 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470ae686-4e54-4346-a499-904c3ac3cfd6 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:21:14.531296 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470ae686-4e54-4346-a499-904c3ac3cfd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:21:14.585483 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-470ae686-4e54-4346-a499-904c3ac3cfd6 None None] MFA Rules not processed for user `140c6d1a20e94192bde06e72040f162d`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:21:14.586969 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-470ae686-4e54-4346-a499-904c3ac3cfd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:21:14.679519 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 681/1359] 10.222.0.30 () {58 vars in 1057 bytes} [Wed Mar 30 01:21:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:21:14.688051 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d4f655-2f67-4a15-838f-c835f78f1ce1 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:21:14.703362 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d4f655-2f67-4a15-838f-c835f78f1ce1 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:21:14.708935 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9635b41-bcdf-4c72-972f-395ea68b8629 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140c6d1a20e94192bde06e72040f162d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:21:14.709576 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9635b41-bcdf-4c72-972f-395ea68b8629 service nova] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:21:14.709861 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9635b41-bcdf-4c72-972f-395ea68b8629 service nova] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:21:14.710137 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9635b41-bcdf-4c72-972f-395ea68b8629 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:21:14.719232 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9635b41-bcdf-4c72-972f-395ea68b8629 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:21:14.720809 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9635b41-bcdf-4c72-972f-395ea68b8629 service nova] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:21:14.730475 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 679/1360] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:21:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 30 01:21:17.300312 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d68b9-4a0e-452a-ad17-18e53f3007e8 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:21:17.300941 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d68b9-4a0e-452a-ad17-18e53f3007e8 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:21:17.300941 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d68b9-4a0e-452a-ad17-18e53f3007e8 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:21:17.302619 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 682/1361] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:21:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:21:17.307930 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ff426-f393-4dff-9710-457c644dcf6c None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:21:17.308369 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ff426-f393-4dff-9710-457c644dcf6c None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:21:17.308492 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ff426-f393-4dff-9710-457c644dcf6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:21:17.326826 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-128ff426-f393-4dff-9710-457c644dcf6c None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:21:17.328032 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-128ff426-f393-4dff-9710-457c644dcf6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:21:17.335924 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 680/1362] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:21:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:21:17.381076 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73d68b9-4a0e-452a-ad17-18e53f3007e8 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:21:17.398078 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73d68b9-4a0e-452a-ad17-18e53f3007e8 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:21:17.405292 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426e08d5-3b22-4d53-8e3f-d9ede18246df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140c6d1a20e94192bde06e72040f162d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:21:17.406127 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e08d5-3b22-4d53-8e3f-d9ede18246df service nova] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:21:17.406507 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e08d5-3b22-4d53-8e3f-d9ede18246df service nova] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:21:17.406924 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e08d5-3b22-4d53-8e3f-d9ede18246df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:21:17.416361 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426e08d5-3b22-4d53-8e3f-d9ede18246df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:21:17.418058 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426e08d5-3b22-4d53-8e3f-d9ede18246df service nova] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:21:17.428649 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 683/1363] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:21:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:21:20.099386 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0fd52e-6da8-444c-8f5c-c8665a544936 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:21:20.099947 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0fd52e-6da8-444c-8f5c-c8665a544936 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:21:20.099947 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0fd52e-6da8-444c-8f5c-c8665a544936 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:21:20.101704 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 681/1364] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:21:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:21:20.107643 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33392cc1-1286-4971-aeba-890b936fcb48 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:21:20.108070 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33392cc1-1286-4971-aeba-890b936fcb48 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:21:20.108174 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33392cc1-1286-4971-aeba-890b936fcb48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:21:20.126902 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-33392cc1-1286-4971-aeba-890b936fcb48 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:21:20.128083 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-33392cc1-1286-4971-aeba-890b936fcb48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:21:20.136041 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 684/1365] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:21:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:21:20.183362 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2e447-2f63-4028-9ef0-989321e61b2f None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:21:20.183653 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2e447-2f63-4028-9ef0-989321e61b2f None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:21:20.183934 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2e447-2f63-4028-9ef0-989321e61b2f None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:21:20.185718 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 682/1366] 10.222.0.30 () {54 vars in 960 bytes} [Wed Mar 30 01:21:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:21:20.191584 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae3174-aa08-4d14-964b-6ad5baffccc3 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:21:20.191940 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae3174-aa08-4d14-964b-6ad5baffccc3 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:21:20.192310 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae3174-aa08-4d14-964b-6ad5baffccc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:21:20.217699 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-2dae3174-aa08-4d14-964b-6ad5baffccc3 None None] MFA Rules not processed for user `140c6d1a20e94192bde06e72040f162d`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:21:20.218902 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-2dae3174-aa08-4d14-964b-6ad5baffccc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:21:20.228095 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 685/1367] 10.222.0.30 () {58 vars in 1057 bytes} [Wed Mar 30 01:21:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:21:20.235857 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef2e447-2f63-4028-9ef0-989321e61b2f None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:21:20.250639 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef2e447-2f63-4028-9ef0-989321e61b2f None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:21:20.256188 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba78fe6-61b5-4315-86f0-63b9922d326c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140c6d1a20e94192bde06e72040f162d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:21:20.256951 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba78fe6-61b5-4315-86f0-63b9922d326c service nova] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:21:20.257187 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba78fe6-61b5-4315-86f0-63b9922d326c service nova] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:21:20.257465 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba78fe6-61b5-4315-86f0-63b9922d326c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:21:20.266124 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba78fe6-61b5-4315-86f0-63b9922d326c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:21:20.267726 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba78fe6-61b5-4315-86f0-63b9922d326c service nova] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:21:20.277179 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 683/1368] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:21:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:21:22.674683 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04280dc2-ea97-492e-a926-02d9c60f4853 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:21:22.675241 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04280dc2-ea97-492e-a926-02d9c60f4853 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:21:22.675321 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04280dc2-ea97-492e-a926-02d9c60f4853 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:21:22.677347 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 686/1369] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:21:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:21:22.682819 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c5db39-738b-4e15-ae33-c9f0d8519dd1 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:21:22.683325 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c5db39-738b-4e15-ae33-c9f0d8519dd1 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:21:22.683411 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c5db39-738b-4e15-ae33-c9f0d8519dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:21:22.701523 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-55c5db39-738b-4e15-ae33-c9f0d8519dd1 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:21:22.702435 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-55c5db39-738b-4e15-ae33-c9f0d8519dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:21:22.711816 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 684/1370] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:21:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:21:22.756851 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04280dc2-ea97-492e-a926-02d9c60f4853 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:21:22.771403 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04280dc2-ea97-492e-a926-02d9c60f4853 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:21:22.776758 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cbc5e4-bec0-4915-b3d6-1c6fcdaedf82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140c6d1a20e94192bde06e72040f162d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:21:22.777396 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cbc5e4-bec0-4915-b3d6-1c6fcdaedf82 service nova] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:21:22.777686 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cbc5e4-bec0-4915-b3d6-1c6fcdaedf82 service nova] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:21:22.778480 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cbc5e4-bec0-4915-b3d6-1c6fcdaedf82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:21:22.787519 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cbc5e4-bec0-4915-b3d6-1c6fcdaedf82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:21:22.789121 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cbc5e4-bec0-4915-b3d6-1c6fcdaedf82 service nova] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:21:22.799908 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 687/1371] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:21:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:21:22.801899 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa87e5e-de2c-4f11-804f-1e910ec19213 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:21:22.802341 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa87e5e-de2c-4f11-804f-1e910ec19213 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:21:22.802692 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa87e5e-de2c-4f11-804f-1e910ec19213 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:21:22.804544 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 685/1372] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:21:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:21:22.809745 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8c1f6-cdeb-487b-9d70-b4b0aecc57ac None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:21:22.810598 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8c1f6-cdeb-487b-9d70-b4b0aecc57ac None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:21:22.810936 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8c1f6-cdeb-487b-9d70-b4b0aecc57ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:21:22.829797 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-a8c8c1f6-cdeb-487b-9d70-b4b0aecc57ac None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:21:22.837371 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-a8c8c1f6-cdeb-487b-9d70-b4b0aecc57ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:21:22.839992 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 688/1373] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:21:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:21:23.164113 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d477057-d048-49be-8445-78eed87c3aaa None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:21:23.164698 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d477057-d048-49be-8445-78eed87c3aaa None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:21:23.165006 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d477057-d048-49be-8445-78eed87c3aaa None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:21:23.167048 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 686/1374] 10.222.0.30 () {54 vars in 962 bytes} [Wed Mar 30 01:21:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:21:23.172317 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750d2fc9-f22b-4df8-97cd-bb429ebe7818 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:21:23.172701 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750d2fc9-f22b-4df8-97cd-bb429ebe7818 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:21:23.173053 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750d2fc9-f22b-4df8-97cd-bb429ebe7818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:21:23.223018 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-750d2fc9-f22b-4df8-97cd-bb429ebe7818 None None] MFA Rules not processed for user `45219f386f0147b6bd380efe4ab62812`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:21:23.224391 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-750d2fc9-f22b-4df8-97cd-bb429ebe7818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:21:23.286604 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 689/1375] 10.222.0.30 () {58 vars in 1059 bytes} [Wed Mar 30 01:21:23 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:21:23.294324 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d477057-d048-49be-8445-78eed87c3aaa None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:21:23.305677 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d477057-d048-49be-8445-78eed87c3aaa None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:21:23.309976 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19d74bc-a1ad-424a-ac78-95d6d1258481 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45219f386f0147b6bd380efe4ab62812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:21:23.310901 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d74bc-a1ad-424a-ac78-95d6d1258481 service cinder] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:21:23.311475 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d74bc-a1ad-424a-ac78-95d6d1258481 service cinder] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:21:23.311951 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d74bc-a1ad-424a-ac78-95d6d1258481 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:21:23.321714 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19d74bc-a1ad-424a-ac78-95d6d1258481 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:21:23.323434 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19d74bc-a1ad-424a-ac78-95d6d1258481 service cinder] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:21:23.333950 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 687/1376] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:21:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:21:25.169844 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585865db-d3e5-436c-89ef-30bce48ece9f None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:21:25.170431 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585865db-d3e5-436c-89ef-30bce48ece9f None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:21:25.170431 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585865db-d3e5-436c-89ef-30bce48ece9f None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:21:25.172236 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 690/1377] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:21:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:21:25.178010 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4348a-f234-4947-89f5-b26f913c8cb2 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:21:25.178521 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4348a-f234-4947-89f5-b26f913c8cb2 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:21:25.178612 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4348a-f234-4947-89f5-b26f913c8cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:21:25.197922 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-ffc4348a-f234-4947-89f5-b26f913c8cb2 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:21:25.199322 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-ffc4348a-f234-4947-89f5-b26f913c8cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:21:25.207716 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 688/1378] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:21:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:21:25.253234 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585865db-d3e5-436c-89ef-30bce48ece9f None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:21:25.268070 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585865db-d3e5-436c-89ef-30bce48ece9f None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:21:25.273611 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccda6b50-34e1-4b31-8016-bcb704a09a43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140c6d1a20e94192bde06e72040f162d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:21:25.274265 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda6b50-34e1-4b31-8016-bcb704a09a43 service nova] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:21:25.274527 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda6b50-34e1-4b31-8016-bcb704a09a43 service nova] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:21:25.274822 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda6b50-34e1-4b31-8016-bcb704a09a43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:21:25.283581 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccda6b50-34e1-4b31-8016-bcb704a09a43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:21:25.285182 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccda6b50-34e1-4b31-8016-bcb704a09a43 service nova] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:21:25.296333 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 691/1379] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:21:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:21:27.657333 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd16986-6d96-4c57-969f-f8603fbefa6d None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:21:27.657869 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd16986-6d96-4c57-969f-f8603fbefa6d None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:21:27.657869 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd16986-6d96-4c57-969f-f8603fbefa6d None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:21:27.659669 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 689/1380] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:21:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:21:27.664777 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6410719-1106-48a5-8eb1-891915f4f3a2 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:21:27.665166 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6410719-1106-48a5-8eb1-891915f4f3a2 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:21:27.665319 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6410719-1106-48a5-8eb1-891915f4f3a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:21:27.683290 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-e6410719-1106-48a5-8eb1-891915f4f3a2 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:21:27.684935 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-e6410719-1106-48a5-8eb1-891915f4f3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:21:27.692885 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 692/1381] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:21:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:21:27.737020 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd16986-6d96-4c57-969f-f8603fbefa6d None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:21:27.752036 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd16986-6d96-4c57-969f-f8603fbefa6d None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:21:27.757548 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55436e96-b50d-4e5e-becc-7d132b0e2c39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140c6d1a20e94192bde06e72040f162d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:21:27.758188 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55436e96-b50d-4e5e-becc-7d132b0e2c39 service nova] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:21:27.758471 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55436e96-b50d-4e5e-becc-7d132b0e2c39 service nova] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:21:27.758771 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55436e96-b50d-4e5e-becc-7d132b0e2c39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:21:27.767835 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55436e96-b50d-4e5e-becc-7d132b0e2c39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:21:27.769452 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55436e96-b50d-4e5e-becc-7d132b0e2c39 service nova] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:21:27.778724 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 690/1382] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:21:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:21:30.109256 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba6618f-46e3-4235-853c-7c305ca7b494 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:21:30.109859 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba6618f-46e3-4235-853c-7c305ca7b494 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:21:30.109859 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba6618f-46e3-4235-853c-7c305ca7b494 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:21:30.111599 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 693/1383] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:21:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:21:30.116838 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a373e-3043-48ee-b8f0-8d6d83ee8c8a None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:21:30.117246 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a373e-3043-48ee-b8f0-8d6d83ee8c8a None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:21:30.117398 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a373e-3043-48ee-b8f0-8d6d83ee8c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:21:30.135778 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-6e7a373e-3043-48ee-b8f0-8d6d83ee8c8a None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:21:30.136958 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-6e7a373e-3043-48ee-b8f0-8d6d83ee8c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:21:30.145181 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 691/1384] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:21:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 01:21:30.188772 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba6618f-46e3-4235-853c-7c305ca7b494 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:21:30.203344 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba6618f-46e3-4235-853c-7c305ca7b494 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:21:30.208797 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107111a7-1207-408e-8b6f-d56dc063fb96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140c6d1a20e94192bde06e72040f162d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:21:30.209443 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107111a7-1207-408e-8b6f-d56dc063fb96 service nova] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:21:30.209723 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107111a7-1207-408e-8b6f-d56dc063fb96 service nova] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:21:30.209995 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107111a7-1207-408e-8b6f-d56dc063fb96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:21:30.219390 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107111a7-1207-408e-8b6f-d56dc063fb96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:21:30.220994 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107111a7-1207-408e-8b6f-d56dc063fb96 service nova] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:21:30.230666 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 694/1385] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:21:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:21:32.553293 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d98a2d-5d3c-43f8-ad02-eb4fb4262c57 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:21:32.553830 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d98a2d-5d3c-43f8-ad02-eb4fb4262c57 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:21:32.553925 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d98a2d-5d3c-43f8-ad02-eb4fb4262c57 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:21:32.556035 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 692/1386] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:21:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:21:32.562007 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eabe50-b0df-4788-a1d9-4aed95fdfd12 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:21:32.562444 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eabe50-b0df-4788-a1d9-4aed95fdfd12 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:21:32.562752 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eabe50-b0df-4788-a1d9-4aed95fdfd12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:21:32.585255 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-98eabe50-b0df-4788-a1d9-4aed95fdfd12 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:21:32.586892 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-98eabe50-b0df-4788-a1d9-4aed95fdfd12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:21:32.597428 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 695/1387] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:21:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:21:32.645122 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d98a2d-5d3c-43f8-ad02-eb4fb4262c57 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:21:32.664402 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d98a2d-5d3c-43f8-ad02-eb4fb4262c57 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:21:32.671327 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71521d9-7667-4f40-b72d-a872b4ae58fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140c6d1a20e94192bde06e72040f162d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:21:32.672218 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71521d9-7667-4f40-b72d-a872b4ae58fb service nova] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:21:32.672584 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71521d9-7667-4f40-b72d-a872b4ae58fb service nova] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:21:32.672956 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71521d9-7667-4f40-b72d-a872b4ae58fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:21:32.683771 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71521d9-7667-4f40-b72d-a872b4ae58fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:21:32.686124 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71521d9-7667-4f40-b72d-a872b4ae58fb service nova] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:21:32.698627 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 693/1388] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:21:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 30 01:21:35.027195 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbae883-f580-4605-8f07-3ee92404be17 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:21:35.027707 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbae883-f580-4605-8f07-3ee92404be17 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:21:35.028092 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbae883-f580-4605-8f07-3ee92404be17 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:21:35.031153 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 696/1389] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:21:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:21:35.037647 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746cb628-d12b-4972-bf3f-a2800fd5f186 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:21:35.038157 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746cb628-d12b-4972-bf3f-a2800fd5f186 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:21:35.038257 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746cb628-d12b-4972-bf3f-a2800fd5f186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:21:35.064286 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-746cb628-d12b-4972-bf3f-a2800fd5f186 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:21:35.066330 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-746cb628-d12b-4972-bf3f-a2800fd5f186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:21:35.077291 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 694/1390] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:21:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 01:21:35.135346 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbae883-f580-4605-8f07-3ee92404be17 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:21:35.150217 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbae883-f580-4605-8f07-3ee92404be17 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:21:35.156384 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b611c2f-2926-43c4-84f5-c0f4acd1a8da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140c6d1a20e94192bde06e72040f162d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:21:35.157055 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b611c2f-2926-43c4-84f5-c0f4acd1a8da service nova] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:21:35.157347 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b611c2f-2926-43c4-84f5-c0f4acd1a8da service nova] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:21:35.157618 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b611c2f-2926-43c4-84f5-c0f4acd1a8da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:21:35.168265 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b611c2f-2926-43c4-84f5-c0f4acd1a8da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:21:35.171826 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b611c2f-2926-43c4-84f5-c0f4acd1a8da service nova] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:21:35.185754 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 697/1391] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:21:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:21:37.487167 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93715624-91f5-464e-99e5-3b84404615f1 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:21:37.487809 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93715624-91f5-464e-99e5-3b84404615f1 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:21:37.487809 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93715624-91f5-464e-99e5-3b84404615f1 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:21:37.489501 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 695/1392] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:21:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:21:37.494763 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90904cff-f49a-4e9d-a607-eb1eca819a78 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:21:37.495181 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90904cff-f49a-4e9d-a607-eb1eca819a78 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:21:37.495336 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90904cff-f49a-4e9d-a607-eb1eca819a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:21:37.513882 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-90904cff-f49a-4e9d-a607-eb1eca819a78 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:21:37.515101 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-90904cff-f49a-4e9d-a607-eb1eca819a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:21:37.524157 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 698/1393] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:21:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:21:37.568795 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93715624-91f5-464e-99e5-3b84404615f1 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:21:37.583778 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93715624-91f5-464e-99e5-3b84404615f1 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:21:37.589312 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f84c1c9-1122-498e-97f5-7a28132c1b19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140c6d1a20e94192bde06e72040f162d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:21:37.589945 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f84c1c9-1122-498e-97f5-7a28132c1b19 service nova] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:21:37.590258 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f84c1c9-1122-498e-97f5-7a28132c1b19 service nova] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:21:37.590539 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f84c1c9-1122-498e-97f5-7a28132c1b19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:21:37.598634 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f84c1c9-1122-498e-97f5-7a28132c1b19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:21:37.600234 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f84c1c9-1122-498e-97f5-7a28132c1b19 service nova] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:21:37.609532 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 696/1394] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:21:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:21:39.357175 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189f71f-1626-48e5-93b0-bc28ad3c72f7 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:21:39.357760 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189f71f-1626-48e5-93b0-bc28ad3c72f7 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:21:39.357760 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189f71f-1626-48e5-93b0-bc28ad3c72f7 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:21:39.359586 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 699/1395] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:21:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:21:39.364829 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253a372-47b0-4097-a933-5e2c71199648 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:21:39.365273 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253a372-47b0-4097-a933-5e2c71199648 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:21:39.365408 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253a372-47b0-4097-a933-5e2c71199648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:21:39.383908 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-9253a372-47b0-4097-a933-5e2c71199648 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:21:39.385097 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-9253a372-47b0-4097-a933-5e2c71199648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:21:39.393619 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 697/1396] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:21:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:21:39.451370 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d57f0-abef-42e0-86ed-5b81002e8ea6 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:21:39.451660 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d57f0-abef-42e0-86ed-5b81002e8ea6 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:21:39.451942 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d57f0-abef-42e0-86ed-5b81002e8ea6 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:21:39.453756 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 700/1397] 10.222.0.30 () {54 vars in 961 bytes} [Wed Mar 30 01:21:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:21:39.458974 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81913fc4-c23c-44ea-8a0b-ca5751d0bb9a None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:21:39.459347 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81913fc4-c23c-44ea-8a0b-ca5751d0bb9a None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:21:39.459700 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81913fc4-c23c-44ea-8a0b-ca5751d0bb9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:21:39.507451 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-81913fc4-c23c-44ea-8a0b-ca5751d0bb9a None None] MFA Rules not processed for user `ebf28c0ec3d94fb99bcd573dd8dd0e30`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:21:39.508676 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-81913fc4-c23c-44ea-8a0b-ca5751d0bb9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:21:39.568633 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 698/1398] 10.222.0.30 () {58 vars in 1058 bytes} [Wed Mar 30 01:21:39 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:21:39.576521 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d57f0-abef-42e0-86ed-5b81002e8ea6 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:21:39.587572 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d57f0-abef-42e0-86ed-5b81002e8ea6 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:21:39.591376 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57042a32-9d45-4611-bc63-b4001a237f12 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf28c0ec3d94fb99bcd573dd8dd0e30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:21:39.592119 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57042a32-9d45-4611-bc63-b4001a237f12 service glance] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:21:39.592468 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57042a32-9d45-4611-bc63-b4001a237f12 service glance] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:21:39.592811 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57042a32-9d45-4611-bc63-b4001a237f12 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:21:39.602500 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57042a32-9d45-4611-bc63-b4001a237f12 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:21:39.604043 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57042a32-9d45-4611-bc63-b4001a237f12 service glance] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:21:39.614331 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 701/1399] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:21:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 30 01:21:39.942401 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a514a8-4c39-42f8-96c5-b09aa4692cfa None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:21:39.942692 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a514a8-4c39-42f8-96c5-b09aa4692cfa None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:21:39.943011 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a514a8-4c39-42f8-96c5-b09aa4692cfa None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:21:39.944775 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 699/1400] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:21:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:21:39.950130 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e0accb-4bf9-4bdb-aed2-4ac11db1ee51 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:21:39.950441 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e0accb-4bf9-4bdb-aed2-4ac11db1ee51 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:21:39.950734 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e0accb-4bf9-4bdb-aed2-4ac11db1ee51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:21:39.969617 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-45e0accb-4bf9-4bdb-aed2-4ac11db1ee51 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:21:39.970842 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-45e0accb-4bf9-4bdb-aed2-4ac11db1ee51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:21:39.978628 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 702/1401] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:21:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:21:40.023928 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a514a8-4c39-42f8-96c5-b09aa4692cfa None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:21:40.039139 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a514a8-4c39-42f8-96c5-b09aa4692cfa None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:21:40.045534 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84243a2f-fd7c-4f11-bbeb-914a6df7a718 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140c6d1a20e94192bde06e72040f162d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:21:40.046175 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84243a2f-fd7c-4f11-bbeb-914a6df7a718 service nova] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:21:40.046451 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84243a2f-fd7c-4f11-bbeb-914a6df7a718 service nova] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:21:40.046751 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84243a2f-fd7c-4f11-bbeb-914a6df7a718 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:21:40.058266 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84243a2f-fd7c-4f11-bbeb-914a6df7a718 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:21:40.059934 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84243a2f-fd7c-4f11-bbeb-914a6df7a718 service nova] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:21:40.062305 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30742e-85e8-4371-adbc-c483491ed925 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:21:40.062600 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30742e-85e8-4371-adbc-c483491ed925 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:21:40.062912 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30742e-85e8-4371-adbc-c483491ed925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:21:40.070399 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 700/1402] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:21:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:21:40.117252 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-9c30742e-85e8-4371-adbc-c483491ed925 None None] MFA Rules not processed for user `0503fdca7f834ef0a81422804dc74812`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:21:40.118462 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-9c30742e-85e8-4371-adbc-c483491ed925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:21:40.187689 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 703/1403] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Mar 30 01:21:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 01:21:40.231860 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec6816-9716-41af-81bc-681e5b9289d6 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:21:40.232140 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec6816-9716-41af-81bc-681e5b9289d6 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:21:40.232587 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec6816-9716-41af-81bc-681e5b9289d6 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:21:40.234399 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 701/1404] 10.222.0.30 () {54 vars in 942 bytes} [Wed Mar 30 01:21:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 01:21:40.241433 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f31a0-3cd9-481d-871f-e7ff323d2642 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:21:40.241754 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f31a0-3cd9-481d-871f-e7ff323d2642 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:21:40.242034 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f31a0-3cd9-481d-871f-e7ff323d2642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:21:40.295178 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-0f0f31a0-3cd9-481d-871f-e7ff323d2642 None None] MFA Rules not processed for user `76f16de81dfb4c14b027cd6cd1e6ff2c`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:21:40.296407 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-0f0f31a0-3cd9-481d-871f-e7ff323d2642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:21:40.368849 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 704/1405] 10.222.0.30 () {58 vars in 1039 bytes} [Wed Mar 30 01:21:40 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:21:40.378788 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec6816-9716-41af-81bc-681e5b9289d6 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:21:40.392776 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec6816-9716-41af-81bc-681e5b9289d6 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:21:40.397704 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f933481-2da7-400a-9e42-0a6415d9c420 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f16de81dfb4c14b027cd6cd1e6ff2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:21:40.398407 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f933481-2da7-400a-9e42-0a6415d9c420 service swift] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:21:40.398794 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f933481-2da7-400a-9e42-0a6415d9c420 service swift] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:21:40.399142 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f933481-2da7-400a-9e42-0a6415d9c420 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:21:40.408231 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f933481-2da7-400a-9e42-0a6415d9c420 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:21:40.409804 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f933481-2da7-400a-9e42-0a6415d9c420 service swift] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:21:40.417897 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 702/1406] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Mar 30 01:21:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 30 01:21:42.447945 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f95caf7-a7c8-4211-9925-bebaf7491491 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:21:42.448509 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f95caf7-a7c8-4211-9925-bebaf7491491 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:21:42.448509 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f95caf7-a7c8-4211-9925-bebaf7491491 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:21:42.450310 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 705/1407] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:21:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:21:42.455557 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd04e12-5c69-46c4-8289-1a0e258b3ea5 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:21:42.456411 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd04e12-5c69-46c4-8289-1a0e258b3ea5 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:21:42.456698 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd04e12-5c69-46c4-8289-1a0e258b3ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:21:42.474416 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-2cd04e12-5c69-46c4-8289-1a0e258b3ea5 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:21:42.475862 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-2cd04e12-5c69-46c4-8289-1a0e258b3ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:21:42.485450 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 703/1408] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:21:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 01:21:42.533136 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f95caf7-a7c8-4211-9925-bebaf7491491 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:21:42.549256 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f95caf7-a7c8-4211-9925-bebaf7491491 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:21:42.555895 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10821d1-3e3f-43db-b44b-18ba1de76892 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140c6d1a20e94192bde06e72040f162d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:21:42.556780 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10821d1-3e3f-43db-b44b-18ba1de76892 service nova] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:21:42.557255 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10821d1-3e3f-43db-b44b-18ba1de76892 service nova] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:21:42.557534 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10821d1-3e3f-43db-b44b-18ba1de76892 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:21:42.567194 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10821d1-3e3f-43db-b44b-18ba1de76892 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:21:42.568874 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10821d1-3e3f-43db-b44b-18ba1de76892 service nova] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:21:42.578577 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 706/1409] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:21:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:22:03.961922 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e11268-1d93-49cc-aa08-c82ad4dfeb26 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:22:03.962532 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e11268-1d93-49cc-aa08-c82ad4dfeb26 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:22:03.962532 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e11268-1d93-49cc-aa08-c82ad4dfeb26 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:22:03.964304 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 704/1410] 10.222.0.30 () {54 vars in 918 bytes} [Wed Mar 30 01:22:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:22:03.971147 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5798ef62-811d-4fae-8563-f717f5f43e92 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:22:03.971606 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5798ef62-811d-4fae-8563-f717f5f43e92 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:22:03.971718 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5798ef62-811d-4fae-8563-f717f5f43e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:22:03.989711 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-5798ef62-811d-4fae-8563-f717f5f43e92 None None] MFA Rules not processed for user `7343cd5457264dabb4c2b3a62df59431`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:22:03.990935 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-5798ef62-811d-4fae-8563-f717f5f43e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:22:04.000363 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 707/1411] 10.222.0.30 () {58 vars in 1015 bytes} [Wed Mar 30 01:22:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 01:22:04.015655 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae0fa3-4ddf-45f0-a496-ea01defc5638 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:22:04.015944 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae0fa3-4ddf-45f0-a496-ea01defc5638 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:22:04.016221 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae0fa3-4ddf-45f0-a496-ea01defc5638 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:22:04.017956 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 705/1412] 10.222.0.30 () {54 vars in 918 bytes} [Wed Mar 30 01:22:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:22:04.022402 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a7f6a-3e18-4e30-a7c5-e75855138c25 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:22:04.022685 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a7f6a-3e18-4e30-a7c5-e75855138c25 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:22:04.022988 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a7f6a-3e18-4e30-a7c5-e75855138c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:22:04.041716 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-3f4a7f6a-3e18-4e30-a7c5-e75855138c25 None None] MFA Rules not processed for user `140c6d1a20e94192bde06e72040f162d`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:22:04.042925 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-3f4a7f6a-3e18-4e30-a7c5-e75855138c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:22:04.052255 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 708/1413] 10.222.0.30 () {58 vars in 1015 bytes} [Wed Mar 30 01:22:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:22:06.859909 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c01da3-46bb-473a-b940-32b92346aa8e None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:22:06.860464 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c01da3-46bb-473a-b940-32b92346aa8e None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:22:06.860464 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c01da3-46bb-473a-b940-32b92346aa8e None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:22:06.862192 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 706/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed Mar 30 01:22:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:22:06.867296 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0699aca-927a-4a6b-90d6-c2ad8ee0e84a None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:22:06.867737 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0699aca-927a-4a6b-90d6-c2ad8ee0e84a None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:22:06.867842 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0699aca-927a-4a6b-90d6-c2ad8ee0e84a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:22:06.886042 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-f0699aca-927a-4a6b-90d6-c2ad8ee0e84a None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:22:06.887968 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-f0699aca-927a-4a6b-90d6-c2ad8ee0e84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:22:06.895793 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 709/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Mar 30 01:22:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:22:06.937504 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c01da3-46bb-473a-b940-32b92346aa8e None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:22:06.951924 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c01da3-46bb-473a-b940-32b92346aa8e None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:22:06.957251 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea2d628-f39a-4ae6-8784-9856ba919775 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140c6d1a20e94192bde06e72040f162d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:22:06.957879 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea2d628-f39a-4ae6-8784-9856ba919775 service nova] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:22:06.958162 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea2d628-f39a-4ae6-8784-9856ba919775 service nova] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:22:06.958439 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea2d628-f39a-4ae6-8784-9856ba919775 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:22:06.966724 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea2d628-f39a-4ae6-8784-9856ba919775 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:22:06.968303 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea2d628-f39a-4ae6-8784-9856ba919775 service nova] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:22:06.977407 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 707/1416] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:22:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:22:08.319893 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d9cfa-ebf5-4c4f-832e-b01b50688a72 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:22:08.320432 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d9cfa-ebf5-4c4f-832e-b01b50688a72 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:22:08.320432 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d9cfa-ebf5-4c4f-832e-b01b50688a72 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:22:08.322357 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 710/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Mar 30 01:22:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:22:08.327771 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde8485-bd19-416e-acc9-53e53e75847f None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:22:08.328274 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde8485-bd19-416e-acc9-53e53e75847f None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:22:08.328369 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde8485-bd19-416e-acc9-53e53e75847f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:22:08.345867 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-8dde8485-bd19-416e-acc9-53e53e75847f None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:22:08.347084 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-8dde8485-bd19-416e-acc9-53e53e75847f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:22:08.354746 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 708/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Mar 30 01:22:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:22:08.525053 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d9cfa-ebf5-4c4f-832e-b01b50688a72 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:22:08.539738 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d9cfa-ebf5-4c4f-832e-b01b50688a72 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:22:08.545168 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97238be2-3053-4c50-ba1f-0627bcc68d3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140c6d1a20e94192bde06e72040f162d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:22:08.545794 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97238be2-3053-4c50-ba1f-0627bcc68d3a service nova] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:22:08.546074 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97238be2-3053-4c50-ba1f-0627bcc68d3a service nova] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:22:08.546355 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97238be2-3053-4c50-ba1f-0627bcc68d3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:22:08.558526 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97238be2-3053-4c50-ba1f-0627bcc68d3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:22:08.560675 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97238be2-3053-4c50-ba1f-0627bcc68d3a service nova] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:22:08.571103 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 711/1419] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:22:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:22:09.872638 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfebf5ac-4795-4531-bb2f-dbe859349a28 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:22:09.873198 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfebf5ac-4795-4531-bb2f-dbe859349a28 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:22:09.873198 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfebf5ac-4795-4531-bb2f-dbe859349a28 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:22:09.874909 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 709/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Mar 30 01:22:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:22:09.879785 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba3510-016b-4915-badf-7ecb400d5c39 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:22:09.880186 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba3510-016b-4915-badf-7ecb400d5c39 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:22:09.880464 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba3510-016b-4915-badf-7ecb400d5c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:22:09.898784 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-e1ba3510-016b-4915-badf-7ecb400d5c39 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:22:09.899964 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-e1ba3510-016b-4915-badf-7ecb400d5c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:22:09.908047 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 712/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Mar 30 01:22:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 01:22:10.060260 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfebf5ac-4795-4531-bb2f-dbe859349a28 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:22:10.074205 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfebf5ac-4795-4531-bb2f-dbe859349a28 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:22:10.080245 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a629e12a-8d93-45a6-b70c-170ea8a60a61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140c6d1a20e94192bde06e72040f162d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:22:10.080875 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629e12a-8d93-45a6-b70c-170ea8a60a61 service nova] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:22:10.081158 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629e12a-8d93-45a6-b70c-170ea8a60a61 service nova] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:22:10.081433 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629e12a-8d93-45a6-b70c-170ea8a60a61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:22:10.089300 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a629e12a-8d93-45a6-b70c-170ea8a60a61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:22:10.090903 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a629e12a-8d93-45a6-b70c-170ea8a60a61 service nova] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:22:10.100635 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 710/1422] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:22:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:22:11.396641 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ad33b-2332-4d50-a5e3-7d8b9b00158b None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:22:11.397215 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ad33b-2332-4d50-a5e3-7d8b9b00158b None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:22:11.397215 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ad33b-2332-4d50-a5e3-7d8b9b00158b None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:22:11.398969 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 713/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Mar 30 01:22:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:22:11.403999 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d4968-27d3-4017-b7fe-869384dc1e37 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:22:11.404448 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d4968-27d3-4017-b7fe-869384dc1e37 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:22:11.404552 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d4968-27d3-4017-b7fe-869384dc1e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:22:11.422766 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-659d4968-27d3-4017-b7fe-869384dc1e37 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:22:11.423980 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-659d4968-27d3-4017-b7fe-869384dc1e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:22:11.431712 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 711/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Mar 30 01:22:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:22:11.582263 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24ad33b-2332-4d50-a5e3-7d8b9b00158b None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:22:11.596739 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24ad33b-2332-4d50-a5e3-7d8b9b00158b None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:22:11.602073 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95149c7b-def9-478a-8a83-6a61490a2275 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140c6d1a20e94192bde06e72040f162d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:22:11.602695 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95149c7b-def9-478a-8a83-6a61490a2275 service nova] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:22:11.603001 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95149c7b-def9-478a-8a83-6a61490a2275 service nova] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:22:11.603279 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95149c7b-def9-478a-8a83-6a61490a2275 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:22:11.612202 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95149c7b-def9-478a-8a83-6a61490a2275 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:22:11.613778 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95149c7b-def9-478a-8a83-6a61490a2275 service nova] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:22:11.623312 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 714/1425] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:22:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:22:12.939782 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e2d1b-ba78-4bed-9fe8-967aecb89321 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:22:12.940311 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e2d1b-ba78-4bed-9fe8-967aecb89321 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:22:12.940311 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e2d1b-ba78-4bed-9fe8-967aecb89321 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:22:12.942014 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 712/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Mar 30 01:22:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:22:12.947277 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0b886-064a-41a4-8c66-ed23b2b4e27d None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:22:12.947687 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0b886-064a-41a4-8c66-ed23b2b4e27d None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:22:12.947829 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0b886-064a-41a4-8c66-ed23b2b4e27d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:22:12.965844 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-4ef0b886-064a-41a4-8c66-ed23b2b4e27d None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:22:12.967040 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-4ef0b886-064a-41a4-8c66-ed23b2b4e27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:22:12.974603 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 715/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Mar 30 01:22:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:22:13.124639 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864e2d1b-ba78-4bed-9fe8-967aecb89321 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:22:13.139065 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864e2d1b-ba78-4bed-9fe8-967aecb89321 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:22:13.144320 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbcacb1-b63c-4a53-9eee-f59d3d0496c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140c6d1a20e94192bde06e72040f162d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:22:13.144977 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbcacb1-b63c-4a53-9eee-f59d3d0496c4 service nova] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:22:13.145257 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbcacb1-b63c-4a53-9eee-f59d3d0496c4 service nova] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:22:13.145528 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbcacb1-b63c-4a53-9eee-f59d3d0496c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:22:13.153492 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbcacb1-b63c-4a53-9eee-f59d3d0496c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:22:13.155344 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbcacb1-b63c-4a53-9eee-f59d3d0496c4 service nova] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:22:13.164393 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 713/1428] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:22:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:22:14.401953 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c305ebfb-6dcf-40ff-af6d-a3904a579ba3 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:22:14.403025 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c305ebfb-6dcf-40ff-af6d-a3904a579ba3 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:22:14.403025 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c305ebfb-6dcf-40ff-af6d-a3904a579ba3 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:22:14.404925 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 716/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Mar 30 01:22:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:22:14.410285 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac52a5e2-1128-4907-ac4d-a2232a26ae1b None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:22:14.410683 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac52a5e2-1128-4907-ac4d-a2232a26ae1b None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:22:14.410878 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac52a5e2-1128-4907-ac4d-a2232a26ae1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:22:14.429358 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-ac52a5e2-1128-4907-ac4d-a2232a26ae1b None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:22:14.430558 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-ac52a5e2-1128-4907-ac4d-a2232a26ae1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:22:14.438796 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 714/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Mar 30 01:22:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:22:14.587823 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c305ebfb-6dcf-40ff-af6d-a3904a579ba3 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:22:14.602184 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c305ebfb-6dcf-40ff-af6d-a3904a579ba3 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:22:14.608112 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29457f40-9323-447a-8428-6e58d54190f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140c6d1a20e94192bde06e72040f162d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:22:14.608735 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29457f40-9323-447a-8428-6e58d54190f1 service nova] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:22:14.609013 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29457f40-9323-447a-8428-6e58d54190f1 service nova] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:22:14.609284 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29457f40-9323-447a-8428-6e58d54190f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:22:14.618874 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29457f40-9323-447a-8428-6e58d54190f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:22:14.620464 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29457f40-9323-447a-8428-6e58d54190f1 service nova] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:22:14.630344 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 717/1431] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:22:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:22:15.876084 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4488feb-bb09-432d-8b15-4a5259afd2dd None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:22:15.876658 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4488feb-bb09-432d-8b15-4a5259afd2dd None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:22:15.876658 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4488feb-bb09-432d-8b15-4a5259afd2dd None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:22:15.878413 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 715/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Mar 30 01:22:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:22:15.883493 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d607d1-486d-48a1-9c8e-ac8245123c1c None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:22:15.883916 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d607d1-486d-48a1-9c8e-ac8245123c1c None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:22:15.884029 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d607d1-486d-48a1-9c8e-ac8245123c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:22:15.902352 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-d0d607d1-486d-48a1-9c8e-ac8245123c1c None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:22:15.903772 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-d0d607d1-486d-48a1-9c8e-ac8245123c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:22:15.911614 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 718/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Mar 30 01:22:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:22:16.062032 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4488feb-bb09-432d-8b15-4a5259afd2dd None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:22:16.077088 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4488feb-bb09-432d-8b15-4a5259afd2dd None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:22:16.082504 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf9410c-7f75-442f-8d5e-708805be896d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140c6d1a20e94192bde06e72040f162d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:22:16.083171 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9410c-7f75-442f-8d5e-708805be896d service nova] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:22:16.083457 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9410c-7f75-442f-8d5e-708805be896d service nova] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:22:16.083735 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9410c-7f75-442f-8d5e-708805be896d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:22:16.092008 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf9410c-7f75-442f-8d5e-708805be896d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:22:16.093536 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf9410c-7f75-442f-8d5e-708805be896d service nova] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:22:16.102903 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 716/1434] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:22:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:22:17.337079 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9a77f-fcb9-4942-9104-09d1178c00e2 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:22:17.337594 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9a77f-fcb9-4942-9104-09d1178c00e2 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:22:17.337594 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9a77f-fcb9-4942-9104-09d1178c00e2 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:22:17.339343 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 719/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Mar 30 01:22:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:22:17.344843 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d654e7b-efc9-4f51-87c5-34ee1f118c57 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:22:17.345306 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d654e7b-efc9-4f51-87c5-34ee1f118c57 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:22:17.345405 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d654e7b-efc9-4f51-87c5-34ee1f118c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:22:17.363460 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-4d654e7b-efc9-4f51-87c5-34ee1f118c57 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:22:17.364632 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-4d654e7b-efc9-4f51-87c5-34ee1f118c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:22:17.373001 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 717/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Mar 30 01:22:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:22:17.523059 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb9a77f-fcb9-4942-9104-09d1178c00e2 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:22:17.538928 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb9a77f-fcb9-4942-9104-09d1178c00e2 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:22:17.545332 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538a67c7-b533-45d2-baaf-7285d73c26a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140c6d1a20e94192bde06e72040f162d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:22:17.545999 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a67c7-b533-45d2-baaf-7285d73c26a1 service nova] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:22:17.546278 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a67c7-b533-45d2-baaf-7285d73c26a1 service nova] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:22:17.546550 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a67c7-b533-45d2-baaf-7285d73c26a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:22:17.555711 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538a67c7-b533-45d2-baaf-7285d73c26a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:22:17.557338 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538a67c7-b533-45d2-baaf-7285d73c26a1 service nova] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:22:17.568335 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 720/1437] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:22:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:22:18.820506 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85178cdf-eb80-41f6-bd01-0dd1c958a320 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:22:18.821061 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85178cdf-eb80-41f6-bd01-0dd1c958a320 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:22:18.821061 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85178cdf-eb80-41f6-bd01-0dd1c958a320 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:22:18.822856 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 718/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Mar 30 01:22:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:22:18.827913 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec7b89-f0d0-48c4-9e08-ee1584db6858 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:22:18.828318 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec7b89-f0d0-48c4-9e08-ee1584db6858 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:22:18.828470 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec7b89-f0d0-48c4-9e08-ee1584db6858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:22:18.847135 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-2bec7b89-f0d0-48c4-9e08-ee1584db6858 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:22:18.848321 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-2bec7b89-f0d0-48c4-9e08-ee1584db6858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:22:18.857131 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 721/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Mar 30 01:22:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:22:19.006091 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85178cdf-eb80-41f6-bd01-0dd1c958a320 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:22:19.019966 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85178cdf-eb80-41f6-bd01-0dd1c958a320 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:22:19.025318 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ad7eb-82ca-436b-8f60-7dd5e87dd901 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140c6d1a20e94192bde06e72040f162d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:22:19.025948 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ad7eb-82ca-436b-8f60-7dd5e87dd901 service nova] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:22:19.026235 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ad7eb-82ca-436b-8f60-7dd5e87dd901 service nova] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:22:19.026517 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ad7eb-82ca-436b-8f60-7dd5e87dd901 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:22:19.035482 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72ad7eb-82ca-436b-8f60-7dd5e87dd901 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:22:19.037038 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72ad7eb-82ca-436b-8f60-7dd5e87dd901 service nova] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:22:19.047086 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 719/1440] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:22:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:22:21.278768 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a73b9d5-a598-4d01-885d-55a9109d826e None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:22:21.279313 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a73b9d5-a598-4d01-885d-55a9109d826e None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:22:21.279313 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a73b9d5-a598-4d01-885d-55a9109d826e None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:22:21.281361 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 722/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed Mar 30 01:22:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:22:21.286592 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb28622-41ec-446f-a92b-ee2180a6fb2a None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:22:21.287023 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb28622-41ec-446f-a92b-ee2180a6fb2a None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:22:21.287178 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb28622-41ec-446f-a92b-ee2180a6fb2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:22:21.305021 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-3fb28622-41ec-446f-a92b-ee2180a6fb2a None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:22:21.306191 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-3fb28622-41ec-446f-a92b-ee2180a6fb2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:22:21.313940 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 720/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Mar 30 01:22:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:22:21.351310 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a73b9d5-a598-4d01-885d-55a9109d826e None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:22:21.362336 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a73b9d5-a598-4d01-885d-55a9109d826e None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:22:21.365773 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f81da0-e4ee-4572-94fc-f02cdd672fcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:22:21.366389 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f81da0-e4ee-4572-94fc-f02cdd672fcc service neutron] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:22:21.366668 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f81da0-e4ee-4572-94fc-f02cdd672fcc service neutron] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:22:21.366971 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f81da0-e4ee-4572-94fc-f02cdd672fcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:22:21.375609 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f81da0-e4ee-4572-94fc-f02cdd672fcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:22:21.377027 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f81da0-e4ee-4572-94fc-f02cdd672fcc service neutron] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:22:21.386066 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 723/1443] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:22:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:22:23.842481 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc3336b-365c-40e8-9325-392eeea45fcf None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:22:23.843087 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc3336b-365c-40e8-9325-392eeea45fcf None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:22:23.843087 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc3336b-365c-40e8-9325-392eeea45fcf None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:22:23.844852 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 721/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed Mar 30 01:22:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:22:23.850085 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb7362e-31a8-49e8-9522-60d4af1f1297 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:22:23.850514 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb7362e-31a8-49e8-9522-60d4af1f1297 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:22:23.850636 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb7362e-31a8-49e8-9522-60d4af1f1297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:22:23.868150 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-8fb7362e-31a8-49e8-9522-60d4af1f1297 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:22:23.869376 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-8fb7362e-31a8-49e8-9522-60d4af1f1297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:22:23.877040 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 724/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Mar 30 01:22:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:22:23.915885 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc3336b-365c-40e8-9325-392eeea45fcf None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:22:23.926332 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc3336b-365c-40e8-9325-392eeea45fcf None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:22:23.929826 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad77ee7a-feb1-4940-ae56-297b767750ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:22:23.930445 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77ee7a-feb1-4940-ae56-297b767750ad service neutron] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:22:23.930742 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77ee7a-feb1-4940-ae56-297b767750ad service neutron] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:22:23.931019 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77ee7a-feb1-4940-ae56-297b767750ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:22:23.939772 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad77ee7a-feb1-4940-ae56-297b767750ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:22:23.941177 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad77ee7a-feb1-4940-ae56-297b767750ad service neutron] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:22:23.950763 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 722/1446] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:22:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:22:26.507120 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4caed32-2173-49c6-a624-177546aa8437 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:22:26.507743 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4caed32-2173-49c6-a624-177546aa8437 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:22:26.507743 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4caed32-2173-49c6-a624-177546aa8437 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:22:26.509505 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 725/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed Mar 30 01:22:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:22:26.516015 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289a8e9-2182-417f-bcef-a61b0afaab89 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:22:26.516456 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289a8e9-2182-417f-bcef-a61b0afaab89 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:22:26.516550 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289a8e9-2182-417f-bcef-a61b0afaab89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:22:26.534603 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-0289a8e9-2182-417f-bcef-a61b0afaab89 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:22:26.535808 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-0289a8e9-2182-417f-bcef-a61b0afaab89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:22:26.543554 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 723/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Mar 30 01:22:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:22:26.583695 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4caed32-2173-49c6-a624-177546aa8437 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:22:26.585328 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-c4caed32-2173-49c6-a624-177546aa8437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:22:26.597879 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4caed32-2173-49c6-a624-177546aa8437 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:22:26.601318 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb83f5e0-62e8-46a5-aaf4-a816efae5a58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:22:26.601937 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83f5e0-62e8-46a5-aaf4-a816efae5a58 service neutron] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:22:26.602214 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83f5e0-62e8-46a5-aaf4-a816efae5a58 service neutron] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:22:26.602484 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83f5e0-62e8-46a5-aaf4-a816efae5a58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:22:26.611157 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb83f5e0-62e8-46a5-aaf4-a816efae5a58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:22:26.612573 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb83f5e0-62e8-46a5-aaf4-a816efae5a58 service neutron] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:22:26.622648 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 726/1449] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:22:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:22:29.014898 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb7aa0-47fe-49dd-862c-bd105e3710fa None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:22:29.015437 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb7aa0-47fe-49dd-862c-bd105e3710fa None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:22:29.015437 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb7aa0-47fe-49dd-862c-bd105e3710fa None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:22:29.017219 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 724/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed Mar 30 01:22:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:22:29.022314 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74e50b-bff2-444a-8300-8ca1b37f4571 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:22:29.022751 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74e50b-bff2-444a-8300-8ca1b37f4571 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:22:29.022889 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74e50b-bff2-444a-8300-8ca1b37f4571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:22:29.041946 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-dd74e50b-bff2-444a-8300-8ca1b37f4571 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:22:29.043762 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-dd74e50b-bff2-444a-8300-8ca1b37f4571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:22:29.054369 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 727/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Mar 30 01:22:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:22:29.089267 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fb7aa0-47fe-49dd-862c-bd105e3710fa None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:22:29.100153 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fb7aa0-47fe-49dd-862c-bd105e3710fa None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:22:29.103680 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b60e53-f27c-4aa7-9a1b-683705bf553a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:22:29.104311 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b60e53-f27c-4aa7-9a1b-683705bf553a service neutron] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:22:29.104594 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b60e53-f27c-4aa7-9a1b-683705bf553a service neutron] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:22:29.104872 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b60e53-f27c-4aa7-9a1b-683705bf553a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:22:29.114334 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b60e53-f27c-4aa7-9a1b-683705bf553a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:22:29.115775 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b60e53-f27c-4aa7-9a1b-683705bf553a service neutron] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:22:29.125911 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 725/1452] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:22:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:22:31.466994 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e8e9f3-11e4-40d1-ba2f-5c543d311299 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:22:31.467559 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e8e9f3-11e4-40d1-ba2f-5c543d311299 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:22:31.467559 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e8e9f3-11e4-40d1-ba2f-5c543d311299 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:22:31.469370 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 728/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed Mar 30 01:22:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:22:31.474621 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5673f5-78f2-4596-993e-4aee199e5d15 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:22:31.475095 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5673f5-78f2-4596-993e-4aee199e5d15 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:22:31.475211 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5673f5-78f2-4596-993e-4aee199e5d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:22:31.493867 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-db5673f5-78f2-4596-993e-4aee199e5d15 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:22:31.495085 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-db5673f5-78f2-4596-993e-4aee199e5d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:22:31.503411 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 726/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Mar 30 01:22:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:22:31.541636 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e8e9f3-11e4-40d1-ba2f-5c543d311299 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:22:31.552887 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e8e9f3-11e4-40d1-ba2f-5c543d311299 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:22:31.556413 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42247877-a8a1-4348-a8ff-79a90ff148f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:22:31.557042 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42247877-a8a1-4348-a8ff-79a90ff148f3 service neutron] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:22:31.557325 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42247877-a8a1-4348-a8ff-79a90ff148f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:22:31.557599 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42247877-a8a1-4348-a8ff-79a90ff148f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:22:31.566369 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42247877-a8a1-4348-a8ff-79a90ff148f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:22:31.567831 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42247877-a8a1-4348-a8ff-79a90ff148f3 service neutron] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:22:31.577002 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 729/1455] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:22:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:22:33.905092 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c5c5e-b0f7-4afd-bcbf-5b2bc87bec13 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:22:33.905865 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c5c5e-b0f7-4afd-bcbf-5b2bc87bec13 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:22:33.905865 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c5c5e-b0f7-4afd-bcbf-5b2bc87bec13 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:22:33.907635 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 727/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed Mar 30 01:22:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 01:22:33.912854 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc435df-6cd5-4ff5-9023-873219201043 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:22:33.913276 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc435df-6cd5-4ff5-9023-873219201043 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:22:33.913412 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc435df-6cd5-4ff5-9023-873219201043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:22:33.931623 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-fcc435df-6cd5-4ff5-9023-873219201043 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:22:33.932817 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-fcc435df-6cd5-4ff5-9023-873219201043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:22:33.940708 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 730/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Mar 30 01:22:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:22:33.978804 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66c5c5e-b0f7-4afd-bcbf-5b2bc87bec13 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:22:33.990178 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66c5c5e-b0f7-4afd-bcbf-5b2bc87bec13 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:22:33.993633 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1308685-8177-478f-a786-7677c601fbc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:22:33.994259 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1308685-8177-478f-a786-7677c601fbc6 service neutron] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:22:33.994540 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1308685-8177-478f-a786-7677c601fbc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:22:33.994864 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1308685-8177-478f-a786-7677c601fbc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:22:34.003838 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1308685-8177-478f-a786-7677c601fbc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:22:34.005246 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1308685-8177-478f-a786-7677c601fbc6 service neutron] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:22:34.014649 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 728/1458] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:22:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:22:36.383463 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a75d0a7-37d2-4867-a0dc-20b8108e8792 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:22:36.384033 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a75d0a7-37d2-4867-a0dc-20b8108e8792 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:22:36.384033 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a75d0a7-37d2-4867-a0dc-20b8108e8792 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:22:36.385840 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 731/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed Mar 30 01:22:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:22:36.391656 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3567a-4f5a-4b2e-bb1c-780755f26cc5 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:22:36.392105 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3567a-4f5a-4b2e-bb1c-780755f26cc5 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:22:36.392204 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3567a-4f5a-4b2e-bb1c-780755f26cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:22:36.409951 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-bfe3567a-4f5a-4b2e-bb1c-780755f26cc5 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:22:36.411179 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-bfe3567a-4f5a-4b2e-bb1c-780755f26cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:22:36.419459 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 729/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Mar 30 01:22:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:22:36.456479 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a75d0a7-37d2-4867-a0dc-20b8108e8792 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:22:36.467819 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a75d0a7-37d2-4867-a0dc-20b8108e8792 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:22:36.471365 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d915c3-f254-4bf8-8dae-776e9952db02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:22:36.471996 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d915c3-f254-4bf8-8dae-776e9952db02 service neutron] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:22:36.472280 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d915c3-f254-4bf8-8dae-776e9952db02 service neutron] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:22:36.472559 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d915c3-f254-4bf8-8dae-776e9952db02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:22:36.481915 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d915c3-f254-4bf8-8dae-776e9952db02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:22:36.483397 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d915c3-f254-4bf8-8dae-776e9952db02 service neutron] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:22:36.493387 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 732/1461] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:22:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 30 01:22:38.843800 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c238264-aa81-4ea3-9cc3-551d7755992a None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:22:38.844343 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c238264-aa81-4ea3-9cc3-551d7755992a None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:22:38.844343 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c238264-aa81-4ea3-9cc3-551d7755992a None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:22:38.846106 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 730/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed Mar 30 01:22:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:22:38.851421 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953ef5c-3323-4bd9-9273-ce021a66fa2d None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:22:38.851862 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953ef5c-3323-4bd9-9273-ce021a66fa2d None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:22:38.851982 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953ef5c-3323-4bd9-9273-ce021a66fa2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:22:38.869664 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-c953ef5c-3323-4bd9-9273-ce021a66fa2d None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:22:38.870833 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-c953ef5c-3323-4bd9-9273-ce021a66fa2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:22:38.878750 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 733/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Mar 30 01:22:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:22:38.916210 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c238264-aa81-4ea3-9cc3-551d7755992a None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:22:38.926589 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c238264-aa81-4ea3-9cc3-551d7755992a None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:22:38.929995 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a16b9-aa82-44ef-baa4-44f8e1d7219b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:22:38.930613 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a16b9-aa82-44ef-baa4-44f8e1d7219b service neutron] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:22:38.930933 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a16b9-aa82-44ef-baa4-44f8e1d7219b service neutron] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:22:38.931207 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a16b9-aa82-44ef-baa4-44f8e1d7219b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:22:38.939720 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912a16b9-aa82-44ef-baa4-44f8e1d7219b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:22:38.941120 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912a16b9-aa82-44ef-baa4-44f8e1d7219b service neutron] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:22:38.950626 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 731/1464] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:22:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:22:41.235357 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ce4e6-c94d-4a5f-bc89-49126dcb4dc6 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:22:41.235931 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ce4e6-c94d-4a5f-bc89-49126dcb4dc6 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:22:41.235931 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ce4e6-c94d-4a5f-bc89-49126dcb4dc6 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:22:41.237810 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 734/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed Mar 30 01:22:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:22:41.243057 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633f275-49ba-4062-9722-1f70a56c4698 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:22:41.243441 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633f275-49ba-4062-9722-1f70a56c4698 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:22:41.243616 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633f275-49ba-4062-9722-1f70a56c4698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:22:41.261937 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-b633f275-49ba-4062-9722-1f70a56c4698 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:22:41.263164 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-b633f275-49ba-4062-9722-1f70a56c4698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:22:41.271160 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 732/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Mar 30 01:22:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:22:41.307943 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8ce4e6-c94d-4a5f-bc89-49126dcb4dc6 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:22:41.318408 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8ce4e6-c94d-4a5f-bc89-49126dcb4dc6 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:22:41.321828 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e58478-7173-4469-bebe-3a91c900e29d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:22:41.322446 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e58478-7173-4469-bebe-3a91c900e29d service neutron] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:22:41.322758 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e58478-7173-4469-bebe-3a91c900e29d service neutron] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:22:41.323036 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e58478-7173-4469-bebe-3a91c900e29d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:22:41.331820 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e58478-7173-4469-bebe-3a91c900e29d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:22:41.333248 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e58478-7173-4469-bebe-3a91c900e29d service neutron] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:22:41.342920 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 735/1467] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:22:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:22:43.611508 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836e446-21bb-47eb-b785-937daf47ef98 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:22:43.612069 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836e446-21bb-47eb-b785-937daf47ef98 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:22:43.612069 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836e446-21bb-47eb-b785-937daf47ef98 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:22:43.613936 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 733/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed Mar 30 01:22:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:22:43.619827 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b059f-f798-498a-bd98-ca1f3fb01837 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:22:43.619827 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b059f-f798-498a-bd98-ca1f3fb01837 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:22:43.619827 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b059f-f798-498a-bd98-ca1f3fb01837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:22:43.637226 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-408b059f-f798-498a-bd98-ca1f3fb01837 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:22:43.638403 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-408b059f-f798-498a-bd98-ca1f3fb01837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:22:43.646016 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 736/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Mar 30 01:22:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:22:43.684099 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2836e446-21bb-47eb-b785-937daf47ef98 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:22:43.694429 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2836e446-21bb-47eb-b785-937daf47ef98 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:22:43.697886 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30487e7c-07ee-437b-a181-02192390f177 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:22:43.698509 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30487e7c-07ee-437b-a181-02192390f177 service neutron] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:22:43.698820 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30487e7c-07ee-437b-a181-02192390f177 service neutron] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:22:43.699094 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30487e7c-07ee-437b-a181-02192390f177 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:22:43.708355 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30487e7c-07ee-437b-a181-02192390f177 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:22:43.709752 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30487e7c-07ee-437b-a181-02192390f177 service neutron] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:22:43.719810 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 734/1470] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:22:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:23:04.566423 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30dae4-14d1-4854-aa36-4de4b9558ec7 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:23:04.567056 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30dae4-14d1-4854-aa36-4de4b9558ec7 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:23:04.567056 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30dae4-14d1-4854-aa36-4de4b9558ec7 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:23:04.568755 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 737/1471] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:23:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:23:04.574151 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c24a5-188e-40fb-a594-048c8705af73 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:23:04.574754 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c24a5-188e-40fb-a594-048c8705af73 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:23:04.574754 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c24a5-188e-40fb-a594-048c8705af73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:23:04.592491 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-ac2c24a5-188e-40fb-a594-048c8705af73 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:23:04.593666 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-ac2c24a5-188e-40fb-a594-048c8705af73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:23:04.601429 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 735/1472] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:23:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:23:04.649812 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b295981-e6b0-4571-806b-0ab84e5164a7 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:23:04.650097 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b295981-e6b0-4571-806b-0ab84e5164a7 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:23:04.650369 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b295981-e6b0-4571-806b-0ab84e5164a7 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:23:04.652399 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 738/1473] 10.222.0.30 () {54 vars in 961 bytes} [Wed Mar 30 01:23:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:23:04.657536 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba68e3-8cd2-4bb0-ad63-c2629e87796b None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:23:04.657821 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba68e3-8cd2-4bb0-ad63-c2629e87796b None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:23:04.658108 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba68e3-8cd2-4bb0-ad63-c2629e87796b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:23:04.676412 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-8fba68e3-8cd2-4bb0-ad63-c2629e87796b None None] MFA Rules not processed for user `ebf28c0ec3d94fb99bcd573dd8dd0e30`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:23:04.677585 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-8fba68e3-8cd2-4bb0-ad63-c2629e87796b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:23:04.684910 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 736/1474] 10.222.0.30 () {58 vars in 1058 bytes} [Wed Mar 30 01:23:04 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 01:23:04.691948 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b295981-e6b0-4571-806b-0ab84e5164a7 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:23:04.702817 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b295981-e6b0-4571-806b-0ab84e5164a7 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:23:04.706237 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f239a8e-28e8-42cf-9a30-4f1dea4e89e7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf28c0ec3d94fb99bcd573dd8dd0e30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:23:04.706892 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f239a8e-28e8-42cf-9a30-4f1dea4e89e7 service glance] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:23:04.707173 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f239a8e-28e8-42cf-9a30-4f1dea4e89e7 service glance] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:23:04.707444 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f239a8e-28e8-42cf-9a30-4f1dea4e89e7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:23:04.716254 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f239a8e-28e8-42cf-9a30-4f1dea4e89e7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:23:04.717661 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f239a8e-28e8-42cf-9a30-4f1dea4e89e7 service glance] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:23:04.726661 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 739/1475] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:23:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:23:07.117386 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c4e574-3d92-4588-81f1-2fce78febca3 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:23:07.117944 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c4e574-3d92-4588-81f1-2fce78febca3 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:23:07.117944 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c4e574-3d92-4588-81f1-2fce78febca3 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:23:07.119758 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 737/1476] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:23:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:23:07.125489 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb3863-c996-423f-965e-e0496a146ade None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:23:07.125935 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb3863-c996-423f-965e-e0496a146ade None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:23:07.126038 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb3863-c996-423f-965e-e0496a146ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:23:07.144383 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-83fb3863-c996-423f-965e-e0496a146ade None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:23:07.145580 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-83fb3863-c996-423f-965e-e0496a146ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:23:07.153823 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 740/1477] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:23:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:23:07.186109 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c4e574-3d92-4588-81f1-2fce78febca3 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:23:07.210483 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c4e574-3d92-4588-81f1-2fce78febca3 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:23:07.215525 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee39d9f-27be-41e8-a415-83d71f827849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:23:07.216314 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee39d9f-27be-41e8-a415-83d71f827849 admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:23:07.216614 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee39d9f-27be-41e8-a415-83d71f827849 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:23:07.217015 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee39d9f-27be-41e8-a415-83d71f827849 admin admin] PATH_INFO: `/v3/projects` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:23:07.217966 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee39d9f-27be-41e8-a415-83d71f827849 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:23:07.220262 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING py.warnings [None req-4ee39d9f-27be-41e8-a415-83d71f827849 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 30 01:23:07.220262 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: warnings.warn(msg) Mar 30 01:23:07.220262 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: Mar 30 01:23:07.221648 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee39d9f-27be-41e8-a415-83d71f827849 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:23:07.241510 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 738/1478] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Mar 30 01:23:07 2022] GET /identity/v3/projects => generated 2553 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:23:09.553104 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd150d0-c433-43e3-b58f-c08d46bed9fd None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:23:09.553675 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd150d0-c433-43e3-b58f-c08d46bed9fd None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:23:09.553675 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd150d0-c433-43e3-b58f-c08d46bed9fd None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:23:09.555965 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 741/1479] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:23:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:23:09.561816 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a888d1da-f009-42ef-9b77-9d07b2934648 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:23:09.562261 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a888d1da-f009-42ef-9b77-9d07b2934648 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:23:09.562363 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a888d1da-f009-42ef-9b77-9d07b2934648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:23:09.580485 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-a888d1da-f009-42ef-9b77-9d07b2934648 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:23:09.581677 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-a888d1da-f009-42ef-9b77-9d07b2934648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:23:09.589468 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 739/1480] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:23:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:23:09.631530 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd150d0-c433-43e3-b58f-c08d46bed9fd None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:23:09.645369 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd150d0-c433-43e3-b58f-c08d46bed9fd None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:23:09.650634 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e6188-d60a-4019-a881-adfaf2720326 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140c6d1a20e94192bde06e72040f162d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:23:09.651293 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e6188-d60a-4019-a881-adfaf2720326 service nova] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:23:09.651574 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e6188-d60a-4019-a881-adfaf2720326 service nova] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:23:09.651850 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e6188-d60a-4019-a881-adfaf2720326 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:23:09.660759 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660e6188-d60a-4019-a881-adfaf2720326 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:23:09.662336 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660e6188-d60a-4019-a881-adfaf2720326 service nova] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:23:09.672242 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 742/1481] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:23:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:23:12.119195 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15856101-bdc0-4f01-bba0-5c7b6fc343ad None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:23:12.119760 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15856101-bdc0-4f01-bba0-5c7b6fc343ad None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:23:12.119760 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15856101-bdc0-4f01-bba0-5c7b6fc343ad None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:23:12.122035 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 740/1482] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:23:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:23:12.127340 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c169c-b863-41ea-8656-5bf25bae9df9 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:23:12.127776 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c169c-b863-41ea-8656-5bf25bae9df9 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:23:12.127879 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c169c-b863-41ea-8656-5bf25bae9df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:23:12.146792 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-173c169c-b863-41ea-8656-5bf25bae9df9 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:23:12.147994 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-173c169c-b863-41ea-8656-5bf25bae9df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:23:12.155982 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 743/1483] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:23:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:23:12.191767 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15856101-bdc0-4f01-bba0-5c7b6fc343ad None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:23:12.203037 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15856101-bdc0-4f01-bba0-5c7b6fc343ad None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:23:12.206544 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad20275-7840-4516-b189-933b36ef3b47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:23:12.207218 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad20275-7840-4516-b189-933b36ef3b47 service neutron] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:23:12.207500 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad20275-7840-4516-b189-933b36ef3b47 service neutron] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:23:12.207776 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad20275-7840-4516-b189-933b36ef3b47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:23:12.216596 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad20275-7840-4516-b189-933b36ef3b47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:23:12.218026 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad20275-7840-4516-b189-933b36ef3b47 service neutron] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:23:12.227434 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 741/1484] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:23:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 30 01:23:14.563557 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df33f7-d680-400d-966c-b71ee917ee99 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:23:14.564140 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df33f7-d680-400d-966c-b71ee917ee99 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:23:14.564140 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df33f7-d680-400d-966c-b71ee917ee99 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:23:14.565874 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 744/1485] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:23:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:23:14.571111 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a614bb-966d-422f-91f2-cc58ae2d4693 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:23:14.571554 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a614bb-966d-422f-91f2-cc58ae2d4693 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:23:14.571664 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a614bb-966d-422f-91f2-cc58ae2d4693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:23:14.590220 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-d4a614bb-966d-422f-91f2-cc58ae2d4693 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:23:14.591416 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-d4a614bb-966d-422f-91f2-cc58ae2d4693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:23:14.599018 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 742/1486] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:23:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 01:23:14.637866 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3df33f7-d680-400d-966c-b71ee917ee99 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:23:14.648370 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3df33f7-d680-400d-966c-b71ee917ee99 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:23:14.651971 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f113b-6c90-4f22-944e-46c61a65b29d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:23:14.652800 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f113b-6c90-4f22-944e-46c61a65b29d service neutron] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:23:14.653090 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f113b-6c90-4f22-944e-46c61a65b29d service neutron] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:23:14.653367 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f113b-6c90-4f22-944e-46c61a65b29d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:23:14.662478 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4f113b-6c90-4f22-944e-46c61a65b29d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:23:14.663933 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4f113b-6c90-4f22-944e-46c61a65b29d service neutron] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:23:14.673642 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 745/1487] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:23:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:23:17.091956 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1c2e71-74a2-4b3a-aa93-6e6ab48f0127 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:23:17.092480 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1c2e71-74a2-4b3a-aa93-6e6ab48f0127 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:23:17.092577 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1c2e71-74a2-4b3a-aa93-6e6ab48f0127 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:23:17.094281 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 743/1488] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:23:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:23:17.099440 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b64d9e-1055-4bc0-8ef8-c0792e8f6d3c None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:23:17.099855 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b64d9e-1055-4bc0-8ef8-c0792e8f6d3c None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:23:17.100014 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b64d9e-1055-4bc0-8ef8-c0792e8f6d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:23:17.118233 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-c0b64d9e-1055-4bc0-8ef8-c0792e8f6d3c None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:23:17.119453 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-c0b64d9e-1055-4bc0-8ef8-c0792e8f6d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:23:17.127841 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 746/1489] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:23:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 01:23:17.168910 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1c2e71-74a2-4b3a-aa93-6e6ab48f0127 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:23:17.179446 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1c2e71-74a2-4b3a-aa93-6e6ab48f0127 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:23:17.182972 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214428bc-a864-4992-801c-791faac573cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:23:17.184215 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214428bc-a864-4992-801c-791faac573cf service neutron] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:23:17.184494 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214428bc-a864-4992-801c-791faac573cf service neutron] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:23:17.184772 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214428bc-a864-4992-801c-791faac573cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:23:17.193395 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214428bc-a864-4992-801c-791faac573cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:23:17.194829 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214428bc-a864-4992-801c-791faac573cf service neutron] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:23:17.204007 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 744/1490] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:23:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 30 01:23:19.682373 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7df6a1-1a59-4f76-bd71-8b455bf7dadb None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:23:19.682954 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7df6a1-1a59-4f76-bd71-8b455bf7dadb None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:23:19.682954 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7df6a1-1a59-4f76-bd71-8b455bf7dadb None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:23:19.684789 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 747/1491] 10.222.0.30 () {54 vars in 926 bytes} [Wed Mar 30 01:23:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:23:19.690121 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b572a-f3d7-48b7-9d3f-bdd1aa56f41d None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:23:19.690549 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b572a-f3d7-48b7-9d3f-bdd1aa56f41d None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:23:19.690692 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b572a-f3d7-48b7-9d3f-bdd1aa56f41d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:23:19.708275 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-f08b572a-f3d7-48b7-9d3f-bdd1aa56f41d None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:23:19.709463 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-f08b572a-f3d7-48b7-9d3f-bdd1aa56f41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:23:19.717792 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 745/1492] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Mar 30 01:23:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:23:19.756009 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7df6a1-1a59-4f76-bd71-8b455bf7dadb None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:23:19.766435 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7df6a1-1a59-4f76-bd71-8b455bf7dadb None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:23:19.769955 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcae16c8-3c42-4d98-8278-a96762edbc9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:23:19.770580 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae16c8-3c42-4d98-8278-a96762edbc9e service neutron] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:23:19.770901 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae16c8-3c42-4d98-8278-a96762edbc9e service neutron] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:23:19.771180 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae16c8-3c42-4d98-8278-a96762edbc9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:23:19.780749 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcae16c8-3c42-4d98-8278-a96762edbc9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:23:19.782429 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcae16c8-3c42-4d98-8278-a96762edbc9e service neutron] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:23:19.791736 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 748/1493] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:23:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:24:40.022529 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37514243-a5c8-461d-8f61-0d52551ca0ba None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:24:40.023119 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37514243-a5c8-461d-8f61-0d52551ca0ba None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:24:40.023119 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37514243-a5c8-461d-8f61-0d52551ca0ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:24:40.041388 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-37514243-a5c8-461d-8f61-0d52551ca0ba None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:24:40.042693 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-37514243-a5c8-461d-8f61-0d52551ca0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:24:40.050542 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 746/1494] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:24:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:24:40.060264 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c75b0-f7a5-470e-8966-a57888c94098 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:24:40.060808 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c75b0-f7a5-470e-8966-a57888c94098 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:24:40.060808 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c75b0-f7a5-470e-8966-a57888c94098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:24:40.078933 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-298c75b0-f7a5-470e-8966-a57888c94098 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:24:40.080104 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-298c75b0-f7a5-470e-8966-a57888c94098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:24:40.087732 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 749/1495] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:24:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:24:40.092455 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37514243-a5c8-461d-8f61-0d52551ca0ba None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:24:40.101952 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37514243-a5c8-461d-8f61-0d52551ca0ba None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:24:40.108293 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13459ac3-a491-4195-bcf0-cfb307f2b20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:24:40.109000 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13459ac3-a491-4195-bcf0-cfb307f2b20d admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:24:40.109271 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13459ac3-a491-4195-bcf0-cfb307f2b20d admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:24:40.109550 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13459ac3-a491-4195-bcf0-cfb307f2b20d admin admin] PATH_INFO: `/v3/domains` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:24:40.110271 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13459ac3-a491-4195-bcf0-cfb307f2b20d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:24:40.110580 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13459ac3-a491-4195-bcf0-cfb307f2b20d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:24:40.111629 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING py.warnings [None req-13459ac3-a491-4195-bcf0-cfb307f2b20d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 30 01:24:40.111629 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: warnings.warn(msg) Mar 30 01:24:40.111629 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: Mar 30 01:24:40.112512 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13459ac3-a491-4195-bcf0-cfb307f2b20d admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:24:40.124789 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 747/1496] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Mar 30 01:24:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:24:40.132816 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c75b0-f7a5-470e-8966-a57888c94098 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:24:40.141702 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c75b0-f7a5-470e-8966-a57888c94098 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:24:40.146174 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa20f70-d3e5-4e98-8c03-8e18428006a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:24:40.146838 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa20f70-d3e5-4e98-8c03-8e18428006a8 admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:24:40.147118 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa20f70-d3e5-4e98-8c03-8e18428006a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:24:40.147392 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa20f70-d3e5-4e98-8c03-8e18428006a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:24:40.148060 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa20f70-d3e5-4e98-8c03-8e18428006a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:24:40.149753 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING py.warnings [None req-4fa20f70-d3e5-4e98-8c03-8e18428006a8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 30 01:24:40.149753 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: warnings.warn(msg) Mar 30 01:24:40.149753 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: Mar 30 01:24:40.151302 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa20f70-d3e5-4e98-8c03-8e18428006a8 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:24:40.186895 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 750/1497] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:24:40 2022] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:24:40.191005 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13459ac3-a491-4195-bcf0-cfb307f2b20d admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:24:40.201373 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13459ac3-a491-4195-bcf0-cfb307f2b20d admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:24:40.256868 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f99c54c-83ad-471d-ab75-4ccd377ef288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:24:40.257543 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f99c54c-83ad-471d-ab75-4ccd377ef288 admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:24:40.257825 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f99c54c-83ad-471d-ab75-4ccd377ef288 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:24:40.258102 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f99c54c-83ad-471d-ab75-4ccd377ef288 admin admin] PATH_INFO: `/v3/users` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:24:40.258841 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f99c54c-83ad-471d-ab75-4ccd377ef288 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:24:40.259867 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING py.warnings [None req-3f99c54c-83ad-471d-ab75-4ccd377ef288 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 30 01:24:40.259867 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: warnings.warn(msg) Mar 30 01:24:40.259867 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: Mar 30 01:24:40.261596 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f99c54c-83ad-471d-ab75-4ccd377ef288 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:24:40.282979 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 748/1498] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:24:40 2022] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 01:24:40.286820 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa20f70-d3e5-4e98-8c03-8e18428006a8 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:24:40.296707 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa20f70-d3e5-4e98-8c03-8e18428006a8 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:24:40.301206 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fd35e9-cf2a-401c-be50-1dc7e9c78463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:24:40.301849 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd35e9-cf2a-401c-be50-1dc7e9c78463 admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:24:40.302129 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd35e9-cf2a-401c-be50-1dc7e9c78463 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:24:40.302401 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd35e9-cf2a-401c-be50-1dc7e9c78463 admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:24:40.303156 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fd35e9-cf2a-401c-be50-1dc7e9c78463 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:24:40.304161 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING py.warnings [None req-d8fd35e9-cf2a-401c-be50-1dc7e9c78463 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 30 01:24:40.304161 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: warnings.warn(msg) Mar 30 01:24:40.304161 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: Mar 30 01:24:40.305031 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fd35e9-cf2a-401c-be50-1dc7e9c78463 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:24:40.317315 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 751/1499] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:24:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:24:40.321390 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f99c54c-83ad-471d-ab75-4ccd377ef288 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:24:40.331395 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f99c54c-83ad-471d-ab75-4ccd377ef288 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:24:40.335780 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e25ab9e-0c65-4202-bf69-e3e1b1005b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:24:40.336421 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e25ab9e-0c65-4202-bf69-e3e1b1005b32 admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:24:40.336700 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e25ab9e-0c65-4202-bf69-e3e1b1005b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:24:40.336971 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e25ab9e-0c65-4202-bf69-e3e1b1005b32 admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:24:40.337685 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e25ab9e-0c65-4202-bf69-e3e1b1005b32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:24:40.338671 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING py.warnings [None req-2e25ab9e-0c65-4202-bf69-e3e1b1005b32 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 30 01:24:40.338671 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: warnings.warn(msg) Mar 30 01:24:40.338671 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: Mar 30 01:24:40.340326 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e25ab9e-0c65-4202-bf69-e3e1b1005b32 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:24:40.353194 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 749/1500] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:24:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:24:40.357363 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fd35e9-cf2a-401c-be50-1dc7e9c78463 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:24:40.366919 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fd35e9-cf2a-401c-be50-1dc7e9c78463 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:24:40.371448 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8166d8b9-392f-476b-b59a-6af7f75b2f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:24:40.372307 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8166d8b9-392f-476b-b59a-6af7f75b2f38 admin admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:24:40.372587 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8166d8b9-392f-476b-b59a-6af7f75b2f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:24:40.372859 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8166d8b9-392f-476b-b59a-6af7f75b2f38 admin admin] PATH_INFO: `/v3/projects/c397ed9417e2478caac6a3a798511e38/users/73ed30a31d7c4cba9c6e657f6c7cc28d/roles/7185d0cfbcd44502b1613bcfe1b42f6f` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:24:40.387530 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8166d8b9-392f-476b-b59a-6af7f75b2f38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c397ed9417e2478caac6a3a798511e38, user_id=73ed30a31d7c4cba9c6e657f6c7cc28d, role_id=7185d0cfbcd44502b1613bcfe1b42f6f)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:24:40.388558 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING py.warnings [None req-8166d8b9-392f-476b-b59a-6af7f75b2f38 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 30 01:24:40.388558 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: warnings.warn(msg) Mar 30 01:24:40.388558 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: Mar 30 01:24:40.390457 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8166d8b9-392f-476b-b59a-6af7f75b2f38 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:24:40.404609 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 752/1501] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:24:40 2022] PUT /identity/v3/projects/c397ed9417e2478caac6a3a798511e38/users/73ed30a31d7c4cba9c6e657f6c7cc28d/roles/7185d0cfbcd44502b1613bcfe1b42f6f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:24:40.416128 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71561d2-b4e0-4bdf-afee-526c2f3bb25d None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:24:40.416422 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71561d2-b4e0-4bdf-afee-526c2f3bb25d None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:24:40.416730 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71561d2-b4e0-4bdf-afee-526c2f3bb25d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:24:40.443346 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-f71561d2-b4e0-4bdf-afee-526c2f3bb25d None None] MFA Rules not processed for user `73ed30a31d7c4cba9c6e657f6c7cc28d`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:24:40.444542 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-f71561d2-b4e0-4bdf-afee-526c2f3bb25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:24:40.506601 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 750/1502] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:24:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:24:40.517716 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8166d8b9-392f-476b-b59a-6af7f75b2f38 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:24:40.589688 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8166d8b9-392f-476b-b59a-6af7f75b2f38 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:24:40.598463 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a75cc49-fde9-43ca-8ae0-495f09d49504 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140c6d1a20e94192bde06e72040f162d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:24:40.599136 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75cc49-fde9-43ca-8ae0-495f09d49504 service nova] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:24:40.599419 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75cc49-fde9-43ca-8ae0-495f09d49504 service nova] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:24:40.599710 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75cc49-fde9-43ca-8ae0-495f09d49504 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:24:40.607972 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a75cc49-fde9-43ca-8ae0-495f09d49504 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:24:40.609543 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a75cc49-fde9-43ca-8ae0-495f09d49504 service nova] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:24:40.618053 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 753/1503] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:24:40 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:24:40.691047 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb3f5b-683d-46f6-8a08-1857fa8f8a47 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:24:40.691334 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb3f5b-683d-46f6-8a08-1857fa8f8a47 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:24:40.691610 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb3f5b-683d-46f6-8a08-1857fa8f8a47 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:24:40.693302 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 751/1504] 10.222.0.30 () {52 vars in 829 bytes} [Wed Mar 30 01:24:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:24:40.696888 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a75cc49-fde9-43ca-8ae0-495f09d49504 service nova] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:24:40.754957 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a75cc49-fde9-43ca-8ae0-495f09d49504 service nova] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:24:40.759422 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea58719-3293-48fc-8bc0-ed9fd19ad07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:24:40.760267 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea58719-3293-48fc-8bc0-ed9fd19ad07d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:24:40.760546 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea58719-3293-48fc-8bc0-ed9fd19ad07d admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:24:40.760865 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea58719-3293-48fc-8bc0-ed9fd19ad07d admin admin] PATH_INFO: `/v3/users/73ed30a31d7c4cba9c6e657f6c7cc28d` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:24:40.762620 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea58719-3293-48fc-8bc0-ed9fd19ad07d admin admin] RBAC: Authorizing `identity:delete_user(user_id=73ed30a31d7c4cba9c6e657f6c7cc28d)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:24:40.763649 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING py.warnings [None req-bea58719-3293-48fc-8bc0-ed9fd19ad07d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 30 01:24:40.763649 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: warnings.warn(msg) Mar 30 01:24:40.763649 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: Mar 30 01:24:40.764828 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea58719-3293-48fc-8bc0-ed9fd19ad07d admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:24:40.829418 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-bea58719-3293-48fc-8bc0-ed9fd19ad07d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73ed30a31d7c4cba9c6e657f6c7cc28d'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:24:40.838876 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-bea58719-3293-48fc-8bc0-ed9fd19ad07d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73ed30a31d7c4cba9c6e657f6c7cc28d'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:24:40.840506 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-bea58719-3293-48fc-8bc0-ed9fd19ad07d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73ed30a31d7c4cba9c6e657f6c7cc28d'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:24:40.852013 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-bea58719-3293-48fc-8bc0-ed9fd19ad07d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73ed30a31d7c4cba9c6e657f6c7cc28d'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:24:40.875421 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-bea58719-3293-48fc-8bc0-ed9fd19ad07d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73ed30a31d7c4cba9c6e657f6c7cc28d'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:24:40.881823 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 754/1505] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:24:40 2022] DELETE /identity/v3/users/73ed30a31d7c4cba9c6e657f6c7cc28d => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:24:40.886374 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419a2ce-f73f-4dd7-aa02-24aadcd44aff None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:24:40.886658 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419a2ce-f73f-4dd7-aa02-24aadcd44aff None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:24:40.886967 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419a2ce-f73f-4dd7-aa02-24aadcd44aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:24:40.903822 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-7419a2ce-f73f-4dd7-aa02-24aadcd44aff None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:24:40.904993 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-7419a2ce-f73f-4dd7-aa02-24aadcd44aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:24:40.960087 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 752/1506] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:24:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 01:24:40.970355 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea58719-3293-48fc-8bc0-ed9fd19ad07d admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:24:40.971799 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-bea58719-3293-48fc-8bc0-ed9fd19ad07d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:24:41.029231 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea58719-3293-48fc-8bc0-ed9fd19ad07d admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:24:41.033075 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c710376d-3a28-40bc-820e-3b58e63e3f9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:24:41.033714 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c710376d-3a28-40bc-820e-3b58e63e3f9e service neutron] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:24:41.034000 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c710376d-3a28-40bc-820e-3b58e63e3f9e service neutron] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:24:41.034274 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c710376d-3a28-40bc-820e-3b58e63e3f9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:24:41.043812 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c710376d-3a28-40bc-820e-3b58e63e3f9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:24:41.045240 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c710376d-3a28-40bc-820e-3b58e63e3f9e service neutron] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:24:41.054569 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 755/1507] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:24:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:24:41.380058 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7419a2ce-f73f-4dd7-aa02-24aadcd44aff None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:24:41.381546 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-7419a2ce-f73f-4dd7-aa02-24aadcd44aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:24:41.394178 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7419a2ce-f73f-4dd7-aa02-24aadcd44aff None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:24:41.398783 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5dd6b1-2a14-4e5c-b858-495316340c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:24:41.399668 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5dd6b1-2a14-4e5c-b858-495316340c64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:24:41.399949 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5dd6b1-2a14-4e5c-b858-495316340c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:24:41.400217 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5dd6b1-2a14-4e5c-b858-495316340c64 admin admin] PATH_INFO: `/v3/projects/c397ed9417e2478caac6a3a798511e38` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:24:41.401442 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5dd6b1-2a14-4e5c-b858-495316340c64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c397ed9417e2478caac6a3a798511e38)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:24:41.402688 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING py.warnings [None req-bb5dd6b1-2a14-4e5c-b858-495316340c64 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 30 01:24:41.402688 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: warnings.warn(msg) Mar 30 01:24:41.402688 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: Mar 30 01:24:41.407720 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5dd6b1-2a14-4e5c-b858-495316340c64 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:24:41.468625 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-bb5dd6b1-2a14-4e5c-b858-495316340c64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c397ed9417e2478caac6a3a798511e38', 'request_id': 'req-bb5dd6b1-2a14-4e5c-b858-495316340c64'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:24:41.477508 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-bb5dd6b1-2a14-4e5c-b858-495316340c64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c397ed9417e2478caac6a3a798511e38', 'request_id': 'req-bb5dd6b1-2a14-4e5c-b858-495316340c64'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:24:41.484140 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-bb5dd6b1-2a14-4e5c-b858-495316340c64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c397ed9417e2478caac6a3a798511e38', 'request_id': 'req-bb5dd6b1-2a14-4e5c-b858-495316340c64'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:24:41.502190 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-bb5dd6b1-2a14-4e5c-b858-495316340c64 admin admin] The token cache is being invalidate because project c397ed9417e2478caac6a3a798511e38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:24:41.502483 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-bb5dd6b1-2a14-4e5c-b858-495316340c64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:24:41.503234 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-bb5dd6b1-2a14-4e5c-b858-495316340c64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:24:41.504776 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 753/1508] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:24:41 2022] DELETE /identity/v3/projects/c397ed9417e2478caac6a3a798511e38 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:26:16.951139 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64681777-b8de-4727-9145-1f6c30058a92 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:26:16.951698 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64681777-b8de-4727-9145-1f6c30058a92 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:26:16.951698 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64681777-b8de-4727-9145-1f6c30058a92 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:26:16.953634 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 756/1509] 127.0.0.1 () {54 vars in 901 bytes} [Wed Mar 30 01:26:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:26:16.958930 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4edcd64-01c3-4f3c-9f81-b0883d7f2568 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:26:16.959384 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4edcd64-01c3-4f3c-9f81-b0883d7f2568 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:26:16.959484 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4edcd64-01c3-4f3c-9f81-b0883d7f2568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:26:16.978152 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-c4edcd64-01c3-4f3c-9f81-b0883d7f2568 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:26:16.979378 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-c4edcd64-01c3-4f3c-9f81-b0883d7f2568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:26:17.037183 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 754/1510] 127.0.0.1 () {58 vars in 998 bytes} [Wed Mar 30 01:26:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:26:17.108130 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c775c8-885a-4784-bcb2-7bcf95fb243c None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:26:17.108418 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c775c8-885a-4784-bcb2-7bcf95fb243c None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:26:17.108694 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c775c8-885a-4784-bcb2-7bcf95fb243c None None] PATH_INFO: `/v3` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:26:17.109976 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 757/1511] 10.222.0.10 () {54 vars in 925 bytes} [Wed Mar 30 01:26:17 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:26:17.116216 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd92e7-5d06-4f75-a518-d8897a8751e8 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:26:17.116512 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd92e7-5d06-4f75-a518-d8897a8751e8 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:26:17.116796 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd92e7-5d06-4f75-a518-d8897a8751e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:26:17.136149 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-bddd92e7-5d06-4f75-a518-d8897a8751e8 None None] MFA Rules not processed for user `7343cd5457264dabb4c2b3a62df59431`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:26:17.137877 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-bddd92e7-5d06-4f75-a518-d8897a8751e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:26:17.194004 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c775c8-885a-4784-bcb2-7bcf95fb243c None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:26:17.195616 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-b2c775c8-885a-4784-bcb2-7bcf95fb243c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:26:17.200969 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 755/1512] 10.222.0.10 () {58 vars in 1015 bytes} [Wed Mar 30 01:26:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:26:17.278372 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c775c8-885a-4784-bcb2-7bcf95fb243c None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:26:17.283997 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4713d2d0-7a77-4461-94f5-6c5c38baec42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140c6d1a20e94192bde06e72040f162d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:26:17.284665 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4713d2d0-7a77-4461-94f5-6c5c38baec42 service nova] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:26:17.284945 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4713d2d0-7a77-4461-94f5-6c5c38baec42 service nova] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:26:17.285224 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4713d2d0-7a77-4461-94f5-6c5c38baec42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:26:17.293422 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4713d2d0-7a77-4461-94f5-6c5c38baec42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:26:17.295112 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4713d2d0-7a77-4461-94f5-6c5c38baec42 service nova] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:26:17.304593 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 758/1513] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:26:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 30 01:26:18.591932 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb9421-a1f7-42ec-9df5-4782b2d1cb7b None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:26:18.592480 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb9421-a1f7-42ec-9df5-4782b2d1cb7b None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:26:18.592480 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb9421-a1f7-42ec-9df5-4782b2d1cb7b None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:26:18.594251 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 756/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Mar 30 01:26:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:26:18.599207 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850f75b-a772-402f-9971-1a257fbfcb63 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:26:18.599677 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850f75b-a772-402f-9971-1a257fbfcb63 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:26:18.599819 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850f75b-a772-402f-9971-1a257fbfcb63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:26:18.617729 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-b850f75b-a772-402f-9971-1a257fbfcb63 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:26:18.618958 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-b850f75b-a772-402f-9971-1a257fbfcb63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:26:18.627355 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 759/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Mar 30 01:26:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:26:18.780873 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bb9421-a1f7-42ec-9df5-4782b2d1cb7b None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:26:18.796246 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bb9421-a1f7-42ec-9df5-4782b2d1cb7b None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:26:18.801612 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155efd45-365d-4374-9c8a-0b0ff0114820 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140c6d1a20e94192bde06e72040f162d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:26:18.802239 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155efd45-365d-4374-9c8a-0b0ff0114820 service nova] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:26:18.802519 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155efd45-365d-4374-9c8a-0b0ff0114820 service nova] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:26:18.802828 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155efd45-365d-4374-9c8a-0b0ff0114820 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:26:18.810957 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155efd45-365d-4374-9c8a-0b0ff0114820 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:26:18.812544 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155efd45-365d-4374-9c8a-0b0ff0114820 service nova] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:26:18.821615 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 757/1516] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:26:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:26:21.021943 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ff6e9-ea1d-4e59-aeed-e66f8d5b0537 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:26:21.022511 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ff6e9-ea1d-4e59-aeed-e66f8d5b0537 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:26:21.022511 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ff6e9-ea1d-4e59-aeed-e66f8d5b0537 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:26:21.024283 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 760/1517] 10.222.0.30 () {54 vars in 960 bytes} [Wed Mar 30 01:26:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:26:21.029780 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56121a55-9fa4-4bfc-abdd-a5ce40f357d3 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:26:21.030241 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56121a55-9fa4-4bfc-abdd-a5ce40f357d3 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:26:21.030346 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56121a55-9fa4-4bfc-abdd-a5ce40f357d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:26:21.048873 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-56121a55-9fa4-4bfc-abdd-a5ce40f357d3 None None] MFA Rules not processed for user `7343cd5457264dabb4c2b3a62df59431`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:26:21.050092 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-56121a55-9fa4-4bfc-abdd-a5ce40f357d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:26:21.058655 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 758/1518] 10.222.0.30 () {58 vars in 1057 bytes} [Wed Mar 30 01:26:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 01:26:21.066134 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ff6e9-ea1d-4e59-aeed-e66f8d5b0537 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:26:21.079297 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ff6e9-ea1d-4e59-aeed-e66f8d5b0537 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:26:21.084371 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e3f6bf-62a3-4e79-8e94-9f477b47b7c3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7343cd5457264dabb4c2b3a62df59431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:26:21.085032 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e3f6bf-62a3-4e79-8e94-9f477b47b7c3 service placement] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:26:21.085315 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e3f6bf-62a3-4e79-8e94-9f477b47b7c3 service placement] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:26:21.085592 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e3f6bf-62a3-4e79-8e94-9f477b47b7c3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:26:21.094595 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e3f6bf-62a3-4e79-8e94-9f477b47b7c3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:26:21.096231 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e3f6bf-62a3-4e79-8e94-9f477b47b7c3 service placement] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:26:21.107080 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 761/1519] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:26:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:26:30.522364 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04338f2a-ac69-4f53-bac9-c9ca7bf184ce None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:26:30.522852 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04338f2a-ac69-4f53-bac9-c9ca7bf184ce None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:26:30.522961 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04338f2a-ac69-4f53-bac9-c9ca7bf184ce None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:26:30.524714 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 759/1520] 127.0.0.1 () {54 vars in 901 bytes} [Wed Mar 30 01:26:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:26:30.530482 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91722216-bc21-47ea-8ebc-854948a9a701 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:26:30.530926 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91722216-bc21-47ea-8ebc-854948a9a701 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:26:30.531091 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91722216-bc21-47ea-8ebc-854948a9a701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:26:30.549856 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-91722216-bc21-47ea-8ebc-854948a9a701 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:26:30.551077 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-91722216-bc21-47ea-8ebc-854948a9a701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:26:30.559013 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 762/1521] 127.0.0.1 () {58 vars in 998 bytes} [Wed Mar 30 01:26:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:26:30.709297 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04338f2a-ac69-4f53-bac9-c9ca7bf184ce None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:26:30.724021 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04338f2a-ac69-4f53-bac9-c9ca7bf184ce None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:26:30.729389 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f547b595-aad2-4eba-9fc6-ed9ad63b506a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140c6d1a20e94192bde06e72040f162d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:26:30.730048 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547b595-aad2-4eba-9fc6-ed9ad63b506a service nova] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:26:30.730996 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547b595-aad2-4eba-9fc6-ed9ad63b506a service nova] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:26:30.731359 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547b595-aad2-4eba-9fc6-ed9ad63b506a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:26:30.739275 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f547b595-aad2-4eba-9fc6-ed9ad63b506a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:26:30.740860 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f547b595-aad2-4eba-9fc6-ed9ad63b506a service nova] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:26:30.750092 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 760/1522] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:26:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:26:32.009263 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074ec58-9fdb-46ab-bd6d-c5e5b75c0f3d None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:26:32.009813 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074ec58-9fdb-46ab-bd6d-c5e5b75c0f3d None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:26:32.009813 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074ec58-9fdb-46ab-bd6d-c5e5b75c0f3d None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:26:32.012118 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 763/1523] 127.0.0.1 () {54 vars in 901 bytes} [Wed Mar 30 01:26:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:26:32.017326 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69f405-0ff3-417f-ba9e-3143a4f0660f None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:26:32.017724 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69f405-0ff3-417f-ba9e-3143a4f0660f None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:26:32.017890 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69f405-0ff3-417f-ba9e-3143a4f0660f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:26:32.037852 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-0a69f405-0ff3-417f-ba9e-3143a4f0660f None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:26:32.039081 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-0a69f405-0ff3-417f-ba9e-3143a4f0660f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:26:32.046921 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 761/1524] 127.0.0.1 () {58 vars in 998 bytes} [Wed Mar 30 01:26:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:26:32.201393 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6074ec58-9fdb-46ab-bd6d-c5e5b75c0f3d None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:26:32.215685 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6074ec58-9fdb-46ab-bd6d-c5e5b75c0f3d None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:26:32.221076 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0e9b5c-acba-455c-8916-89f0751ebeca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140c6d1a20e94192bde06e72040f162d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:26:32.221736 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e9b5c-acba-455c-8916-89f0751ebeca service nova] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:26:32.222021 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e9b5c-acba-455c-8916-89f0751ebeca service nova] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:26:32.222299 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e9b5c-acba-455c-8916-89f0751ebeca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:26:32.230185 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0e9b5c-acba-455c-8916-89f0751ebeca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:26:32.231792 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0e9b5c-acba-455c-8916-89f0751ebeca service nova] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:26:32.240952 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 764/1525] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:26:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:26:36.781926 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852add36-be10-461a-8f56-89d614e403c2 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:26:36.782778 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852add36-be10-461a-8f56-89d614e403c2 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:26:36.782778 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852add36-be10-461a-8f56-89d614e403c2 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:26:36.784519 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 762/1526] 127.0.0.1 () {54 vars in 916 bytes} [Wed Mar 30 01:26:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:26:36.789916 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b6203d-f12b-489b-812d-785ffc34b8df None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:26:36.790349 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b6203d-f12b-489b-812d-785ffc34b8df None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:26:36.790451 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b6203d-f12b-489b-812d-785ffc34b8df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:26:36.808933 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-a5b6203d-f12b-489b-812d-785ffc34b8df None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:26:36.810095 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-a5b6203d-f12b-489b-812d-785ffc34b8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:26:36.817676 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 765/1527] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Mar 30 01:26:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:26:36.853423 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852add36-be10-461a-8f56-89d614e403c2 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:26:36.855793 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-852add36-be10-461a-8f56-89d614e403c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:26:36.910332 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852add36-be10-461a-8f56-89d614e403c2 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:26:36.913796 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2ae331-d9b4-4339-a6fa-6bbb3a24a447 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:26:36.914424 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ae331-d9b4-4339-a6fa-6bbb3a24a447 service neutron] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:26:36.914721 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ae331-d9b4-4339-a6fa-6bbb3a24a447 service neutron] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:26:36.915003 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ae331-d9b4-4339-a6fa-6bbb3a24a447 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:26:36.924562 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2ae331-d9b4-4339-a6fa-6bbb3a24a447 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:26:36.925974 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2ae331-d9b4-4339-a6fa-6bbb3a24a447 service neutron] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:26:36.935231 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 763/1528] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:26:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:26:39.208642 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea3c95f-92ef-47e1-833f-5d27c02dacfb None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:26:39.209174 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea3c95f-92ef-47e1-833f-5d27c02dacfb None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:26:39.209174 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea3c95f-92ef-47e1-833f-5d27c02dacfb None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:26:39.210904 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 766/1529] 127.0.0.1 () {54 vars in 916 bytes} [Wed Mar 30 01:26:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:26:39.216546 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f162db0-2248-4c80-a03f-2d85aad30bd1 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:26:39.216989 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f162db0-2248-4c80-a03f-2d85aad30bd1 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:26:39.217107 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f162db0-2248-4c80-a03f-2d85aad30bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:26:39.235244 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-3f162db0-2248-4c80-a03f-2d85aad30bd1 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:26:39.236413 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-3f162db0-2248-4c80-a03f-2d85aad30bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:26:39.244039 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 764/1530] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Mar 30 01:26:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:26:39.279921 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea3c95f-92ef-47e1-833f-5d27c02dacfb None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:26:39.281548 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-cea3c95f-92ef-47e1-833f-5d27c02dacfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:26:39.294860 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea3c95f-92ef-47e1-833f-5d27c02dacfb None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:26:39.298296 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7672fc6d-5aab-4856-9433-22c7b71756e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:26:39.298949 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672fc6d-5aab-4856-9433-22c7b71756e3 service neutron] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:26:39.299231 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672fc6d-5aab-4856-9433-22c7b71756e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:26:39.299506 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672fc6d-5aab-4856-9433-22c7b71756e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:26:39.308267 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7672fc6d-5aab-4856-9433-22c7b71756e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:26:39.309671 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7672fc6d-5aab-4856-9433-22c7b71756e3 service neutron] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:26:39.318694 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 767/1531] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:26:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:26:43.103448 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3bc57a-c6b6-488a-bae5-2e5dcd4cb515 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:26:43.104009 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3bc57a-c6b6-488a-bae5-2e5dcd4cb515 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:26:43.104009 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3bc57a-c6b6-488a-bae5-2e5dcd4cb515 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:26:43.106298 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 765/1532] 127.0.0.1 () {54 vars in 916 bytes} [Wed Mar 30 01:26:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:26:43.111449 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323a7f7-c6f2-4f9e-a15d-dc2574b7f3af None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:26:43.111855 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323a7f7-c6f2-4f9e-a15d-dc2574b7f3af None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:26:43.111996 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323a7f7-c6f2-4f9e-a15d-dc2574b7f3af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:26:43.136788 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-3323a7f7-c6f2-4f9e-a15d-dc2574b7f3af None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:26:43.137954 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-3323a7f7-c6f2-4f9e-a15d-dc2574b7f3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:26:43.146142 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 768/1533] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Mar 30 01:26:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:26:43.400094 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3bc57a-c6b6-488a-bae5-2e5dcd4cb515 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:26:43.401892 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-4c3bc57a-c6b6-488a-bae5-2e5dcd4cb515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:26:43.457473 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3bc57a-c6b6-488a-bae5-2e5dcd4cb515 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:26:43.461123 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07721e24-948f-4177-b888-72e85d5aa69e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45219f386f0147b6bd380efe4ab62812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:26:43.461787 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07721e24-948f-4177-b888-72e85d5aa69e service cinder] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:26:43.462071 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07721e24-948f-4177-b888-72e85d5aa69e service cinder] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:26:43.462346 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07721e24-948f-4177-b888-72e85d5aa69e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:26:43.472105 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07721e24-948f-4177-b888-72e85d5aa69e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:26:43.473533 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07721e24-948f-4177-b888-72e85d5aa69e service cinder] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:26:43.482936 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 766/1534] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:26:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:26:45.868687 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c139a-8505-4772-8a13-d4888449c0f7 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:26:45.869301 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c139a-8505-4772-8a13-d4888449c0f7 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:26:45.869301 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c139a-8505-4772-8a13-d4888449c0f7 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:26:45.871427 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 769/1535] 127.0.0.1 () {54 vars in 916 bytes} [Wed Mar 30 01:26:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:26:45.877549 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8cd5db-7692-4d82-bb77-5ce255059af3 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:26:45.878067 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8cd5db-7692-4d82-bb77-5ce255059af3 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:26:45.878247 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8cd5db-7692-4d82-bb77-5ce255059af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:26:45.896386 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-af8cd5db-7692-4d82-bb77-5ce255059af3 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:26:45.897574 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-af8cd5db-7692-4d82-bb77-5ce255059af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:26:45.906277 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 767/1536] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Mar 30 01:26:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:26:46.158477 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f244be5-7054-46d2-b426-1102882aa98f None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:26:46.158810 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f244be5-7054-46d2-b426-1102882aa98f None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:26:46.159098 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f244be5-7054-46d2-b426-1102882aa98f None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:26:46.160900 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 770/1537] 10.222.0.30 () {54 vars in 962 bytes} [Wed Mar 30 01:26:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:26:46.165878 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57595ce-322e-4923-be2b-cf210f3273f4 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:26:46.166166 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57595ce-322e-4923-be2b-cf210f3273f4 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:26:46.166445 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57595ce-322e-4923-be2b-cf210f3273f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:26:46.184162 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-f57595ce-322e-4923-be2b-cf210f3273f4 None None] MFA Rules not processed for user `45219f386f0147b6bd380efe4ab62812`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:26:46.185332 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-f57595ce-322e-4923-be2b-cf210f3273f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:26:46.191730 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 768/1538] 10.222.0.30 () {58 vars in 1059 bytes} [Wed Mar 30 01:26:46 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:26:46.202045 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f244be5-7054-46d2-b426-1102882aa98f None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:26:46.212487 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f244be5-7054-46d2-b426-1102882aa98f None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:26:46.216621 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d2130f-8706-4549-934c-6d16fe1ec009 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45219f386f0147b6bd380efe4ab62812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:26:46.217242 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2130f-8706-4549-934c-6d16fe1ec009 service cinder] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:26:46.217552 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2130f-8706-4549-934c-6d16fe1ec009 service cinder] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:26:46.217824 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2130f-8706-4549-934c-6d16fe1ec009 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:26:46.226452 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d2130f-8706-4549-934c-6d16fe1ec009 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:26:46.227915 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d2130f-8706-4549-934c-6d16fe1ec009 service cinder] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:26:46.237063 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 771/1539] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:26:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 30 01:28:12.764878 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceab5bb-19a3-4207-a878-08e88fc30329 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:12.765528 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceab5bb-19a3-4207-a878-08e88fc30329 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:12.765528 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceab5bb-19a3-4207-a878-08e88fc30329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:12.795796 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-eceab5bb-19a3-4207-a878-08e88fc30329 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:12.797022 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-eceab5bb-19a3-4207-a878-08e88fc30329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:12.812268 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 769/1540] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:12.823500 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4aa3a7-0e15-48eb-b760-c8b932b08691 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:12.824476 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4aa3a7-0e15-48eb-b760-c8b932b08691 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:12.824979 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4aa3a7-0e15-48eb-b760-c8b932b08691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:12.848299 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-7c4aa3a7-0e15-48eb-b760-c8b932b08691 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:12.849998 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-7c4aa3a7-0e15-48eb-b760-c8b932b08691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:12.867286 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 772/1541] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:12.872655 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceab5bb-19a3-4207-a878-08e88fc30329 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:12.888538 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceab5bb-19a3-4207-a878-08e88fc30329 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:12.894899 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d8dcd-3ed6-4f90-a3f7-bd026a9d5345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:12.895569 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d8dcd-3ed6-4f90-a3f7-bd026a9d5345 admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:12.895850 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d8dcd-3ed6-4f90-a3f7-bd026a9d5345 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:12.896130 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d8dcd-3ed6-4f90-a3f7-bd026a9d5345 admin admin] PATH_INFO: `/v3/domains` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:12.896863 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294d8dcd-3ed6-4f90-a3f7-bd026a9d5345 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:28:12.897171 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294d8dcd-3ed6-4f90-a3f7-bd026a9d5345 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:12.898805 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294d8dcd-3ed6-4f90-a3f7-bd026a9d5345 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:12.921302 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 770/1542] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Mar 30 01:28:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:28:12.929472 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4aa3a7-0e15-48eb-b760-c8b932b08691 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:12.946538 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4aa3a7-0e15-48eb-b760-c8b932b08691 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:12.952985 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ba56ae-19fd-48e8-80fe-00bb178860f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:12.954127 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ba56ae-19fd-48e8-80fe-00bb178860f6 admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:12.954630 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ba56ae-19fd-48e8-80fe-00bb178860f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:12.955170 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ba56ae-19fd-48e8-80fe-00bb178860f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:12.956082 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ba56ae-19fd-48e8-80fe-00bb178860f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:12.958352 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ba56ae-19fd-48e8-80fe-00bb178860f6 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:12.974727 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f07fe3-fda9-4c45-9c21-1554c6d680a4 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:12.974727 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f07fe3-fda9-4c45-9c21-1554c6d680a4 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:12.974727 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f07fe3-fda9-4c45-9c21-1554c6d680a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:13.004707 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-f4f07fe3-fda9-4c45-9c21-1554c6d680a4 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:13.005936 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-f4f07fe3-fda9-4c45-9c21-1554c6d680a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:13.007668 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 773/1543] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:28:12 2022] POST /identity/v3/projects => generated 385 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:28:13.013632 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ba56ae-19fd-48e8-80fe-00bb178860f6 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:13.115655 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ba56ae-19fd-48e8-80fe-00bb178860f6 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:13.133046 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f982a-67c5-4549-87df-219e3a5e8df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:13.134190 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f982a-67c5-4549-87df-219e3a5e8df2 admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:13.134805 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f982a-67c5-4549-87df-219e3a5e8df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:13.135352 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f982a-67c5-4549-87df-219e3a5e8df2 admin admin] PATH_INFO: `/v3/users` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:13.136366 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7f982a-67c5-4549-87df-219e3a5e8df2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:13.137638 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING py.warnings [None req-7d7f982a-67c5-4549-87df-219e3a5e8df2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 30 01:28:13.137638 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: warnings.warn(msg) Mar 30 01:28:13.137638 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: Mar 30 01:28:13.139332 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7f982a-67c5-4549-87df-219e3a5e8df2 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:13.143521 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 771/1544] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:13.153887 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1226ce-47bf-40dc-ad66-b217147fda18 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:13.154139 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1226ce-47bf-40dc-ad66-b217147fda18 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:13.154398 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1226ce-47bf-40dc-ad66-b217147fda18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:13.185162 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-ce1226ce-47bf-40dc-ad66-b217147fda18 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:13.186387 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-ce1226ce-47bf-40dc-ad66-b217147fda18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:13.188289 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 774/1545] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:28:13 2022] POST /identity/v3/users => generated 293 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:28:13.192808 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f982a-67c5-4549-87df-219e3a5e8df2 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:13.201461 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 772/1546] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 01:28:13.205196 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f982a-67c5-4549-87df-219e3a5e8df2 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:13.206054 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1226ce-47bf-40dc-ad66-b217147fda18 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:13.220264 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb06e36-86bd-48de-bd9b-c74727df8a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:13.220736 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1226ce-47bf-40dc-ad66-b217147fda18 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:13.221657 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb06e36-86bd-48de-bd9b-c74727df8a4d admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:13.222184 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb06e36-86bd-48de-bd9b-c74727df8a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:13.222778 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb06e36-86bd-48de-bd9b-c74727df8a4d admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:13.223962 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb06e36-86bd-48de-bd9b-c74727df8a4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:13.225841 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb06e36-86bd-48de-bd9b-c74727df8a4d admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:13.232531 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1f2fae-3de7-404d-b9b1-103e18302a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:13.233521 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f2fae-3de7-404d-b9b1-103e18302a6b admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:13.233664 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f2fae-3de7-404d-b9b1-103e18302a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:13.233898 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f2fae-3de7-404d-b9b1-103e18302a6b admin admin] PATH_INFO: `/v3/domains` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:13.234598 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1f2fae-3de7-404d-b9b1-103e18302a6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:28:13.235028 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1f2fae-3de7-404d-b9b1-103e18302a6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:13.236647 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1f2fae-3de7-404d-b9b1-103e18302a6b admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:13.245387 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 775/1547] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:28:13 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:28:13.251849 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb06e36-86bd-48de-bd9b-c74727df8a4d admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:13.259868 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 773/1548] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Mar 30 01:28:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:28:13.263038 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1f2fae-3de7-404d-b9b1-103e18302a6b admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:13.264252 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb06e36-86bd-48de-bd9b-c74727df8a4d admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:13.274714 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1f2fae-3de7-404d-b9b1-103e18302a6b admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:13.284854 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71112c42-df58-4fe2-837b-1f7358378880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:13.285918 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71112c42-df58-4fe2-837b-1f7358378880 admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:13.286449 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71112c42-df58-4fe2-837b-1f7358378880 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:13.286978 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71112c42-df58-4fe2-837b-1f7358378880 admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:13.287923 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71112c42-df58-4fe2-837b-1f7358378880 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:13.289831 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71112c42-df58-4fe2-837b-1f7358378880 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:13.292487 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32447ae6-393e-4ac5-b878-0b001066a04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:13.293230 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32447ae6-393e-4ac5-b878-0b001066a04d admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:13.293447 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32447ae6-393e-4ac5-b878-0b001066a04d admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:13.293727 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32447ae6-393e-4ac5-b878-0b001066a04d admin admin] PATH_INFO: `/v3/projects` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:13.294426 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32447ae6-393e-4ac5-b878-0b001066a04d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:13.297750 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING py.warnings [None req-32447ae6-393e-4ac5-b878-0b001066a04d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 30 01:28:13.297750 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: warnings.warn(msg) Mar 30 01:28:13.297750 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: Mar 30 01:28:13.297750 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32447ae6-393e-4ac5-b878-0b001066a04d admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:13.307459 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 776/1549] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:28:13 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:28:13.315915 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e3dae1-c103-4a6c-85ce-c7f984b133a1 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:13.316458 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e3dae1-c103-4a6c-85ce-c7f984b133a1 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:13.316902 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e3dae1-c103-4a6c-85ce-c7f984b133a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:13.346525 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 774/1550] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:28:13 2022] POST /identity/v3/projects => generated 387 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 01:28:13.349165 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86bd667-fa7e-48c2-88d7-e20bd7b235e1 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:13.350588 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86bd667-fa7e-48c2-88d7-e20bd7b235e1 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:13.351066 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86bd667-fa7e-48c2-88d7-e20bd7b235e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:13.376190 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-b0e3dae1-c103-4a6c-85ce-c7f984b133a1 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:13.377430 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-b0e3dae1-c103-4a6c-85ce-c7f984b133a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:13.380533 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-a86bd667-fa7e-48c2-88d7-e20bd7b235e1 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:13.381888 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-a86bd667-fa7e-48c2-88d7-e20bd7b235e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:13.474057 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 777/1551] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:13.475190 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e3dae1-c103-4a6c-85ce-c7f984b133a1 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:13.481367 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 775/1552] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:13.482434 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86bd667-fa7e-48c2-88d7-e20bd7b235e1 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:13.485926 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e3dae1-c103-4a6c-85ce-c7f984b133a1 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:13.492711 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6e992e-370e-493a-8232-cd5493513644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:13.493673 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e992e-370e-493a-8232-cd5493513644 admin admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:13.493960 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e992e-370e-493a-8232-cd5493513644 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:13.494301 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e992e-370e-493a-8232-cd5493513644 admin admin] PATH_INFO: `/v3/projects/22f49ef5f57f4bc08aa083cea4ca4a43/users/90e436c041b043529418187b2d2aba85/roles/7185d0cfbcd44502b1613bcfe1b42f6f` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:13.499015 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86bd667-fa7e-48c2-88d7-e20bd7b235e1 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:13.504704 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58058ae9-a33e-4f73-bf4d-83df2b00e16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:13.505724 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58058ae9-a33e-4f73-bf4d-83df2b00e16f admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:13.506165 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58058ae9-a33e-4f73-bf4d-83df2b00e16f admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:13.506624 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58058ae9-a33e-4f73-bf4d-83df2b00e16f admin admin] PATH_INFO: `/v3/users` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:13.507502 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58058ae9-a33e-4f73-bf4d-83df2b00e16f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:13.509225 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6e992e-370e-493a-8232-cd5493513644 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22f49ef5f57f4bc08aa083cea4ca4a43, user_id=90e436c041b043529418187b2d2aba85, role_id=7185d0cfbcd44502b1613bcfe1b42f6f)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:13.510616 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58058ae9-a33e-4f73-bf4d-83df2b00e16f admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:13.512423 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6e992e-370e-493a-8232-cd5493513644 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:13.527608 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 778/1553] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:28:13 2022] PUT /identity/v3/projects/22f49ef5f57f4bc08aa083cea4ca4a43/users/90e436c041b043529418187b2d2aba85/roles/7185d0cfbcd44502b1613bcfe1b42f6f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:28:13.528933 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b2adb-3017-4838-a24e-f228e25893a3 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:13.529360 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b2adb-3017-4838-a24e-f228e25893a3 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:13.529641 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b2adb-3017-4838-a24e-f228e25893a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:13.544795 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 776/1554] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:28:13 2022] POST /identity/v3/users => generated 294 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:28:13.546165 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a0ee20-4c5c-4a99-8ea4-7cf95eac0a0e None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:13.546463 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a0ee20-4c5c-4a99-8ea4-7cf95eac0a0e None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:13.546774 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a0ee20-4c5c-4a99-8ea4-7cf95eac0a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:13.553912 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-9f8b2adb-3017-4838-a24e-f228e25893a3 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:13.555380 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-9f8b2adb-3017-4838-a24e-f228e25893a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:13.567690 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-64a0ee20-4c5c-4a99-8ea4-7cf95eac0a0e None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:13.569005 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-64a0ee20-4c5c-4a99-8ea4-7cf95eac0a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:13.623769 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 779/1555] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:13.628113 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc63349-a1f7-4b5f-8f5b-8c2130c68968 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:13.628516 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc63349-a1f7-4b5f-8f5b-8c2130c68968 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:13.628898 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc63349-a1f7-4b5f-8f5b-8c2130c68968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:13.630805 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 777/1556] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:13.639626 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eeef51-c93f-4e77-8a0c-81d3a5c3c2c4 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:13.639914 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eeef51-c93f-4e77-8a0c-81d3a5c3c2c4 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:13.640190 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eeef51-c93f-4e77-8a0c-81d3a5c3c2c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:13.648391 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-1dc63349-a1f7-4b5f-8f5b-8c2130c68968 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:13.649412 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-1dc63349-a1f7-4b5f-8f5b-8c2130c68968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:13.658199 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-b6eeef51-c93f-4e77-8a0c-81d3a5c3c2c4 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:13.666937 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 780/1557] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:13.667105 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-b6eeef51-c93f-4e77-8a0c-81d3a5c3c2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:13.667206 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddfab1f-8da0-4af1-a866-01841b37f16e None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:13.667206 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddfab1f-8da0-4af1-a866-01841b37f16e None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:13.667206 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddfab1f-8da0-4af1-a866-01841b37f16e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:13.671721 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 778/1558] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:13.672853 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064479e4-ee2f-4397-ae8f-e1ee92f5d364 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:13.673143 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064479e4-ee2f-4397-ae8f-e1ee92f5d364 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:13.673418 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064479e4-ee2f-4397-ae8f-e1ee92f5d364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:13.689193 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-fddfab1f-8da0-4af1-a866-01841b37f16e None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:13.690950 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-fddfab1f-8da0-4af1-a866-01841b37f16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:13.694230 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-064479e4-ee2f-4397-ae8f-e1ee92f5d364 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:13.695422 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-064479e4-ee2f-4397-ae8f-e1ee92f5d364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:13.699513 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 781/1559] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:13.700737 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace2221-992e-4bca-8b70-faab541a3849 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:13.701023 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace2221-992e-4bca-8b70-faab541a3849 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:13.701300 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace2221-992e-4bca-8b70-faab541a3849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:13.707346 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 779/1560] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:13.708167 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064479e4-ee2f-4397-ae8f-e1ee92f5d364 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:13.720070 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064479e4-ee2f-4397-ae8f-e1ee92f5d364 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:13.724895 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bbf6ba-e053-4ca7-ab70-99e4607f228f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:13.725495 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bbf6ba-e053-4ca7-ab70-99e4607f228f admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:13.725777 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bbf6ba-e053-4ca7-ab70-99e4607f228f admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:13.726050 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bbf6ba-e053-4ca7-ab70-99e4607f228f admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:13.726874 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bbf6ba-e053-4ca7-ab70-99e4607f228f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:13.728453 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bbf6ba-e053-4ca7-ab70-99e4607f228f admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:13.731850 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-6ace2221-992e-4bca-8b70-faab541a3849 None None] MFA Rules not processed for user `90e436c041b043529418187b2d2aba85`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:13.733055 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-6ace2221-992e-4bca-8b70-faab541a3849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:13.739104 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 780/1561] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:28:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:28:13.740358 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d922cb9f-0c1e-49db-a422-8cf5e08fd951 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:13.740653 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d922cb9f-0c1e-49db-a422-8cf5e08fd951 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:13.740933 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d922cb9f-0c1e-49db-a422-8cf5e08fd951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:13.767846 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-d922cb9f-0c1e-49db-a422-8cf5e08fd951 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:13.769038 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-d922cb9f-0c1e-49db-a422-8cf5e08fd951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:13.778148 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 781/1562] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:13.779501 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64913477-3b8f-49f2-b7f8-60828c3da415 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:13.779790 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64913477-3b8f-49f2-b7f8-60828c3da415 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:13.780067 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64913477-3b8f-49f2-b7f8-60828c3da415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:13.802543 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-64913477-3b8f-49f2-b7f8-60828c3da415 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:13.803775 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-64913477-3b8f-49f2-b7f8-60828c3da415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:13.806418 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 782/1563] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:13.807979 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c7765-167a-4a4e-ad30-8e1cf108da83 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:13.808266 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c7765-167a-4a4e-ad30-8e1cf108da83 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:13.808539 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c7765-167a-4a4e-ad30-8e1cf108da83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:13.815956 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 782/1564] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:13.817317 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64913477-3b8f-49f2-b7f8-60828c3da415 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:13.829458 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64913477-3b8f-49f2-b7f8-60828c3da415 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:13.830997 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-aa7c7765-167a-4a4e-ad30-8e1cf108da83 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:13.832196 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-aa7c7765-167a-4a4e-ad30-8e1cf108da83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:13.834004 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab59a041-599e-4cc8-af53-3d336ada8af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:13.834654 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab59a041-599e-4cc8-af53-3d336ada8af3 admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:13.834968 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab59a041-599e-4cc8-af53-3d336ada8af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:13.835243 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab59a041-599e-4cc8-af53-3d336ada8af3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:13.835959 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab59a041-599e-4cc8-af53-3d336ada8af3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:28:13.836262 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab59a041-599e-4cc8-af53-3d336ada8af3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:13.837842 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab59a041-599e-4cc8-af53-3d336ada8af3 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:13.840837 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 783/1565] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:13.841612 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c7765-167a-4a4e-ad30-8e1cf108da83 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:13.850632 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c7765-167a-4a4e-ad30-8e1cf108da83 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:13.851358 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 783/1566] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Mar 30 01:28:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:28:13.852643 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a542e-9894-4be2-b8c0-b32650b079cc None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:13.852932 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a542e-9894-4be2-b8c0-b32650b079cc None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:13.853215 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a542e-9894-4be2-b8c0-b32650b079cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:13.856417 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc106fb-ac9d-41ce-b662-3d6f1ece6370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:13.857073 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc106fb-ac9d-41ce-b662-3d6f1ece6370 admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:13.857346 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc106fb-ac9d-41ce-b662-3d6f1ece6370 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:13.857618 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc106fb-ac9d-41ce-b662-3d6f1ece6370 admin admin] PATH_INFO: `/v3/domains` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:13.858333 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc106fb-ac9d-41ce-b662-3d6f1ece6370 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:28:13.858940 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc106fb-ac9d-41ce-b662-3d6f1ece6370 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:13.859997 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING py.warnings [None req-9bc106fb-ac9d-41ce-b662-3d6f1ece6370 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 30 01:28:13.859997 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: warnings.warn(msg) Mar 30 01:28:13.859997 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: Mar 30 01:28:13.860872 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc106fb-ac9d-41ce-b662-3d6f1ece6370 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:13.874750 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-065a542e-9894-4be2-b8c0-b32650b079cc None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:13.874935 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 784/1567] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Mar 30 01:28:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:28:13.874935 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc106fb-ac9d-41ce-b662-3d6f1ece6370 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:13.875114 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-065a542e-9894-4be2-b8c0-b32650b079cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:13.882343 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc106fb-ac9d-41ce-b662-3d6f1ece6370 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:13.886395 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 784/1568] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:13.887366 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a542e-9894-4be2-b8c0-b32650b079cc None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:13.890361 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59bb381-73c3-4131-bd0b-4bb5977761d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:13.891027 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59bb381-73c3-4131-bd0b-4bb5977761d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:13.891308 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59bb381-73c3-4131-bd0b-4bb5977761d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:13.891580 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59bb381-73c3-4131-bd0b-4bb5977761d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:13.892287 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59bb381-73c3-4131-bd0b-4bb5977761d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:13.893859 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59bb381-73c3-4131-bd0b-4bb5977761d9 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:13.896500 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a542e-9894-4be2-b8c0-b32650b079cc None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:13.902090 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095fe488-b3b8-4183-8662-08bfaf9262ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:13.902745 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095fe488-b3b8-4183-8662-08bfaf9262ee admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:13.903034 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095fe488-b3b8-4183-8662-08bfaf9262ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:13.903313 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095fe488-b3b8-4183-8662-08bfaf9262ee admin admin] PATH_INFO: `/v3/domains` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:13.904023 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095fe488-b3b8-4183-8662-08bfaf9262ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:28:13.904324 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095fe488-b3b8-4183-8662-08bfaf9262ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:13.904792 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 785/1569] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:28:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:28:13.905474 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59bb381-73c3-4131-bd0b-4bb5977761d9 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:13.906044 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095fe488-b3b8-4183-8662-08bfaf9262ee admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:13.914855 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59bb381-73c3-4131-bd0b-4bb5977761d9 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:13.919179 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 785/1570] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Mar 30 01:28:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:28:13.920601 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c2792-c7de-4e20-9ca9-09fdc1bff8e9 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:13.920978 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c2792-c7de-4e20-9ca9-09fdc1bff8e9 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:13.921324 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c2792-c7de-4e20-9ca9-09fdc1bff8e9 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:13.923056 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 786/1571] 10.222.0.30 () {54 vars in 960 bytes} [Wed Mar 30 01:28:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:28:13.923810 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345c2792-c7de-4e20-9ca9-09fdc1bff8e9 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:13.927382 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc9ed9d-68e4-4ca6-84b0-6c1f1f3f9b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:13.928140 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc9ed9d-68e4-4ca6-84b0-6c1f1f3f9b7d admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:13.928435 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc9ed9d-68e4-4ca6-84b0-6c1f1f3f9b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:13.928717 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc9ed9d-68e4-4ca6-84b0-6c1f1f3f9b7d admin admin] PATH_INFO: `/v3/domains` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:13.929452 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc9ed9d-68e4-4ca6-84b0-6c1f1f3f9b7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:28:13.929876 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc9ed9d-68e4-4ca6-84b0-6c1f1f3f9b7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:13.931569 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc9ed9d-68e4-4ca6-84b0-6c1f1f3f9b7d admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:13.938191 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345c2792-c7de-4e20-9ca9-09fdc1bff8e9 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:13.942678 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6debe0d6-2044-48bf-aa1d-bcb367c1e6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:13.943335 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debe0d6-2044-48bf-aa1d-bcb367c1e6d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:13.943623 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debe0d6-2044-48bf-aa1d-bcb367c1e6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:13.943761 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 786/1572] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Mar 30 01:28:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:28:13.943977 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debe0d6-2044-48bf-aa1d-bcb367c1e6d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:13.944434 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc9ed9d-68e4-4ca6-84b0-6c1f1f3f9b7d admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:13.944678 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6debe0d6-2044-48bf-aa1d-bcb367c1e6d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:28:13.944990 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6debe0d6-2044-48bf-aa1d-bcb367c1e6d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:13.946567 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6debe0d6-2044-48bf-aa1d-bcb367c1e6d7 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:13.967018 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 787/1573] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Mar 30 01:28:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:28:13.967251 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc9ed9d-68e4-4ca6-84b0-6c1f1f3f9b7d admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:13.967357 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6debe0d6-2044-48bf-aa1d-bcb367c1e6d7 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:13.967456 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9c1e6e-c1c8-490d-9d33-3f4ffc3c74ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:13.967456 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c1e6e-c1c8-490d-9d33-3f4ffc3c74ca admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:13.967456 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c1e6e-c1c8-490d-9d33-3f4ffc3c74ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:13.967456 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c1e6e-c1c8-490d-9d33-3f4ffc3c74ca admin admin] PATH_INFO: `/v3/projects` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:13.968055 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9c1e6e-c1c8-490d-9d33-3f4ffc3c74ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:13.970021 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9c1e6e-c1c8-490d-9d33-3f4ffc3c74ca admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:13.972643 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6debe0d6-2044-48bf-aa1d-bcb367c1e6d7 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:13.980214 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fe1d00-6847-4cc5-983a-cedf7d403143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:13.980791 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe1d00-6847-4cc5-983a-cedf7d403143 admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:13.981073 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe1d00-6847-4cc5-983a-cedf7d403143 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:13.981352 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe1d00-6847-4cc5-983a-cedf7d403143 admin admin] PATH_INFO: `/v3/projects` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:13.982055 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fe1d00-6847-4cc5-983a-cedf7d403143 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:13.983959 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fe1d00-6847-4cc5-983a-cedf7d403143 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:13.997796 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 787/1574] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:28:13 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:28:13.999856 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9c1e6e-c1c8-490d-9d33-3f4ffc3c74ca admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:14.015346 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 788/1575] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:28:13 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:28:14.015346 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fe1d00-6847-4cc5-983a-cedf7d403143 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:14.064053 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9c1e6e-c1c8-490d-9d33-3f4ffc3c74ca admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:14.081069 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fe1d00-6847-4cc5-983a-cedf7d403143 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:14.086389 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40352f74-70d1-46b0-8c34-ebe0dfb8014b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:14.087321 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40352f74-70d1-46b0-8c34-ebe0dfb8014b admin admin] REQUEST_METHOD: `PUT` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:14.087598 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40352f74-70d1-46b0-8c34-ebe0dfb8014b admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:14.087882 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40352f74-70d1-46b0-8c34-ebe0dfb8014b admin admin] PATH_INFO: `/v3/projects/40c47efe85b3419bbfe4af492f367fa3/users/4a2bf75cc4e3465987b8450318708b49/roles/7185d0cfbcd44502b1613bcfe1b42f6f` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:14.103477 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40352f74-70d1-46b0-8c34-ebe0dfb8014b admin admin] RBAC: Authorizing `identity:create_grant(project_id=40c47efe85b3419bbfe4af492f367fa3, user_id=4a2bf75cc4e3465987b8450318708b49, role_id=7185d0cfbcd44502b1613bcfe1b42f6f)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:14.104558 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING py.warnings [None req-40352f74-70d1-46b0-8c34-ebe0dfb8014b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 30 01:28:14.104558 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: warnings.warn(msg) Mar 30 01:28:14.104558 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: Mar 30 01:28:14.106492 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40352f74-70d1-46b0-8c34-ebe0dfb8014b admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:14.119836 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ffb973-02ab-4941-a5ca-e8528f145b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:14.120037 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 789/1576] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:28:14 2022] PUT /identity/v3/projects/40c47efe85b3419bbfe4af492f367fa3/users/4a2bf75cc4e3465987b8450318708b49/roles/7185d0cfbcd44502b1613bcfe1b42f6f => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:28:14.120598 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ffb973-02ab-4941-a5ca-e8528f145b12 admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:14.120881 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ffb973-02ab-4941-a5ca-e8528f145b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:14.121216 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ffb973-02ab-4941-a5ca-e8528f145b12 admin admin] PATH_INFO: `/v3/domains` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:14.121935 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ffb973-02ab-4941-a5ca-e8528f145b12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:28:14.122240 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ffb973-02ab-4941-a5ca-e8528f145b12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:14.123357 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40352f74-70d1-46b0-8c34-ebe0dfb8014b admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:14.123909 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ffb973-02ab-4941-a5ca-e8528f145b12 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:14.142933 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 788/1577] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Mar 30 01:28:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:28:14.142933 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e267b5-8fc0-45c7-a0ff-4aae576c388b None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:14.142933 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e267b5-8fc0-45c7-a0ff-4aae576c388b None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:14.142933 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e267b5-8fc0-45c7-a0ff-4aae576c388b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:14.155330 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-80e267b5-8fc0-45c7-a0ff-4aae576c388b None None] MFA Rules not processed for user `140c6d1a20e94192bde06e72040f162d`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:14.156540 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-80e267b5-8fc0-45c7-a0ff-4aae576c388b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:14.192061 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40352f74-70d1-46b0-8c34-ebe0dfb8014b admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:14.196611 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce088ba5-cda2-414e-90e1-245e5fb11bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:14.197290 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce088ba5-cda2-414e-90e1-245e5fb11bdf admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:14.197572 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce088ba5-cda2-414e-90e1-245e5fb11bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:14.197841 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce088ba5-cda2-414e-90e1-245e5fb11bdf admin admin] PATH_INFO: `/v3/projects` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:14.198600 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce088ba5-cda2-414e-90e1-245e5fb11bdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:14.200555 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce088ba5-cda2-414e-90e1-245e5fb11bdf admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:14.224813 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 790/1578] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:28:14 2022] POST /identity/v3/projects => generated 393 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:28:14.225611 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 789/1579] 10.222.0.30 () {58 vars in 1057 bytes} [Wed Mar 30 01:28:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:14.225989 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce088ba5-cda2-414e-90e1-245e5fb11bdf admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:14.226428 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e267b5-8fc0-45c7-a0ff-4aae576c388b None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:14.237341 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e267b5-8fc0-45c7-a0ff-4aae576c388b None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:14.287893 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce088ba5-cda2-414e-90e1-245e5fb11bdf admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:14.293162 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d311a-104c-4e48-a42f-9ade092de7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:14.293817 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d311a-104c-4e48-a42f-9ade092de7a0 admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:14.294103 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d311a-104c-4e48-a42f-9ade092de7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:14.294362 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d311a-104c-4e48-a42f-9ade092de7a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:14.295188 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9d311a-104c-4e48-a42f-9ade092de7a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:14.296248 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ab2ec-e380-47fc-b015-ac1c4367ab88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:14.297035 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ab2ec-e380-47fc-b015-ac1c4367ab88 admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:14.297165 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9d311a-104c-4e48-a42f-9ade092de7a0 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:14.297391 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ab2ec-e380-47fc-b015-ac1c4367ab88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:14.297791 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ab2ec-e380-47fc-b015-ac1c4367ab88 admin admin] PATH_INFO: `/v3/projects` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:14.298638 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12ab2ec-e380-47fc-b015-ac1c4367ab88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:14.300590 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12ab2ec-e380-47fc-b015-ac1c4367ab88 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:14.322946 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 791/1580] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:28:14 2022] POST /identity/v3/projects => generated 405 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:28:14.323848 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d311a-104c-4e48-a42f-9ade092de7a0 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:14.329478 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 790/1581] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:28:14 2022] POST /identity/v3/projects => generated 375 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:28:14.329478 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ab2ec-e380-47fc-b015-ac1c4367ab88 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:14.383539 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d311a-104c-4e48-a42f-9ade092de7a0 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:14.387694 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ab2ec-e380-47fc-b015-ac1c4367ab88 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:14.388591 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d86353a-f905-4e42-8457-052dec6304c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:14.389245 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d86353a-f905-4e42-8457-052dec6304c5 admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:14.389524 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d86353a-f905-4e42-8457-052dec6304c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:14.389798 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d86353a-f905-4e42-8457-052dec6304c5 admin admin] PATH_INFO: `/v3/users` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:14.390492 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d86353a-f905-4e42-8457-052dec6304c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:14.392404 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d86353a-f905-4e42-8457-052dec6304c5 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:14.392836 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc269608-98dd-4ca3-bac5-b9dbf09967a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:14.393577 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc269608-98dd-4ca3-bac5-b9dbf09967a0 admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:14.393854 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc269608-98dd-4ca3-bac5-b9dbf09967a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:14.394130 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc269608-98dd-4ca3-bac5-b9dbf09967a0 admin admin] PATH_INFO: `/v3/users` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:14.394840 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc269608-98dd-4ca3-bac5-b9dbf09967a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:14.396733 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc269608-98dd-4ca3-bac5-b9dbf09967a0 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:14.413484 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 792/1582] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:28:14 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:28:14.418282 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8af4c7-a198-4d81-a214-6cd9f69f249c None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:14.418811 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8af4c7-a198-4d81-a214-6cd9f69f249c None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:14.418965 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 791/1583] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:28:14 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:28:14.419065 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8af4c7-a198-4d81-a214-6cd9f69f249c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:14.422379 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc269608-98dd-4ca3-bac5-b9dbf09967a0 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:14.431664 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc269608-98dd-4ca3-bac5-b9dbf09967a0 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:14.436434 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826e9089-8a92-4ce6-ac12-c0486a13e092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:14.436759 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-dc8af4c7-a198-4d81-a214-6cd9f69f249c None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:14.437074 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e9089-8a92-4ce6-ac12-c0486a13e092 admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:14.437357 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e9089-8a92-4ce6-ac12-c0486a13e092 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:14.437625 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e9089-8a92-4ce6-ac12-c0486a13e092 admin admin] PATH_INFO: `/v3/projects` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:14.437955 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-dc8af4c7-a198-4d81-a214-6cd9f69f249c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:14.438291 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826e9089-8a92-4ce6-ac12-c0486a13e092 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:14.440210 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826e9089-8a92-4ce6-ac12-c0486a13e092 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:14.445577 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 793/1584] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:14.446393 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8af4c7-a198-4d81-a214-6cd9f69f249c None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:14.455998 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8af4c7-a198-4d81-a214-6cd9f69f249c None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:14.461891 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6203e340-f715-4b24-86a1-d9180c660df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:14.462551 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6203e340-f715-4b24-86a1-d9180c660df9 admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:14.462905 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6203e340-f715-4b24-86a1-d9180c660df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:14.463221 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6203e340-f715-4b24-86a1-d9180c660df9 admin admin] PATH_INFO: `/v3/users` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:14.463904 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6203e340-f715-4b24-86a1-d9180c660df9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:14.465803 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6203e340-f715-4b24-86a1-d9180c660df9 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:14.468009 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 792/1585] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:28:14 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:28:14.468882 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826e9089-8a92-4ce6-ac12-c0486a13e092 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:14.489699 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 794/1586] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:28:14 2022] POST /identity/v3/users => generated 297 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:28:14.489699 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6203e340-f715-4b24-86a1-d9180c660df9 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:14.497596 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6203e340-f715-4b24-86a1-d9180c660df9 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:14.537525 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826e9089-8a92-4ce6-ac12-c0486a13e092 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:14.543256 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c34889-9cc0-4a8b-8e44-d0d320191f46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140c6d1a20e94192bde06e72040f162d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:14.543903 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c34889-9cc0-4a8b-8e44-d0d320191f46 service nova] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:14.544316 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c34889-9cc0-4a8b-8e44-d0d320191f46 service nova] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:14.544589 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c34889-9cc0-4a8b-8e44-d0d320191f46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:14.551658 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffcddd5-ec2f-4285-93d7-f8afa9ea6012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:14.552436 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffcddd5-ec2f-4285-93d7-f8afa9ea6012 admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:14.552719 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffcddd5-ec2f-4285-93d7-f8afa9ea6012 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:14.553023 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffcddd5-ec2f-4285-93d7-f8afa9ea6012 admin admin] PATH_INFO: `/v3/users` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:14.553753 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffcddd5-ec2f-4285-93d7-f8afa9ea6012 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:14.556064 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffcddd5-ec2f-4285-93d7-f8afa9ea6012 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:14.581080 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 795/1587] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:28:14 2022] POST /identity/v3/users => generated 303 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:28:14.581080 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffcddd5-ec2f-4285-93d7-f8afa9ea6012 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:14.588404 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffcddd5-ec2f-4285-93d7-f8afa9ea6012 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:14.592927 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1367da69-d3f2-46cd-9fe7-65dde7e0bc7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:14.593599 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1367da69-d3f2-46cd-9fe7-65dde7e0bc7a admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:14.593880 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1367da69-d3f2-46cd-9fe7-65dde7e0bc7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:14.594155 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1367da69-d3f2-46cd-9fe7-65dde7e0bc7a admin admin] PATH_INFO: `/v3/users` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:14.594886 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1367da69-d3f2-46cd-9fe7-65dde7e0bc7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:14.596780 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1367da69-d3f2-46cd-9fe7-65dde7e0bc7a admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:14.606792 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c34889-9cc0-4a8b-8e44-d0d320191f46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:14.608560 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c34889-9cc0-4a8b-8e44-d0d320191f46 service nova] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:14.616359 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 796/1588] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:28:14 2022] POST /identity/v3/users => generated 288 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:28:14.617653 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 793/1589] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:28:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:28:14.620437 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1367da69-d3f2-46cd-9fe7-65dde7e0bc7a admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:14.620597 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c34889-9cc0-4a8b-8e44-d0d320191f46 service nova] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:14.630655 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1367da69-d3f2-46cd-9fe7-65dde7e0bc7a admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:14.630984 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c34889-9cc0-4a8b-8e44-d0d320191f46 service nova] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:14.635740 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d881354b-695f-42e3-9d98-c3ec38eebbea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:14.636398 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d881354b-695f-42e3-9d98-c3ec38eebbea admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:14.636675 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d881354b-695f-42e3-9d98-c3ec38eebbea admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:14.636944 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d881354b-695f-42e3-9d98-c3ec38eebbea admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:14.637311 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff6d345-75a4-448a-8952-804bebcd9d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:14.637659 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d881354b-695f-42e3-9d98-c3ec38eebbea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:14.638095 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6d345-75a4-448a-8952-804bebcd9d02 admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:14.638444 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6d345-75a4-448a-8952-804bebcd9d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:14.638826 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6d345-75a4-448a-8952-804bebcd9d02 admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:14.639274 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d881354b-695f-42e3-9d98-c3ec38eebbea admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:14.639677 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff6d345-75a4-448a-8952-804bebcd9d02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:14.641417 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff6d345-75a4-448a-8952-804bebcd9d02 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:14.650366 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 797/1590] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:28:14.655189 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d881354b-695f-42e3-9d98-c3ec38eebbea admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:14.655349 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 794/1591] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:28:14.655349 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff6d345-75a4-448a-8952-804bebcd9d02 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:14.664471 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff6d345-75a4-448a-8952-804bebcd9d02 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:14.669229 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b0a7be-f80e-4942-b056-de5813566195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:14.669874 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0a7be-f80e-4942-b056-de5813566195 admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:14.670172 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0a7be-f80e-4942-b056-de5813566195 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:14.670433 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0a7be-f80e-4942-b056-de5813566195 admin admin] PATH_INFO: `/v3/users` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:14.671156 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b0a7be-f80e-4942-b056-de5813566195 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:14.673074 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b0a7be-f80e-4942-b056-de5813566195 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:14.694739 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 795/1592] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:28:14 2022] POST /identity/v3/users => generated 290 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:28:14.698962 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b0a7be-f80e-4942-b056-de5813566195 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:14.709151 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b0a7be-f80e-4942-b056-de5813566195 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:14.714364 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4147e363-c317-413d-bfdd-06da4f263940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:14.715049 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147e363-c317-413d-bfdd-06da4f263940 admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:14.715178 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d881354b-695f-42e3-9d98-c3ec38eebbea admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:14.715339 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147e363-c317-413d-bfdd-06da4f263940 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:14.715618 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147e363-c317-413d-bfdd-06da4f263940 admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:14.716384 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4147e363-c317-413d-bfdd-06da4f263940 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:14.717994 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4147e363-c317-413d-bfdd-06da4f263940 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:14.719286 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edb0205-ebba-4942-8bc9-96a1e6328833 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:14.720284 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb0205-ebba-4942-8bc9-96a1e6328833 service neutron] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:14.720284 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb0205-ebba-4942-8bc9-96a1e6328833 service neutron] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:14.720664 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb0205-ebba-4942-8bc9-96a1e6328833 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:14.729400 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 796/1593] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:28:14.730001 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4147e363-c317-413d-bfdd-06da4f263940 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:14.732769 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edb0205-ebba-4942-8bc9-96a1e6328833 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:14.734296 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edb0205-ebba-4942-8bc9-96a1e6328833 service neutron] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:14.739566 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4147e363-c317-413d-bfdd-06da4f263940 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:14.744736 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 798/1594] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:28:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:28:14.744904 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa9869-17c3-4f21-8ef2-548a8a9ffa1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:14.745551 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa9869-17c3-4f21-8ef2-548a8a9ffa1a admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:14.745835 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa9869-17c3-4f21-8ef2-548a8a9ffa1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:14.746175 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa9869-17c3-4f21-8ef2-548a8a9ffa1a admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:14.746926 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aa9869-17c3-4f21-8ef2-548a8a9ffa1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:14.747907 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edb0205-ebba-4942-8bc9-96a1e6328833 service neutron] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:14.748515 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aa9869-17c3-4f21-8ef2-548a8a9ffa1a admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:14.760538 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 797/1595] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:28:14.761847 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa9869-17c3-4f21-8ef2-548a8a9ffa1a admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:14.762785 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edb0205-ebba-4942-8bc9-96a1e6328833 service neutron] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:14.773961 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776888fa-0217-42e6-8579-e7e3f1684a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:14.774869 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776888fa-0217-42e6-8579-e7e3f1684a00 admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:14.775271 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776888fa-0217-42e6-8579-e7e3f1684a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:14.776159 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776888fa-0217-42e6-8579-e7e3f1684a00 admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:14.777291 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776888fa-0217-42e6-8579-e7e3f1684a00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:14.778754 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776888fa-0217-42e6-8579-e7e3f1684a00 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:14.781694 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa9869-17c3-4f21-8ef2-548a8a9ffa1a admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:14.787921 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7249c459-7e5e-4e5a-bb76-4bc280614d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:14.788852 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249c459-7e5e-4e5a-bb76-4bc280614d9c admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:14.789281 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249c459-7e5e-4e5a-bb76-4bc280614d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:14.789732 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249c459-7e5e-4e5a-bb76-4bc280614d9c admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:14.790596 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7249c459-7e5e-4e5a-bb76-4bc280614d9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:14.790835 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 799/1596] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:28:14.793665 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776888fa-0217-42e6-8579-e7e3f1684a00 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:14.794114 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7249c459-7e5e-4e5a-bb76-4bc280614d9c admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:14.803835 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776888fa-0217-42e6-8579-e7e3f1684a00 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:14.807524 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 798/1597] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:28:14.809136 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7249c459-7e5e-4e5a-bb76-4bc280614d9c admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:14.809598 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0900e695-97cf-4fe5-9186-3a8ba53f1166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:14.810398 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0900e695-97cf-4fe5-9186-3a8ba53f1166 admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:14.810819 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0900e695-97cf-4fe5-9186-3a8ba53f1166 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:14.811236 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0900e695-97cf-4fe5-9186-3a8ba53f1166 admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:14.812090 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0900e695-97cf-4fe5-9186-3a8ba53f1166 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:14.813947 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0900e695-97cf-4fe5-9186-3a8ba53f1166 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:14.823023 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7249c459-7e5e-4e5a-bb76-4bc280614d9c admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:14.829179 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 800/1598] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:28:14.829179 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0900e695-97cf-4fe5-9186-3a8ba53f1166 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:14.835568 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9663ca-51ca-4cce-a84d-0b7a5fb77000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:14.836304 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9663ca-51ca-4cce-a84d-0b7a5fb77000 admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:14.836572 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9663ca-51ca-4cce-a84d-0b7a5fb77000 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:14.839472 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9663ca-51ca-4cce-a84d-0b7a5fb77000 admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:14.840244 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9663ca-51ca-4cce-a84d-0b7a5fb77000 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:14.841863 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9663ca-51ca-4cce-a84d-0b7a5fb77000 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:14.850300 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0900e695-97cf-4fe5-9186-3a8ba53f1166 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:14.857130 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 799/1599] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:28:14.857730 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2adc302-a424-49e6-9865-0779381e38e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:14.858186 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9663ca-51ca-4cce-a84d-0b7a5fb77000 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:14.859213 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2adc302-a424-49e6-9865-0779381e38e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:14.859876 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2adc302-a424-49e6-9865-0779381e38e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:14.860506 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2adc302-a424-49e6-9865-0779381e38e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:14.861522 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2adc302-a424-49e6-9865-0779381e38e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:14.863622 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2adc302-a424-49e6-9865-0779381e38e7 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:14.868376 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9663ca-51ca-4cce-a84d-0b7a5fb77000 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:14.873742 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a201e74-8bcf-46f9-bc89-e08d0fbf9ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:14.874564 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a201e74-8bcf-46f9-bc89-e08d0fbf9ef0 admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:14.874883 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a201e74-8bcf-46f9-bc89-e08d0fbf9ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:14.875160 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a201e74-8bcf-46f9-bc89-e08d0fbf9ef0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:14.875983 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a201e74-8bcf-46f9-bc89-e08d0fbf9ef0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:14.877584 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a201e74-8bcf-46f9-bc89-e08d0fbf9ef0 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:14.881422 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 801/1600] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:28:14.881422 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2adc302-a424-49e6-9865-0779381e38e7 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:14.888899 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 800/1601] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:28:14.890305 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2adc302-a424-49e6-9865-0779381e38e7 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:14.890478 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a201e74-8bcf-46f9-bc89-e08d0fbf9ef0 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:14.897829 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527230f7-358f-4712-8972-ebf9e1f63c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:14.898632 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527230f7-358f-4712-8972-ebf9e1f63c0c admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:14.899088 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527230f7-358f-4712-8972-ebf9e1f63c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:14.899476 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527230f7-358f-4712-8972-ebf9e1f63c0c admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:14.900880 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527230f7-358f-4712-8972-ebf9e1f63c0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:14.902586 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a201e74-8bcf-46f9-bc89-e08d0fbf9ef0 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:14.903093 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527230f7-358f-4712-8972-ebf9e1f63c0c admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:14.909128 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72969fdd-6500-4b2e-b545-146216d0f5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:14.910117 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72969fdd-6500-4b2e-b545-146216d0f5fd admin admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:14.910393 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72969fdd-6500-4b2e-b545-146216d0f5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:14.910665 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72969fdd-6500-4b2e-b545-146216d0f5fd admin admin] PATH_INFO: `/v3/projects/e74548fbecfd414584c6922996d89885/users/62292bd4c3994031b739d81b3d92855f/roles/7185d0cfbcd44502b1613bcfe1b42f6f` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:14.914969 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 802/1602] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:28:14.916041 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527230f7-358f-4712-8972-ebf9e1f63c0c admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:14.926418 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72969fdd-6500-4b2e-b545-146216d0f5fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e74548fbecfd414584c6922996d89885, user_id=62292bd4c3994031b739d81b3d92855f, role_id=7185d0cfbcd44502b1613bcfe1b42f6f)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:14.929049 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527230f7-358f-4712-8972-ebf9e1f63c0c admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:14.929304 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72969fdd-6500-4b2e-b545-146216d0f5fd admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:14.937470 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb3adbb-5673-4197-8641-16bc8b5be200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:14.938400 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb3adbb-5673-4197-8641-16bc8b5be200 admin admin] REQUEST_METHOD: `PUT` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:14.938655 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb3adbb-5673-4197-8641-16bc8b5be200 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:14.938961 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb3adbb-5673-4197-8641-16bc8b5be200 admin admin] PATH_INFO: `/v3/projects/88bae20409534f7ebdb9a6fefb0fd1d3/users/a574f89611cf4d4da99669ef0588ac96/roles/7185d0cfbcd44502b1613bcfe1b42f6f` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:14.954902 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 801/1603] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:28:14 2022] PUT /identity/v3/projects/e74548fbecfd414584c6922996d89885/users/62292bd4c3994031b739d81b3d92855f/roles/7185d0cfbcd44502b1613bcfe1b42f6f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:28:14.955883 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72969fdd-6500-4b2e-b545-146216d0f5fd admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:14.958312 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb3adbb-5673-4197-8641-16bc8b5be200 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88bae20409534f7ebdb9a6fefb0fd1d3, user_id=a574f89611cf4d4da99669ef0588ac96, role_id=7185d0cfbcd44502b1613bcfe1b42f6f)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:14.961217 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb3adbb-5673-4197-8641-16bc8b5be200 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:14.977557 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 803/1604] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:28:14 2022] PUT /identity/v3/projects/88bae20409534f7ebdb9a6fefb0fd1d3/users/a574f89611cf4d4da99669ef0588ac96/roles/7185d0cfbcd44502b1613bcfe1b42f6f => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:28:14.988291 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8091fbc-b708-40fc-9356-40fb1206d5af None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:14.988658 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8091fbc-b708-40fc-9356-40fb1206d5af None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:14.989005 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8091fbc-b708-40fc-9356-40fb1206d5af None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:14.991114 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 804/1605] 10.222.0.30 () {54 vars in 912 bytes} [Wed Mar 30 01:28:14 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:28:14.996385 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8091fbc-b708-40fc-9356-40fb1206d5af None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:15.027486 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72969fdd-6500-4b2e-b545-146216d0f5fd admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:15.064716 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8091fbc-b708-40fc-9356-40fb1206d5af None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:15.069345 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8853f24a-2bb7-47d1-8515-c33ac66fd72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:15.070227 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853f24a-2bb7-47d1-8515-c33ac66fd72b admin admin] REQUEST_METHOD: `PUT` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:15.070596 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853f24a-2bb7-47d1-8515-c33ac66fd72b admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:15.070789 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853f24a-2bb7-47d1-8515-c33ac66fd72b admin admin] PATH_INFO: `/v3/projects/10d8e88a77d8487680652e10a7a18348/users/c610ebdafc22479a8a47892591caaf95/roles/7185d0cfbcd44502b1613bcfe1b42f6f` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:15.085923 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e28f152-4665-4a30-9478-8def829d7963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:15.086725 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e28f152-4665-4a30-9478-8def829d7963 admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:15.087087 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e28f152-4665-4a30-9478-8def829d7963 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:15.087443 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e28f152-4665-4a30-9478-8def829d7963 admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:15.087925 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8853f24a-2bb7-47d1-8515-c33ac66fd72b admin admin] RBAC: Authorizing `identity:create_grant(project_id=10d8e88a77d8487680652e10a7a18348, user_id=c610ebdafc22479a8a47892591caaf95, role_id=7185d0cfbcd44502b1613bcfe1b42f6f)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:15.088979 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e28f152-4665-4a30-9478-8def829d7963 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:15.091757 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e28f152-4665-4a30-9478-8def829d7963 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:15.092215 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8853f24a-2bb7-47d1-8515-c33ac66fd72b admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:15.105191 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 802/1606] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:28:15.106401 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e28f152-4665-4a30-9478-8def829d7963 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:15.113081 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 805/1607] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:28:14 2022] PUT /identity/v3/projects/10d8e88a77d8487680652e10a7a18348/users/c610ebdafc22479a8a47892591caaf95/roles/7185d0cfbcd44502b1613bcfe1b42f6f => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:28:15.116816 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8853f24a-2bb7-47d1-8515-c33ac66fd72b admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:15.117170 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e28f152-4665-4a30-9478-8def829d7963 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:15.190102 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ae9746-d959-418c-a09e-6b28d29ba2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:15.191043 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae9746-d959-418c-a09e-6b28d29ba2bb admin admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:15.191329 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae9746-d959-418c-a09e-6b28d29ba2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:15.191694 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae9746-d959-418c-a09e-6b28d29ba2bb admin admin] PATH_INFO: `/v3/projects/1d66e98408d64eb4b9a1073a56005f19/users/ee9cf76a3a384aae8601dda2605776e4/roles/7185d0cfbcd44502b1613bcfe1b42f6f` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:15.210954 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ae9746-d959-418c-a09e-6b28d29ba2bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d66e98408d64eb4b9a1073a56005f19, user_id=ee9cf76a3a384aae8601dda2605776e4, role_id=7185d0cfbcd44502b1613bcfe1b42f6f)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:15.213281 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8853f24a-2bb7-47d1-8515-c33ac66fd72b admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:15.214749 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ae9746-d959-418c-a09e-6b28d29ba2bb admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:15.221485 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ed3b1a-3fc8-44b0-a16e-fcfa41e22f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:15.222421 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed3b1a-3fc8-44b0-a16e-fcfa41e22f00 admin admin] REQUEST_METHOD: `PUT` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:15.222675 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed3b1a-3fc8-44b0-a16e-fcfa41e22f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:15.223138 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed3b1a-3fc8-44b0-a16e-fcfa41e22f00 admin admin] PATH_INFO: `/v3/projects/039eb3382c0646d4bd8cddff38364c12/users/b5e24981873246ea9df9d121c8dc22a9/roles/7185d0cfbcd44502b1613bcfe1b42f6f` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:15.230362 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 803/1608] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:28:15 2022] PUT /identity/v3/projects/1d66e98408d64eb4b9a1073a56005f19/users/ee9cf76a3a384aae8601dda2605776e4/roles/7185d0cfbcd44502b1613bcfe1b42f6f => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:28:15.231957 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc454f03-0370-4a41-8fe2-ad978156bdda None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:15.232236 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc454f03-0370-4a41-8fe2-ad978156bdda None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:15.232522 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc454f03-0370-4a41-8fe2-ad978156bdda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:15.240206 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ed3b1a-3fc8-44b0-a16e-fcfa41e22f00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=039eb3382c0646d4bd8cddff38364c12, user_id=b5e24981873246ea9df9d121c8dc22a9, role_id=7185d0cfbcd44502b1613bcfe1b42f6f)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:15.242365 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ed3b1a-3fc8-44b0-a16e-fcfa41e22f00 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:15.258822 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 806/1609] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:28:15 2022] PUT /identity/v3/projects/039eb3382c0646d4bd8cddff38364c12/users/b5e24981873246ea9df9d121c8dc22a9/roles/7185d0cfbcd44502b1613bcfe1b42f6f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:28:15.260719 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cecb62-8c90-48e2-9553-32c191a8060b None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:15.261017 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cecb62-8c90-48e2-9553-32c191a8060b None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:15.261295 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cecb62-8c90-48e2-9553-32c191a8060b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:15.267152 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-bc454f03-0370-4a41-8fe2-ad978156bdda None None] MFA Rules not processed for user `62292bd4c3994031b739d81b3d92855f`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:15.268373 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-bc454f03-0370-4a41-8fe2-ad978156bdda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:15.294401 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-a8cecb62-8c90-48e2-9553-32c191a8060b None None] MFA Rules not processed for user `a574f89611cf4d4da99669ef0588ac96`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:15.295700 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-a8cecb62-8c90-48e2-9553-32c191a8060b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:15.345538 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 804/1610] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:15.345538 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdfb041-c260-4c82-8065-ec2fb2016d30 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:15.345538 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdfb041-c260-4c82-8065-ec2fb2016d30 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:15.345538 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdfb041-c260-4c82-8065-ec2fb2016d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:15.364737 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-acdfb041-c260-4c82-8065-ec2fb2016d30 None None] MFA Rules not processed for user `140c6d1a20e94192bde06e72040f162d`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:15.366384 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-acdfb041-c260-4c82-8065-ec2fb2016d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:15.372278 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 807/1611] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:15.372851 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cecb62-8c90-48e2-9553-32c191a8060b None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:15.452782 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cecb62-8c90-48e2-9553-32c191a8060b None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:15.454682 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 805/1612] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Mar 30 01:28:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:15.456295 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b3839-123e-4e54-ac7c-0fa6221a4249 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:15.457084 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b3839-123e-4e54-ac7c-0fa6221a4249 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:15.457354 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b3839-123e-4e54-ac7c-0fa6221a4249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:15.464884 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0134b241-934a-4f4e-9fc0-c47e1009a944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:15.466514 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0134b241-934a-4f4e-9fc0-c47e1009a944 admin admin] REQUEST_METHOD: `PUT` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:15.466514 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0134b241-934a-4f4e-9fc0-c47e1009a944 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:15.466514 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0134b241-934a-4f4e-9fc0-c47e1009a944 admin admin] PATH_INFO: `/v3/projects/36ec6db6f0a941ef9b2b72c285362951/users/82e0471675454cd69f0b28c0edf570b3/roles/7185d0cfbcd44502b1613bcfe1b42f6f` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:15.478260 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-be8b3839-123e-4e54-ac7c-0fa6221a4249 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:15.479669 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-be8b3839-123e-4e54-ac7c-0fa6221a4249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:15.483833 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0134b241-934a-4f4e-9fc0-c47e1009a944 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36ec6db6f0a941ef9b2b72c285362951, user_id=82e0471675454cd69f0b28c0edf570b3, role_id=7185d0cfbcd44502b1613bcfe1b42f6f)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:15.486991 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0134b241-934a-4f4e-9fc0-c47e1009a944 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:15.489242 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 806/1613] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:15.492487 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471fa261-7f68-4d72-80cc-2a65bc4d3036 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:15.492487 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471fa261-7f68-4d72-80cc-2a65bc4d3036 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:15.492487 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471fa261-7f68-4d72-80cc-2a65bc4d3036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:15.509452 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 808/1614] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:28:15 2022] PUT /identity/v3/projects/36ec6db6f0a941ef9b2b72c285362951/users/82e0471675454cd69f0b28c0edf570b3/roles/7185d0cfbcd44502b1613bcfe1b42f6f => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:28:15.509452 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51dc0b-fcfd-4efe-acaf-4179d626d8a7 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:15.509452 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51dc0b-fcfd-4efe-acaf-4179d626d8a7 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:15.509452 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51dc0b-fcfd-4efe-acaf-4179d626d8a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:15.519779 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-471fa261-7f68-4d72-80cc-2a65bc4d3036 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:15.521690 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-471fa261-7f68-4d72-80cc-2a65bc4d3036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:15.530488 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-7b51dc0b-fcfd-4efe-acaf-4179d626d8a7 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:15.532798 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-7b51dc0b-fcfd-4efe-acaf-4179d626d8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:15.604375 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 809/1615] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:15.605355 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b51dc0b-fcfd-4efe-acaf-4179d626d8a7 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:15.622627 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 807/1616] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:15.624357 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6d248-225d-4b09-aedd-05de21668d85 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:15.624653 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6d248-225d-4b09-aedd-05de21668d85 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:15.624927 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6d248-225d-4b09-aedd-05de21668d85 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:15.627446 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 808/1617] 10.222.0.30 () {54 vars in 960 bytes} [Wed Mar 30 01:28:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:28:15.628014 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a6d248-225d-4b09-aedd-05de21668d85 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:15.632590 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b51dc0b-fcfd-4efe-acaf-4179d626d8a7 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:15.638087 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e2a3c8-cce2-4e78-8c35-603915becadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:15.639024 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2a3c8-cce2-4e78-8c35-603915becadc admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:15.639463 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2a3c8-cce2-4e78-8c35-603915becadc admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:15.639907 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2a3c8-cce2-4e78-8c35-603915becadc admin admin] PATH_INFO: `/v3/projects` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:15.641070 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e2a3c8-cce2-4e78-8c35-603915becadc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:15.643315 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e2a3c8-cce2-4e78-8c35-603915becadc admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:15.679567 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 810/1618] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:28:15 2022] POST /identity/v3/projects => generated 383 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:28:15.683628 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e2a3c8-cce2-4e78-8c35-603915becadc admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:15.707695 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a6d248-225d-4b09-aedd-05de21668d85 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:15.754882 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e2a3c8-cce2-4e78-8c35-603915becadc admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:15.762115 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fcd5f1-1dfb-4b6c-a6ee-30a72f6b1dbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:15.762774 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fcd5f1-1dfb-4b6c-a6ee-30a72f6b1dbe service neutron] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:15.763165 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fcd5f1-1dfb-4b6c-a6ee-30a72f6b1dbe service neutron] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:15.763465 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fcd5f1-1dfb-4b6c-a6ee-30a72f6b1dbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:15.770488 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e176e39c-1503-4cbe-a7eb-d20e21e84051 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45219f386f0147b6bd380efe4ab62812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:15.771292 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176e39c-1503-4cbe-a7eb-d20e21e84051 service cinder] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:15.771647 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176e39c-1503-4cbe-a7eb-d20e21e84051 service cinder] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:15.771988 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176e39c-1503-4cbe-a7eb-d20e21e84051 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:15.853972 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fcd5f1-1dfb-4b6c-a6ee-30a72f6b1dbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:15.855819 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fcd5f1-1dfb-4b6c-a6ee-30a72f6b1dbe service neutron] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:15.864411 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e176e39c-1503-4cbe-a7eb-d20e21e84051 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:15.873831 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e176e39c-1503-4cbe-a7eb-d20e21e84051 service cinder] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:15.886565 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 811/1619] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:28:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:28:15.889290 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadcf139-3e17-4fa9-a460-50207b218340 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:15.890968 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadcf139-3e17-4fa9-a460-50207b218340 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:15.891467 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadcf139-3e17-4fa9-a460-50207b218340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:15.896201 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 809/1620] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:28:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:28:15.897036 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e176e39c-1503-4cbe-a7eb-d20e21e84051 service cinder] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:15.913286 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e176e39c-1503-4cbe-a7eb-d20e21e84051 service cinder] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:15.919044 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec2dfe-2ef5-474f-8eb3-25c188120aba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:15.922876 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec2dfe-2ef5-474f-8eb3-25c188120aba service neutron] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:15.923430 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec2dfe-2ef5-474f-8eb3-25c188120aba service neutron] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:15.923819 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec2dfe-2ef5-474f-8eb3-25c188120aba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:15.940408 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cec2dfe-2ef5-474f-8eb3-25c188120aba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:15.942843 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cec2dfe-2ef5-474f-8eb3-25c188120aba service neutron] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:15.957439 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 810/1621] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:28:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:28:15.958151 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-fadcf139-3e17-4fa9-a460-50207b218340 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:15.959395 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec2dfe-2ef5-474f-8eb3-25c188120aba service neutron] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:15.960889 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-fadcf139-3e17-4fa9-a460-50207b218340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:15.970752 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec2dfe-2ef5-474f-8eb3-25c188120aba service neutron] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:15.971935 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 812/1622] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:15.973731 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb4484-cd91-4c72-b88b-02b4dd7bce39 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:15.974059 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb4484-cd91-4c72-b88b-02b4dd7bce39 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:15.974501 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb4484-cd91-4c72-b88b-02b4dd7bce39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:15.981830 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c94e5e-99bf-44bc-95b1-3b588d23850d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:15.982644 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c94e5e-99bf-44bc-95b1-3b588d23850d service neutron] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:15.983063 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c94e5e-99bf-44bc-95b1-3b588d23850d service neutron] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:15.983479 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c94e5e-99bf-44bc-95b1-3b588d23850d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:15.997479 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c94e5e-99bf-44bc-95b1-3b588d23850d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:15.999407 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c94e5e-99bf-44bc-95b1-3b588d23850d service neutron] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:16.011245 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 811/1623] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:28:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:28:16.012496 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c94e5e-99bf-44bc-95b1-3b588d23850d service neutron] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:16.024231 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c94e5e-99bf-44bc-95b1-3b588d23850d service neutron] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:16.028259 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-61eb4484-cd91-4c72-b88b-02b4dd7bce39 None None] MFA Rules not processed for user `140c6d1a20e94192bde06e72040f162d`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:16.031359 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f881491-9668-4c55-9e38-31186880baba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:16.032922 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f881491-9668-4c55-9e38-31186880baba admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:16.033292 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f881491-9668-4c55-9e38-31186880baba admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:16.033643 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f881491-9668-4c55-9e38-31186880baba admin admin] PATH_INFO: `/v3/users` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:16.034536 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-61eb4484-cd91-4c72-b88b-02b4dd7bce39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:16.035195 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f881491-9668-4c55-9e38-31186880baba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:16.037355 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f881491-9668-4c55-9e38-31186880baba admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:16.061399 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 813/1624] 10.222.0.30 () {58 vars in 1057 bytes} [Wed Mar 30 01:28:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:16.062410 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb4484-cd91-4c72-b88b-02b4dd7bce39 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:16.069640 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 812/1625] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:28:16 2022] POST /identity/v3/users => generated 298 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:28:16.072097 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f881491-9668-4c55-9e38-31186880baba admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:16.083182 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb4484-cd91-4c72-b88b-02b4dd7bce39 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:16.085594 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f881491-9668-4c55-9e38-31186880baba admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:16.093599 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e907cdb1-fbbe-4a78-b4a5-5fbcaa5074c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:16.094468 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907cdb1-fbbe-4a78-b4a5-5fbcaa5074c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:16.095355 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647879b6-eabb-4f29-a2c0-9735ed1bf150 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:16.095565 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907cdb1-fbbe-4a78-b4a5-5fbcaa5074c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:16.096017 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647879b6-eabb-4f29-a2c0-9735ed1bf150 service neutron] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:16.096136 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907cdb1-fbbe-4a78-b4a5-5fbcaa5074c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:16.096300 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647879b6-eabb-4f29-a2c0-9735ed1bf150 service neutron] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:16.096579 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647879b6-eabb-4f29-a2c0-9735ed1bf150 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:16.097394 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e907cdb1-fbbe-4a78-b4a5-5fbcaa5074c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:16.100402 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e907cdb1-fbbe-4a78-b4a5-5fbcaa5074c3 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:16.118068 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 813/1626] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:28:16.118528 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647879b6-eabb-4f29-a2c0-9735ed1bf150 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:16.119718 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e907cdb1-fbbe-4a78-b4a5-5fbcaa5074c3 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:16.120395 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647879b6-eabb-4f29-a2c0-9735ed1bf150 service neutron] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:16.137250 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e907cdb1-fbbe-4a78-b4a5-5fbcaa5074c3 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:16.144789 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a3ebe9-cde9-4336-ae26-c495f9c44108 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140c6d1a20e94192bde06e72040f162d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:16.144978 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 814/1627] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:28:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:28:16.145696 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3ebe9-cde9-4336-ae26-c495f9c44108 service nova] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:16.145812 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647879b6-eabb-4f29-a2c0-9735ed1bf150 service neutron] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:16.146249 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3ebe9-cde9-4336-ae26-c495f9c44108 service nova] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:16.146630 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3ebe9-cde9-4336-ae26-c495f9c44108 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:16.173074 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647879b6-eabb-4f29-a2c0-9735ed1bf150 service neutron] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:16.188244 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fefe9d-667d-4346-867e-954122af1232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:16.188244 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fefe9d-667d-4346-867e-954122af1232 admin admin] REQUEST_METHOD: `PUT` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:16.188244 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fefe9d-667d-4346-867e-954122af1232 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:16.188244 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fefe9d-667d-4346-867e-954122af1232 admin admin] PATH_INFO: `/v3/projects/966a6c65c9d84dfba161ec920152ef9b/users/d84830c513604c2a9bb9b37fc1fcb6a7/roles/36909bbf31d04993bb2a9fe587b572dc` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:16.219784 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fefe9d-667d-4346-867e-954122af1232 admin admin] RBAC: Authorizing `identity:create_grant(project_id=966a6c65c9d84dfba161ec920152ef9b, user_id=d84830c513604c2a9bb9b37fc1fcb6a7, role_id=36909bbf31d04993bb2a9fe587b572dc)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:16.222489 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fefe9d-667d-4346-867e-954122af1232 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:16.222630 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a3ebe9-cde9-4336-ae26-c495f9c44108 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:16.224388 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a3ebe9-cde9-4336-ae26-c495f9c44108 service nova] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:16.238774 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 814/1628] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:28:16 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:28:16.250999 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 815/1629] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:28:16 2022] PUT /identity/v3/projects/966a6c65c9d84dfba161ec920152ef9b/users/d84830c513604c2a9bb9b37fc1fcb6a7/roles/36909bbf31d04993bb2a9fe587b572dc => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:28:16.254830 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a3ebe9-cde9-4336-ae26-c495f9c44108 service nova] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:16.269530 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a3ebe9-cde9-4336-ae26-c495f9c44108 service nova] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:16.343029 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714db650-c18e-43cf-8c4b-941a0e286e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:16.344120 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714db650-c18e-43cf-8c4b-941a0e286e98 admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:16.344531 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714db650-c18e-43cf-8c4b-941a0e286e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:16.345654 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714db650-c18e-43cf-8c4b-941a0e286e98 admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:16.346757 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714db650-c18e-43cf-8c4b-941a0e286e98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:16.349348 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714db650-c18e-43cf-8c4b-941a0e286e98 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:16.364619 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 815/1630] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:28:16.368539 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fefe9d-667d-4346-867e-954122af1232 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:16.382292 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fefe9d-667d-4346-867e-954122af1232 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:16.390851 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772ae81d-a893-45d4-993e-7f298a7cb4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:16.392093 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ae81d-a893-45d4-993e-7f298a7cb4b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:16.392482 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ae81d-a893-45d4-993e-7f298a7cb4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:16.393243 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ae81d-a893-45d4-993e-7f298a7cb4b0 admin admin] PATH_INFO: `/v3/projects/966a6c65c9d84dfba161ec920152ef9b/users/d84830c513604c2a9bb9b37fc1fcb6a7/roles/36909bbf31d04993bb2a9fe587b572dc` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:16.396804 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772ae81d-a893-45d4-993e-7f298a7cb4b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=966a6c65c9d84dfba161ec920152ef9b, user_id=d84830c513604c2a9bb9b37fc1fcb6a7, role_id=36909bbf31d04993bb2a9fe587b572dc)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:16.401087 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772ae81d-a893-45d4-993e-7f298a7cb4b0 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:16.418926 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 816/1631] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:28:16 2022] PUT /identity/v3/projects/966a6c65c9d84dfba161ec920152ef9b/users/d84830c513604c2a9bb9b37fc1fcb6a7/roles/36909bbf31d04993bb2a9fe587b572dc => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:28:16.428907 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d2202-8172-425b-a623-4a7a2b65f16b None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:16.429200 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d2202-8172-425b-a623-4a7a2b65f16b None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:16.429500 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d2202-8172-425b-a623-4a7a2b65f16b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:16.504132 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-e67d2202-8172-425b-a623-4a7a2b65f16b None None] MFA Rules not processed for user `d84830c513604c2a9bb9b37fc1fcb6a7`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:16.506324 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-e67d2202-8172-425b-a623-4a7a2b65f16b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:16.659735 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 816/1632] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:16 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:16.680198 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772ae81d-a893-45d4-993e-7f298a7cb4b0 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:16.798378 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772ae81d-a893-45d4-993e-7f298a7cb4b0 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:16.805552 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7080ed-a1bb-4176-9440-753e182171e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45219f386f0147b6bd380efe4ab62812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:16.807256 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7080ed-a1bb-4176-9440-753e182171e2 service cinder] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:16.807765 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7080ed-a1bb-4176-9440-753e182171e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:16.808274 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7080ed-a1bb-4176-9440-753e182171e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:16.833364 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7080ed-a1bb-4176-9440-753e182171e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:16.836508 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7080ed-a1bb-4176-9440-753e182171e2 service cinder] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:16.874991 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 817/1633] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:28:16 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:28:16.932096 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d2202-8172-425b-a623-4a7a2b65f16b None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:16.975549 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2d8b2-a0c9-4338-9e2c-2887288eb8af None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:16.976079 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2d8b2-a0c9-4338-9e2c-2887288eb8af None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:16.976519 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2d8b2-a0c9-4338-9e2c-2887288eb8af None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:16.979289 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 818/1634] 10.222.0.30 () {54 vars in 912 bytes} [Wed Mar 30 01:28:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 01:28:16.989585 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d9eb7-fe91-4b86-9f28-cc9d42b3a46b None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:16.989585 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d9eb7-fe91-4b86-9f28-cc9d42b3a46b None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:16.989832 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d9eb7-fe91-4b86-9f28-cc9d42b3a46b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:17.081591 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-805d9eb7-fe91-4b86-9f28-cc9d42b3a46b None None] MFA Rules not processed for user `140c6d1a20e94192bde06e72040f162d`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:17.086909 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-805d9eb7-fe91-4b86-9f28-cc9d42b3a46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:17.185445 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d2202-8172-425b-a623-4a7a2b65f16b None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:17.191849 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe424e43-e801-43cf-adc7-c364444ea4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:17.193843 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe424e43-e801-43cf-adc7-c364444ea4f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:17.193843 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe424e43-e801-43cf-adc7-c364444ea4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:17.193843 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe424e43-e801-43cf-adc7-c364444ea4f1 admin admin] PATH_INFO: `/v3/users/62292bd4c3994031b739d81b3d92855f` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:17.194802 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe424e43-e801-43cf-adc7-c364444ea4f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62292bd4c3994031b739d81b3d92855f)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:17.196758 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe424e43-e801-43cf-adc7-c364444ea4f1 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:17.291654 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 819/1635] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Mar 30 01:28:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:17.300609 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-fe424e43-e801-43cf-adc7-c364444ea4f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62292bd4c3994031b739d81b3d92855f'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:17.318800 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-fe424e43-e801-43cf-adc7-c364444ea4f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62292bd4c3994031b739d81b3d92855f'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:17.319598 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-fe424e43-e801-43cf-adc7-c364444ea4f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62292bd4c3994031b739d81b3d92855f'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:17.319724 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d9eb7-fe91-4b86-9f28-cc9d42b3a46b None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:17.335911 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-fe424e43-e801-43cf-adc7-c364444ea4f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62292bd4c3994031b739d81b3d92855f'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:17.337469 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d9eb7-fe91-4b86-9f28-cc9d42b3a46b None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:17.345492 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def94ef-3ace-47cb-8538-044ce11f8e33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45219f386f0147b6bd380efe4ab62812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:17.346160 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def94ef-3ace-47cb-8538-044ce11f8e33 service cinder] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:17.346442 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def94ef-3ace-47cb-8538-044ce11f8e33 service cinder] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:17.347003 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def94ef-3ace-47cb-8538-044ce11f8e33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:17.349246 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-7def94ef-3ace-47cb-8538-044ce11f8e33 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:17.360718 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-fe424e43-e801-43cf-adc7-c364444ea4f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62292bd4c3994031b739d81b3d92855f'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:17.368905 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7def94ef-3ace-47cb-8538-044ce11f8e33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:17.371053 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7def94ef-3ace-47cb-8538-044ce11f8e33 service cinder] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:17.376147 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 817/1636] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:28:16 2022] DELETE /identity/v3/users/62292bd4c3994031b739d81b3d92855f => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:28:17.378544 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01a03af-b5ad-4145-82ca-c0bd50097c00 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:17.387102 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 820/1637] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:28:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 30 01:28:17.410036 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01a03af-b5ad-4145-82ca-c0bd50097c00 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:17.412039 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01a03af-b5ad-4145-82ca-c0bd50097c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:17.472144 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-e01a03af-b5ad-4145-82ca-c0bd50097c00 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:17.475124 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-e01a03af-b5ad-4145-82ca-c0bd50097c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:17.597372 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def94ef-3ace-47cb-8538-044ce11f8e33 service cinder] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:17.599218 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-7def94ef-3ace-47cb-8538-044ce11f8e33 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:17.612746 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 818/1638] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:17.626579 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def94ef-3ace-47cb-8538-044ce11f8e33 service cinder] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:17.632262 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01a03af-b5ad-4145-82ca-c0bd50097c00 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:17.633845 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-e01a03af-b5ad-4145-82ca-c0bd50097c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:17.646505 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d6b8bf-5bda-403c-9976-6b5a83e0cd84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:17.647510 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6b8bf-5bda-403c-9976-6b5a83e0cd84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:17.648600 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6b8bf-5bda-403c-9976-6b5a83e0cd84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:17.655876 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6b8bf-5bda-403c-9976-6b5a83e0cd84 admin admin] PATH_INFO: `/v3/users/a574f89611cf4d4da99669ef0588ac96` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:17.658922 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d6b8bf-5bda-403c-9976-6b5a83e0cd84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a574f89611cf4d4da99669ef0588ac96)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:17.659967 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: WARNING py.warnings [None req-99d6b8bf-5bda-403c-9976-6b5a83e0cd84 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 30 01:28:17.659967 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: warnings.warn(msg) Mar 30 01:28:17.659967 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: Mar 30 01:28:17.662732 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d6b8bf-5bda-403c-9976-6b5a83e0cd84 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:17.759500 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01a03af-b5ad-4145-82ca-c0bd50097c00 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:17.774211 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce64c2cc-b99a-4eae-b4d7-5089f50b518b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:17.777926 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce64c2cc-b99a-4eae-b4d7-5089f50b518b service neutron] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:17.778368 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce64c2cc-b99a-4eae-b4d7-5089f50b518b service neutron] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:17.779800 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce64c2cc-b99a-4eae-b4d7-5089f50b518b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:17.803011 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce64c2cc-b99a-4eae-b4d7-5089f50b518b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:17.803313 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-99d6b8bf-5bda-403c-9976-6b5a83e0cd84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a574f89611cf4d4da99669ef0588ac96'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:17.805374 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce64c2cc-b99a-4eae-b4d7-5089f50b518b service neutron] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:17.844537 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 819/1639] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:28:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 30 01:28:17.852845 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-99d6b8bf-5bda-403c-9976-6b5a83e0cd84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a574f89611cf4d4da99669ef0588ac96'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:17.866120 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-99d6b8bf-5bda-403c-9976-6b5a83e0cd84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a574f89611cf4d4da99669ef0588ac96'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:17.866887 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-99d6b8bf-5bda-403c-9976-6b5a83e0cd84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a574f89611cf4d4da99669ef0588ac96'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:17.884395 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-99d6b8bf-5bda-403c-9976-6b5a83e0cd84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a574f89611cf4d4da99669ef0588ac96'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:17.897262 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 821/1640] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:28:17 2022] DELETE /identity/v3/users/a574f89611cf4d4da99669ef0588ac96 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:28:17.899738 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af8b41-a253-4a6a-b04a-d25502ed96fa None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:17.900796 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af8b41-a253-4a6a-b04a-d25502ed96fa None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:17.901255 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af8b41-a253-4a6a-b04a-d25502ed96fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:17.931318 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-05af8b41-a253-4a6a-b04a-d25502ed96fa None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:17.933069 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-05af8b41-a253-4a6a-b04a-d25502ed96fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:18.036748 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 820/1641] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:18.072058 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d6b8bf-5bda-403c-9976-6b5a83e0cd84 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:18.076947 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-99d6b8bf-5bda-403c-9976-6b5a83e0cd84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:18.206352 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d6b8bf-5bda-403c-9976-6b5a83e0cd84 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:18.211403 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19081de3-39b7-4c6c-82e0-8ad9756edfd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:18.212557 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19081de3-39b7-4c6c-82e0-8ad9756edfd9 service neutron] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:18.213420 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19081de3-39b7-4c6c-82e0-8ad9756edfd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:18.213872 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19081de3-39b7-4c6c-82e0-8ad9756edfd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:18.233981 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19081de3-39b7-4c6c-82e0-8ad9756edfd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:18.236971 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19081de3-39b7-4c6c-82e0-8ad9756edfd9 service neutron] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:18.270950 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 822/1642] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:28:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:28:19.100842 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d71e98-6571-40e8-acea-ef455fed258d None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:19.101327 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d71e98-6571-40e8-acea-ef455fed258d None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:19.101437 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d71e98-6571-40e8-acea-ef455fed258d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:19.149430 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-f8d71e98-6571-40e8-acea-ef455fed258d None None] MFA Rules not processed for user `ee9cf76a3a384aae8601dda2605776e4`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:19.152833 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-f8d71e98-6571-40e8-acea-ef455fed258d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:19.219871 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19081de3-39b7-4c6c-82e0-8ad9756edfd9 service neutron] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:19.221617 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-19081de3-39b7-4c6c-82e0-8ad9756edfd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:19.250212 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19081de3-39b7-4c6c-82e0-8ad9756edfd9 service neutron] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:19.271970 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2201c8-ccdc-4dc0-9ba7-0f3aaf81aa57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:19.273416 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2201c8-ccdc-4dc0-9ba7-0f3aaf81aa57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:19.273910 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2201c8-ccdc-4dc0-9ba7-0f3aaf81aa57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:19.274386 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2201c8-ccdc-4dc0-9ba7-0f3aaf81aa57 admin admin] PATH_INFO: `/v3/projects/e74548fbecfd414584c6922996d89885` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:19.277832 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2201c8-ccdc-4dc0-9ba7-0f3aaf81aa57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e74548fbecfd414584c6922996d89885)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:19.280237 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2201c8-ccdc-4dc0-9ba7-0f3aaf81aa57 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:19.302107 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 821/1643] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:19 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:19.307455 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d71e98-6571-40e8-acea-ef455fed258d None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:19.311482 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-f8d71e98-6571-40e8-acea-ef455fed258d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:19.342608 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d71e98-6571-40e8-acea-ef455fed258d None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:19.349286 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850ea461-5669-4e5b-912e-e5eb47c26137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:19.350286 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ea461-5669-4e5b-912e-e5eb47c26137 admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:19.350790 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ea461-5669-4e5b-912e-e5eb47c26137 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:19.351257 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ea461-5669-4e5b-912e-e5eb47c26137 admin admin] PATH_INFO: `/v3/projects` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:19.352220 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850ea461-5669-4e5b-912e-e5eb47c26137 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:19.355087 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850ea461-5669-4e5b-912e-e5eb47c26137 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:19.393269 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 822/1644] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:28:19 2022] POST /identity/v3/projects => generated 403 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:28:19.395349 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-0d2201c8-ccdc-4dc0-9ba7-0f3aaf81aa57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e74548fbecfd414584c6922996d89885', 'request_id': 'req-0d2201c8-ccdc-4dc0-9ba7-0f3aaf81aa57'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:19.397646 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850ea461-5669-4e5b-912e-e5eb47c26137 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:19.419997 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-0d2201c8-ccdc-4dc0-9ba7-0f3aaf81aa57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e74548fbecfd414584c6922996d89885', 'request_id': 'req-0d2201c8-ccdc-4dc0-9ba7-0f3aaf81aa57'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:19.436848 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-0d2201c8-ccdc-4dc0-9ba7-0f3aaf81aa57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e74548fbecfd414584c6922996d89885', 'request_id': 'req-0d2201c8-ccdc-4dc0-9ba7-0f3aaf81aa57'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:19.450313 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-0d2201c8-ccdc-4dc0-9ba7-0f3aaf81aa57 admin admin] The token cache is being invalidate because project e74548fbecfd414584c6922996d89885 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:28:19.450784 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-0d2201c8-ccdc-4dc0-9ba7-0f3aaf81aa57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:19.451684 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-0d2201c8-ccdc-4dc0-9ba7-0f3aaf81aa57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:19.454585 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 823/1645] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:28:19 2022] DELETE /identity/v3/projects/e74548fbecfd414584c6922996d89885 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:28:19.458800 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2201c8-ccdc-4dc0-9ba7-0f3aaf81aa57 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:19.461236 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-0d2201c8-ccdc-4dc0-9ba7-0f3aaf81aa57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:19.527140 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850ea461-5669-4e5b-912e-e5eb47c26137 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:19.539270 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83814641-d0d1-4a79-8b73-03a5784436d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:19.539978 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83814641-d0d1-4a79-8b73-03a5784436d4 admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:19.540238 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83814641-d0d1-4a79-8b73-03a5784436d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:19.540703 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83814641-d0d1-4a79-8b73-03a5784436d4 admin admin] PATH_INFO: `/v3/users` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:19.542090 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83814641-d0d1-4a79-8b73-03a5784436d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:19.544231 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83814641-d0d1-4a79-8b73-03a5784436d4 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:19.553792 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2201c8-ccdc-4dc0-9ba7-0f3aaf81aa57 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:19.561810 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c617da-3336-45d1-91a2-74f7fbae0acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:19.563543 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c617da-3336-45d1-91a2-74f7fbae0acb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:19.564046 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c617da-3336-45d1-91a2-74f7fbae0acb admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:19.564614 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c617da-3336-45d1-91a2-74f7fbae0acb admin admin] PATH_INFO: `/v3/users/d84830c513604c2a9bb9b37fc1fcb6a7` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:19.568022 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c617da-3336-45d1-91a2-74f7fbae0acb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d84830c513604c2a9bb9b37fc1fcb6a7)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:19.571243 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c617da-3336-45d1-91a2-74f7fbae0acb admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:19.589766 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 823/1646] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:28:19 2022] POST /identity/v3/users => generated 308 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 01:28:19.593752 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83814641-d0d1-4a79-8b73-03a5784436d4 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:19.595633 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-83814641-d0d1-4a79-8b73-03a5784436d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:19.622985 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83814641-d0d1-4a79-8b73-03a5784436d4 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:19.637934 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8678b502-bbfa-4362-856c-c5d52a0ba57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:19.638936 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8678b502-bbfa-4362-856c-c5d52a0ba57c admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:19.639376 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8678b502-bbfa-4362-856c-c5d52a0ba57c admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:19.639561 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-29c617da-3336-45d1-91a2-74f7fbae0acb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd84830c513604c2a9bb9b37fc1fcb6a7'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:19.639799 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8678b502-bbfa-4362-856c-c5d52a0ba57c admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:19.640698 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8678b502-bbfa-4362-856c-c5d52a0ba57c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:19.642473 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8678b502-bbfa-4362-856c-c5d52a0ba57c admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:19.655142 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-29c617da-3336-45d1-91a2-74f7fbae0acb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd84830c513604c2a9bb9b37fc1fcb6a7'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:19.664426 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 824/1647] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:28:19 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 01:28:19.665671 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8678b502-bbfa-4362-856c-c5d52a0ba57c admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:19.668703 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-29c617da-3336-45d1-91a2-74f7fbae0acb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd84830c513604c2a9bb9b37fc1fcb6a7'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:19.669774 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-29c617da-3336-45d1-91a2-74f7fbae0acb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd84830c513604c2a9bb9b37fc1fcb6a7'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:19.678970 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-29c617da-3336-45d1-91a2-74f7fbae0acb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd84830c513604c2a9bb9b37fc1fcb6a7'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:19.680858 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8678b502-bbfa-4362-856c-c5d52a0ba57c admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:19.688006 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 824/1648] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:28:19 2022] DELETE /identity/v3/users/d84830c513604c2a9bb9b37fc1fcb6a7 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:28:19.695843 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075562e5-0f72-4b2d-8a49-db7c1423697f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:19.696752 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075562e5-0f72-4b2d-8a49-db7c1423697f admin admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:19.697030 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075562e5-0f72-4b2d-8a49-db7c1423697f admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:19.698088 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075562e5-0f72-4b2d-8a49-db7c1423697f admin admin] PATH_INFO: `/v3/projects/0820e41d54864df6954e2d71fa6ac6ff/users/afea8c1288044245a31dff26342b92cc/roles/36909bbf31d04993bb2a9fe587b572dc` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:19.733470 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075562e5-0f72-4b2d-8a49-db7c1423697f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0820e41d54864df6954e2d71fa6ac6ff, user_id=afea8c1288044245a31dff26342b92cc, role_id=36909bbf31d04993bb2a9fe587b572dc)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:19.736432 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075562e5-0f72-4b2d-8a49-db7c1423697f admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:19.766319 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 825/1649] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:28:19 2022] PUT /identity/v3/projects/0820e41d54864df6954e2d71fa6ac6ff/users/afea8c1288044245a31dff26342b92cc/roles/36909bbf31d04993bb2a9fe587b572dc => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:28:19.770373 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c617da-3336-45d1-91a2-74f7fbae0acb admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:19.773615 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-29c617da-3336-45d1-91a2-74f7fbae0acb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:19.902330 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c617da-3336-45d1-91a2-74f7fbae0acb admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:20.008958 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37692863-2581-40d9-81c4-9a184df53253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:20.011298 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37692863-2581-40d9-81c4-9a184df53253 admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:20.011626 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37692863-2581-40d9-81c4-9a184df53253 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:20.012006 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37692863-2581-40d9-81c4-9a184df53253 admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:20.012944 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37692863-2581-40d9-81c4-9a184df53253 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:20.015603 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37692863-2581-40d9-81c4-9a184df53253 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:20.029359 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 825/1650] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:28:19 2022] GET /identity/v3/roles => generated 1420 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:28:20.033393 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075562e5-0f72-4b2d-8a49-db7c1423697f admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:20.043888 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075562e5-0f72-4b2d-8a49-db7c1423697f admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:20.060055 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2b0421-0e09-4b2f-901c-cc0a47d2f72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:20.061546 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b0421-0e09-4b2f-901c-cc0a47d2f72c admin admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:20.061845 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b0421-0e09-4b2f-901c-cc0a47d2f72c admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:20.062571 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b0421-0e09-4b2f-901c-cc0a47d2f72c admin admin] PATH_INFO: `/v3/projects/0820e41d54864df6954e2d71fa6ac6ff/users/afea8c1288044245a31dff26342b92cc/roles/36909bbf31d04993bb2a9fe587b572dc` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:20.075712 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2b0421-0e09-4b2f-901c-cc0a47d2f72c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0820e41d54864df6954e2d71fa6ac6ff, user_id=afea8c1288044245a31dff26342b92cc, role_id=36909bbf31d04993bb2a9fe587b572dc)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:20.078388 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2b0421-0e09-4b2f-901c-cc0a47d2f72c admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:20.095417 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 826/1651] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:28:20 2022] PUT /identity/v3/projects/0820e41d54864df6954e2d71fa6ac6ff/users/afea8c1288044245a31dff26342b92cc/roles/36909bbf31d04993bb2a9fe587b572dc => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:28:20.564933 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37692863-2581-40d9-81c4-9a184df53253 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:20.566792 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-37692863-2581-40d9-81c4-9a184df53253 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:20.591857 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37692863-2581-40d9-81c4-9a184df53253 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:20.738053 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810268c4-dff0-4eab-b89f-d81088d43e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:20.738528 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cfd660-fe92-4464-9247-a4a07499f01d None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:20.739057 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cfd660-fe92-4464-9247-a4a07499f01d None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:20.739186 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810268c4-dff0-4eab-b89f-d81088d43e2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:20.739366 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810268c4-dff0-4eab-b89f-d81088d43e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:20.739474 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cfd660-fe92-4464-9247-a4a07499f01d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:20.740477 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810268c4-dff0-4eab-b89f-d81088d43e2e admin admin] PATH_INFO: `/v3/projects/966a6c65c9d84dfba161ec920152ef9b` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:20.741873 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810268c4-dff0-4eab-b89f-d81088d43e2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=966a6c65c9d84dfba161ec920152ef9b)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:20.749727 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810268c4-dff0-4eab-b89f-d81088d43e2e admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:20.799207 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-35cfd660-fe92-4464-9247-a4a07499f01d None None] MFA Rules not processed for user `82e0471675454cd69f0b28c0edf570b3`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:20.800609 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-35cfd660-fe92-4464-9247-a4a07499f01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:20.867378 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-810268c4-dff0-4eab-b89f-d81088d43e2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '966a6c65c9d84dfba161ec920152ef9b', 'request_id': 'req-810268c4-dff0-4eab-b89f-d81088d43e2e'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:20.889863 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-810268c4-dff0-4eab-b89f-d81088d43e2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '966a6c65c9d84dfba161ec920152ef9b', 'request_id': 'req-810268c4-dff0-4eab-b89f-d81088d43e2e'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:20.906511 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-810268c4-dff0-4eab-b89f-d81088d43e2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '966a6c65c9d84dfba161ec920152ef9b', 'request_id': 'req-810268c4-dff0-4eab-b89f-d81088d43e2e'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:20.945746 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-810268c4-dff0-4eab-b89f-d81088d43e2e admin admin] The token cache is being invalidate because project 966a6c65c9d84dfba161ec920152ef9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:28:20.946265 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-810268c4-dff0-4eab-b89f-d81088d43e2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:20.949251 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-810268c4-dff0-4eab-b89f-d81088d43e2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:20.957525 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 826/1652] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:28:20 2022] DELETE /identity/v3/projects/966a6c65c9d84dfba161ec920152ef9b => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:28:20.960348 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810268c4-dff0-4eab-b89f-d81088d43e2e admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:20.964936 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-810268c4-dff0-4eab-b89f-d81088d43e2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:21.049733 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 827/1653] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 01:28:21.058872 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56abb5d0-bbcd-42fa-943a-836b8262b415 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:21.064710 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56abb5d0-bbcd-42fa-943a-836b8262b415 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:21.065777 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56abb5d0-bbcd-42fa-943a-836b8262b415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:21.147058 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-56abb5d0-bbcd-42fa-943a-836b8262b415 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:21.149300 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-56abb5d0-bbcd-42fa-943a-836b8262b415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:21.276659 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810268c4-dff0-4eab-b89f-d81088d43e2e admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:21.291208 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6d94b3-bac3-4e2b-8dec-a71b62843cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:21.292327 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d94b3-bac3-4e2b-8dec-a71b62843cf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:21.292616 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d94b3-bac3-4e2b-8dec-a71b62843cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:21.292898 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d94b3-bac3-4e2b-8dec-a71b62843cf8 admin admin] PATH_INFO: `/v3/projects/88bae20409534f7ebdb9a6fefb0fd1d3` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:21.295955 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 828/1654] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:21.296164 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6d94b3-bac3-4e2b-8dec-a71b62843cf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88bae20409534f7ebdb9a6fefb0fd1d3)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:21.298202 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6d94b3-bac3-4e2b-8dec-a71b62843cf8 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:21.300717 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72055c0d-0329-4932-92a2-784cdf00d14e None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:21.301184 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72055c0d-0329-4932-92a2-784cdf00d14e None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:21.301615 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72055c0d-0329-4932-92a2-784cdf00d14e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:21.338905 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-72055c0d-0329-4932-92a2-784cdf00d14e None None] MFA Rules not processed for user `82e0471675454cd69f0b28c0edf570b3`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:21.341328 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-72055c0d-0329-4932-92a2-784cdf00d14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:21.409131 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-cc6d94b3-bac3-4e2b-8dec-a71b62843cf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88bae20409534f7ebdb9a6fefb0fd1d3', 'request_id': 'req-cc6d94b3-bac3-4e2b-8dec-a71b62843cf8'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:21.435693 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-cc6d94b3-bac3-4e2b-8dec-a71b62843cf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88bae20409534f7ebdb9a6fefb0fd1d3', 'request_id': 'req-cc6d94b3-bac3-4e2b-8dec-a71b62843cf8'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:21.455142 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-cc6d94b3-bac3-4e2b-8dec-a71b62843cf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88bae20409534f7ebdb9a6fefb0fd1d3', 'request_id': 'req-cc6d94b3-bac3-4e2b-8dec-a71b62843cf8'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:21.485111 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-cc6d94b3-bac3-4e2b-8dec-a71b62843cf8 admin admin] The token cache is being invalidate because project 88bae20409534f7ebdb9a6fefb0fd1d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:28:21.485407 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-cc6d94b3-bac3-4e2b-8dec-a71b62843cf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:21.487502 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 829/1655] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:21 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:21.489200 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b783d-40ce-4e7e-bf90-1c2393e13405 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:21.489485 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b783d-40ce-4e7e-bf90-1c2393e13405 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:21.489760 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b783d-40ce-4e7e-bf90-1c2393e13405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:21.491054 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-cc6d94b3-bac3-4e2b-8dec-a71b62843cf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:21.499735 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 827/1656] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:28:20 2022] DELETE /identity/v3/projects/88bae20409534f7ebdb9a6fefb0fd1d3 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:28:21.500726 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6d94b3-bac3-4e2b-8dec-a71b62843cf8 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:21.503908 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-cc6d94b3-bac3-4e2b-8dec-a71b62843cf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:21.540335 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-620b783d-40ce-4e7e-bf90-1c2393e13405 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:21.543851 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-620b783d-40ce-4e7e-bf90-1c2393e13405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:21.688161 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6d94b3-bac3-4e2b-8dec-a71b62843cf8 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:21.697680 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f406ff9a-db0b-4cc0-8a34-46b0ed77d1f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140c6d1a20e94192bde06e72040f162d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:21.698678 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f406ff9a-db0b-4cc0-8a34-46b0ed77d1f4 service nova] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:21.699275 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f406ff9a-db0b-4cc0-8a34-46b0ed77d1f4 service nova] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:21.699854 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f406ff9a-db0b-4cc0-8a34-46b0ed77d1f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:21.702246 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-f406ff9a-db0b-4cc0-8a34-46b0ed77d1f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:21.718524 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 830/1657] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:21.719760 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82fca85-b4cf-4ee1-b992-acfd8503d395 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:21.720146 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82fca85-b4cf-4ee1-b992-acfd8503d395 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:21.720527 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82fca85-b4cf-4ee1-b992-acfd8503d395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:21.768204 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-e82fca85-b4cf-4ee1-b992-acfd8503d395 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:21.769695 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-e82fca85-b4cf-4ee1-b992-acfd8503d395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:21.786988 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 831/1658] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:21.792351 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82fca85-b4cf-4ee1-b992-acfd8503d395 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:21.812324 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f406ff9a-db0b-4cc0-8a34-46b0ed77d1f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:21.815277 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f406ff9a-db0b-4cc0-8a34-46b0ed77d1f4 service nova] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:21.829283 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82fca85-b4cf-4ee1-b992-acfd8503d395 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:21.834418 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96050e7-af63-4262-a709-f1673f6badbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:21.835238 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96050e7-af63-4262-a709-f1673f6badbf admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:21.835624 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96050e7-af63-4262-a709-f1673f6badbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:21.835997 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96050e7-af63-4262-a709-f1673f6badbf admin admin] PATH_INFO: `/v3/domains` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:21.836854 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96050e7-af63-4262-a709-f1673f6badbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:28:21.837258 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96050e7-af63-4262-a709-f1673f6badbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:21.839878 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96050e7-af63-4262-a709-f1673f6badbf admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:21.851065 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 828/1659] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:28:21 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:28:21.872105 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03456b99-362c-4979-9203-7370b501c1e0 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:21.872474 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03456b99-362c-4979-9203-7370b501c1e0 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:21.872829 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03456b99-362c-4979-9203-7370b501c1e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:21.881326 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 832/1660] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Mar 30 01:28:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:28:21.888881 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96050e7-af63-4262-a709-f1673f6badbf admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:21.912556 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96050e7-af63-4262-a709-f1673f6badbf admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:21.927340 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a6931-24fc-4550-807a-37f215b6e1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:21.927340 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a6931-24fc-4550-807a-37f215b6e1ab admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:21.927340 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a6931-24fc-4550-807a-37f215b6e1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:21.927340 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a6931-24fc-4550-807a-37f215b6e1ab admin admin] PATH_INFO: `/v3/projects` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:21.927969 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521a6931-24fc-4550-807a-37f215b6e1ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:21.932137 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521a6931-24fc-4550-807a-37f215b6e1ab admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:21.940520 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-03456b99-362c-4979-9203-7370b501c1e0 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:21.943839 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-03456b99-362c-4979-9203-7370b501c1e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:21.966824 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 829/1661] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:21.970009 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03456b99-362c-4979-9203-7370b501c1e0 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:21.995672 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03456b99-362c-4979-9203-7370b501c1e0 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:22.006362 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 833/1662] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:28:21 2022] POST /identity/v3/projects => generated 381 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 01:28:22.008082 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a6931-24fc-4550-807a-37f215b6e1ab admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:22.159821 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a6931-24fc-4550-807a-37f215b6e1ab admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:22.173997 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be95a238-9e42-44f1-9fb9-a5869ec179b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:22.175556 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0385f8d-4c05-44e3-bbad-be36082a5dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:22.176282 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0385f8d-4c05-44e3-bbad-be36082a5dd5 admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:22.176570 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0385f8d-4c05-44e3-bbad-be36082a5dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:22.176848 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0385f8d-4c05-44e3-bbad-be36082a5dd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:22.177605 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0385f8d-4c05-44e3-bbad-be36082a5dd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:28:22.177918 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0385f8d-4c05-44e3-bbad-be36082a5dd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:22.179633 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0385f8d-4c05-44e3-bbad-be36082a5dd5 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:22.194761 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be95a238-9e42-44f1-9fb9-a5869ec179b3 admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:22.195962 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be95a238-9e42-44f1-9fb9-a5869ec179b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:22.196667 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be95a238-9e42-44f1-9fb9-a5869ec179b3 admin admin] PATH_INFO: `/v3/users` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:22.198914 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be95a238-9e42-44f1-9fb9-a5869ec179b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:22.202297 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be95a238-9e42-44f1-9fb9-a5869ec179b3 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:22.219036 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 830/1663] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Mar 30 01:28:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:28:22.220492 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0385f8d-4c05-44e3-bbad-be36082a5dd5 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:22.245328 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0385f8d-4c05-44e3-bbad-be36082a5dd5 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:22.284966 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bb2329-48b1-4ee0-a28b-ea428c54986d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:22.285902 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb2329-48b1-4ee0-a28b-ea428c54986d admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:22.285902 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb2329-48b1-4ee0-a28b-ea428c54986d admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:22.286186 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb2329-48b1-4ee0-a28b-ea428c54986d admin admin] PATH_INFO: `/v3/projects` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:22.286923 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bb2329-48b1-4ee0-a28b-ea428c54986d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:22.288863 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bb2329-48b1-4ee0-a28b-ea428c54986d admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:22.302535 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 834/1664] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:28:22 2022] POST /identity/v3/users => generated 291 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:28:22.303802 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be95a238-9e42-44f1-9fb9-a5869ec179b3 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:22.338791 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be95a238-9e42-44f1-9fb9-a5869ec179b3 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:22.344604 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e26b11e-af74-4f6a-979f-96993e76fecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:22.345633 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26b11e-af74-4f6a-979f-96993e76fecb admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:22.346042 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26b11e-af74-4f6a-979f-96993e76fecb admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:22.372043 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 831/1665] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:28:22 2022] POST /identity/v3/projects => generated 367 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 01:28:22.372043 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bb2329-48b1-4ee0-a28b-ea428c54986d admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:22.373331 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26b11e-af74-4f6a-979f-96993e76fecb admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:22.374604 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e26b11e-af74-4f6a-979f-96993e76fecb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:22.376783 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e26b11e-af74-4f6a-979f-96993e76fecb admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:22.392503 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 835/1666] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:28:22.399368 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e26b11e-af74-4f6a-979f-96993e76fecb admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:22.423809 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e26b11e-af74-4f6a-979f-96993e76fecb admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:22.496914 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bb2329-48b1-4ee0-a28b-ea428c54986d admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:22.516171 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1ed825-517f-4e3f-8fee-5f1b72a5cf39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:22.518834 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ed825-517f-4e3f-8fee-5f1b72a5cf39 admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:22.519817 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ed825-517f-4e3f-8fee-5f1b72a5cf39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:22.521521 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ed825-517f-4e3f-8fee-5f1b72a5cf39 admin admin] PATH_INFO: `/v3/users` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:22.525354 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1ed825-517f-4e3f-8fee-5f1b72a5cf39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:22.533688 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1ed825-517f-4e3f-8fee-5f1b72a5cf39 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:22.577358 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e0681-3a9a-46e5-8606-9759fd6b78ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:22.577358 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e0681-3a9a-46e5-8606-9759fd6b78ed admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:22.577358 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e0681-3a9a-46e5-8606-9759fd6b78ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:22.577358 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e0681-3a9a-46e5-8606-9759fd6b78ed admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:22.577818 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83e0681-3a9a-46e5-8606-9759fd6b78ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:22.579609 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83e0681-3a9a-46e5-8606-9759fd6b78ed admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:22.580037 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 832/1667] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:28:22 2022] POST /identity/v3/users => generated 284 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:28:22.581330 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1ed825-517f-4e3f-8fee-5f1b72a5cf39 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:22.602124 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1ed825-517f-4e3f-8fee-5f1b72a5cf39 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:22.606763 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 836/1668] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:28:22.608799 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e0681-3a9a-46e5-8606-9759fd6b78ed admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:22.620773 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0359de18-4b17-460e-b0dd-61a24020a293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:22.622584 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359de18-4b17-460e-b0dd-61a24020a293 admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:22.624247 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359de18-4b17-460e-b0dd-61a24020a293 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:22.624524 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359de18-4b17-460e-b0dd-61a24020a293 admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:22.625307 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0359de18-4b17-460e-b0dd-61a24020a293 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:22.627489 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0359de18-4b17-460e-b0dd-61a24020a293 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:22.635468 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e0681-3a9a-46e5-8606-9759fd6b78ed admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:22.651210 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 833/1669] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:28:22.651430 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d60445-22bf-4b89-b033-5f36486960a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:22.651430 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d60445-22bf-4b89-b033-5f36486960a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:22.651430 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d60445-22bf-4b89-b033-5f36486960a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:22.651700 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d60445-22bf-4b89-b033-5f36486960a5 admin admin] PATH_INFO: `/v3/projects/05420669ba0c4974925180bd3e257274/users/87d9290dee8848f490a743c067345ed9/roles/7185d0cfbcd44502b1613bcfe1b42f6f` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:22.653386 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0359de18-4b17-460e-b0dd-61a24020a293 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:22.675018 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0359de18-4b17-460e-b0dd-61a24020a293 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:22.684472 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d60445-22bf-4b89-b033-5f36486960a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05420669ba0c4974925180bd3e257274, user_id=87d9290dee8848f490a743c067345ed9, role_id=7185d0cfbcd44502b1613bcfe1b42f6f)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:22.687249 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d60445-22bf-4b89-b033-5f36486960a5 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:22.690236 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5232e9ba-7a35-4196-8b2c-38bece43a028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:22.690936 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5232e9ba-7a35-4196-8b2c-38bece43a028 admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:22.691418 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5232e9ba-7a35-4196-8b2c-38bece43a028 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:22.693834 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5232e9ba-7a35-4196-8b2c-38bece43a028 admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:22.694882 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5232e9ba-7a35-4196-8b2c-38bece43a028 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:22.696715 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5232e9ba-7a35-4196-8b2c-38bece43a028 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:22.719693 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 837/1670] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:28:22 2022] PUT /identity/v3/projects/05420669ba0c4974925180bd3e257274/users/87d9290dee8848f490a743c067345ed9/roles/7185d0cfbcd44502b1613bcfe1b42f6f => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:28:22.720165 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 834/1671] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:28:22.732431 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d60445-22bf-4b89-b033-5f36486960a5 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:22.736584 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbfc136-b13c-49f6-99b3-c91a1ef65727 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:22.737657 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbfc136-b13c-49f6-99b3-c91a1ef65727 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:22.738423 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbfc136-b13c-49f6-99b3-c91a1ef65727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:22.790185 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-dfbfc136-b13c-49f6-99b3-c91a1ef65727 None None] MFA Rules not processed for user `87d9290dee8848f490a743c067345ed9`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:22.792811 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-dfbfc136-b13c-49f6-99b3-c91a1ef65727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:22.864587 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d60445-22bf-4b89-b033-5f36486960a5 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:22.878391 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4452e1d3-c68b-4a25-aa2f-61dd3ef82711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:22.879794 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452e1d3-c68b-4a25-aa2f-61dd3ef82711 admin admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:22.880257 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452e1d3-c68b-4a25-aa2f-61dd3ef82711 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:22.880812 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452e1d3-c68b-4a25-aa2f-61dd3ef82711 admin admin] PATH_INFO: `/v3/projects/6b8cd6901a754b5da51fadd625c3426a/users/43f30c12e9314d568ba7443b3b4c84f8/roles/7185d0cfbcd44502b1613bcfe1b42f6f` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:22.907900 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 835/1672] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:22.911540 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbfc136-b13c-49f6-99b3-c91a1ef65727 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:22.914828 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4452e1d3-c68b-4a25-aa2f-61dd3ef82711 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b8cd6901a754b5da51fadd625c3426a, user_id=43f30c12e9314d568ba7443b3b4c84f8, role_id=7185d0cfbcd44502b1613bcfe1b42f6f)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:22.918190 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4452e1d3-c68b-4a25-aa2f-61dd3ef82711 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:22.938518 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbfc136-b13c-49f6-99b3-c91a1ef65727 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:22.947424 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d61ac1-4623-44ea-b271-5545b95d732e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:22.949131 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d61ac1-4623-44ea-b271-5545b95d732e admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:22.950386 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d61ac1-4623-44ea-b271-5545b95d732e admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:22.950527 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d61ac1-4623-44ea-b271-5545b95d732e admin admin] PATH_INFO: `/v3/projects` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:22.951790 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d61ac1-4623-44ea-b271-5545b95d732e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:22.955062 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d61ac1-4623-44ea-b271-5545b95d732e admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:22.956047 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 838/1673] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:28:22 2022] PUT /identity/v3/projects/6b8cd6901a754b5da51fadd625c3426a/users/43f30c12e9314d568ba7443b3b4c84f8/roles/7185d0cfbcd44502b1613bcfe1b42f6f => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:28:22.968263 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fae58c-ae89-476b-824a-8aba97064e29 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:22.968725 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fae58c-ae89-476b-824a-8aba97064e29 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:22.969147 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fae58c-ae89-476b-824a-8aba97064e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:23.012925 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 836/1674] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:28:22 2022] POST /identity/v3/projects => generated 379 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:28:23.013879 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d61ac1-4623-44ea-b271-5545b95d732e admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:23.055395 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-57fae58c-ae89-476b-824a-8aba97064e29 None None] MFA Rules not processed for user `43f30c12e9314d568ba7443b3b4c84f8`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:23.059322 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-57fae58c-ae89-476b-824a-8aba97064e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:23.185521 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d61ac1-4623-44ea-b271-5545b95d732e admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:23.193027 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84498180-aad9-4302-9565-d01f21137533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:23.194465 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84498180-aad9-4302-9565-d01f21137533 admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:23.194916 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84498180-aad9-4302-9565-d01f21137533 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:23.195297 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84498180-aad9-4302-9565-d01f21137533 admin admin] PATH_INFO: `/v3/users` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:23.198297 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84498180-aad9-4302-9565-d01f21137533 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:23.200916 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84498180-aad9-4302-9565-d01f21137533 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:23.220629 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 839/1675] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:22 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:23.222027 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d783c-3f7b-4708-b3b2-4c4255573c27 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:23.222312 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d783c-3f7b-4708-b3b2-4c4255573c27 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:23.222632 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d783c-3f7b-4708-b3b2-4c4255573c27 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:23.224409 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 840/1676] 10.222.0.30 () {54 vars in 912 bytes} [Wed Mar 30 01:28:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:28:23.225098 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d783c-3f7b-4708-b3b2-4c4255573c27 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:23.236842 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 837/1677] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:28:23 2022] POST /identity/v3/users => generated 296 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:28:23.239966 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce12f90a-8eeb-4789-afdd-d29586a0f789 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:23.240333 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce12f90a-8eeb-4789-afdd-d29586a0f789 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:23.240680 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce12f90a-8eeb-4789-afdd-d29586a0f789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:23.253163 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d783c-3f7b-4708-b3b2-4c4255573c27 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:23.265460 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1a0307-f299-478d-b653-e0b683380921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:23.266136 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a0307-f299-478d-b653-e0b683380921 admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:23.266418 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a0307-f299-478d-b653-e0b683380921 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:23.266863 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a0307-f299-478d-b653-e0b683380921 admin admin] PATH_INFO: `/v3/projects` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:23.267574 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1a0307-f299-478d-b653-e0b683380921 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:23.269514 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1a0307-f299-478d-b653-e0b683380921 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:23.316099 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-ce12f90a-8eeb-4789-afdd-d29586a0f789 None None] MFA Rules not processed for user `41745b7f8a804e75b490a0a34977b23b`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:23.318608 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-ce12f90a-8eeb-4789-afdd-d29586a0f789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:23.325146 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 841/1678] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:28:23 2022] POST /identity/v3/projects => generated 367 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:28:23.326033 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1a0307-f299-478d-b653-e0b683380921 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:23.426324 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 838/1679] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Mar 30 01:28:23 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:23.427208 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce12f90a-8eeb-4789-afdd-d29586a0f789 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:23.475117 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1a0307-f299-478d-b653-e0b683380921 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:23.487770 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8e16b6-983b-40b2-82be-6a911ab88ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:23.488380 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e16b6-983b-40b2-82be-6a911ab88ade admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:23.488657 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e16b6-983b-40b2-82be-6a911ab88ade admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:23.488930 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e16b6-983b-40b2-82be-6a911ab88ade admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:23.490293 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8e16b6-983b-40b2-82be-6a911ab88ade admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:23.491945 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8e16b6-983b-40b2-82be-6a911ab88ade admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:23.511930 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 842/1680] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:28:23 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:28:23.515144 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8e16b6-983b-40b2-82be-6a911ab88ade admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:23.545483 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8e16b6-983b-40b2-82be-6a911ab88ade admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:23.568545 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3acc3b1-dbd6-430c-80da-d7d87ca73e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:23.569455 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3acc3b1-dbd6-430c-80da-d7d87ca73e68 admin admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:23.569741 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3acc3b1-dbd6-430c-80da-d7d87ca73e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:23.570408 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3acc3b1-dbd6-430c-80da-d7d87ca73e68 admin admin] PATH_INFO: `/v3/projects/131200c7555b447e8f7f9e2c69a4b5f5/users/aa02bae88a7f4e218a329bb18aa24f4d/roles/36909bbf31d04993bb2a9fe587b572dc` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:23.624199 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce12f90a-8eeb-4789-afdd-d29586a0f789 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:23.650679 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1561913b-c612-476c-984c-c56e41556372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:23.655084 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561913b-c612-476c-984c-c56e41556372 admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:23.656066 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561913b-c612-476c-984c-c56e41556372 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:23.657062 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3acc3b1-dbd6-430c-80da-d7d87ca73e68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=131200c7555b447e8f7f9e2c69a4b5f5, user_id=aa02bae88a7f4e218a329bb18aa24f4d, role_id=36909bbf31d04993bb2a9fe587b572dc)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:23.657735 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561913b-c612-476c-984c-c56e41556372 admin admin] PATH_INFO: `/v3/users` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:23.659786 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1561913b-c612-476c-984c-c56e41556372 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:23.661924 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3acc3b1-dbd6-430c-80da-d7d87ca73e68 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:23.664076 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1561913b-c612-476c-984c-c56e41556372 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:23.720435 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 843/1681] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:28:23 2022] PUT /identity/v3/projects/131200c7555b447e8f7f9e2c69a4b5f5/users/aa02bae88a7f4e218a329bb18aa24f4d/roles/36909bbf31d04993bb2a9fe587b572dc => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:28:23.721694 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3acc3b1-dbd6-430c-80da-d7d87ca73e68 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:23.725458 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-a3acc3b1-dbd6-430c-80da-d7d87ca73e68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:23.729822 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 839/1682] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:28:23 2022] POST /identity/v3/users => generated 290 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:28:23.730667 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1561913b-c612-476c-984c-c56e41556372 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:23.773393 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1561913b-c612-476c-984c-c56e41556372 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:23.895887 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3acc3b1-dbd6-430c-80da-d7d87ca73e68 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:23.909607 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2bb5f8-3656-4e02-8fd4-c2dc2764ec7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:23.910492 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2bb5f8-3656-4e02-8fd4-c2dc2764ec7e service neutron] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:23.910959 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2bb5f8-3656-4e02-8fd4-c2dc2764ec7e service neutron] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:23.911400 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2bb5f8-3656-4e02-8fd4-c2dc2764ec7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:23.926400 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2bb5f8-3656-4e02-8fd4-c2dc2764ec7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:23.928726 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2bb5f8-3656-4e02-8fd4-c2dc2764ec7e service neutron] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:23.958766 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 844/1683] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:28:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:28:23.961054 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2bb5f8-3656-4e02-8fd4-c2dc2764ec7e service neutron] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:23.968996 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6cd1a2-a508-453e-9663-349db775a627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:23.969693 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6cd1a2-a508-453e-9663-349db775a627 admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:23.970016 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6cd1a2-a508-453e-9663-349db775a627 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:23.970255 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6cd1a2-a508-453e-9663-349db775a627 admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:23.971179 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6cd1a2-a508-453e-9663-349db775a627 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:23.972877 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6cd1a2-a508-453e-9663-349db775a627 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:23.995892 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2bb5f8-3656-4e02-8fd4-c2dc2764ec7e service neutron] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:24.014051 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f552927-d9de-4561-9b97-c1911eb8c2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:24.016526 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f552927-d9de-4561-9b97-c1911eb8c2b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:24.017353 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f552927-d9de-4561-9b97-c1911eb8c2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:24.018339 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f552927-d9de-4561-9b97-c1911eb8c2b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:24.020937 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f552927-d9de-4561-9b97-c1911eb8c2b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:24.024059 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f552927-d9de-4561-9b97-c1911eb8c2b1 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:24.029093 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 840/1684] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:28:23 2022] GET /identity/v3/roles => generated 1420 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:28:24.030246 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6cd1a2-a508-453e-9663-349db775a627 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:24.061272 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6cd1a2-a508-453e-9663-349db775a627 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:24.069087 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68bc1b6-7a7b-4df8-8b69-7d9d68dac7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:24.070222 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 845/1685] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:28:23 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:28:24.071173 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68bc1b6-7a7b-4df8-8b69-7d9d68dac7a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:24.072924 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f552927-d9de-4561-9b97-c1911eb8c2b1 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:24.074237 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68bc1b6-7a7b-4df8-8b69-7d9d68dac7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:24.074761 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68bc1b6-7a7b-4df8-8b69-7d9d68dac7a0 admin admin] PATH_INFO: `/v3/projects/131200c7555b447e8f7f9e2c69a4b5f5/users/aa02bae88a7f4e218a329bb18aa24f4d/roles/36909bbf31d04993bb2a9fe587b572dc` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:24.080104 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68bc1b6-7a7b-4df8-8b69-7d9d68dac7a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=131200c7555b447e8f7f9e2c69a4b5f5, user_id=aa02bae88a7f4e218a329bb18aa24f4d, role_id=36909bbf31d04993bb2a9fe587b572dc)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:24.082809 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68bc1b6-7a7b-4df8-8b69-7d9d68dac7a0 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:24.098983 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f552927-d9de-4561-9b97-c1911eb8c2b1 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:24.119636 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 841/1686] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:28:24 2022] PUT /identity/v3/projects/131200c7555b447e8f7f9e2c69a4b5f5/users/aa02bae88a7f4e218a329bb18aa24f4d/roles/36909bbf31d04993bb2a9fe587b572dc => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:28:24.131294 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9533ff-5484-4851-b0d6-e28b48b6b013 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:24.131583 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9533ff-5484-4851-b0d6-e28b48b6b013 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:24.131869 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9533ff-5484-4851-b0d6-e28b48b6b013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:24.221384 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-5f9533ff-5484-4851-b0d6-e28b48b6b013 None None] MFA Rules not processed for user `aa02bae88a7f4e218a329bb18aa24f4d`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:24.222583 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-5f9533ff-5484-4851-b0d6-e28b48b6b013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:24.308324 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1548325-2ed2-4940-89c0-4d74b8e0a263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:24.309278 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1548325-2ed2-4940-89c0-4d74b8e0a263 admin admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:24.309506 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1548325-2ed2-4940-89c0-4d74b8e0a263 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:24.309785 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1548325-2ed2-4940-89c0-4d74b8e0a263 admin admin] PATH_INFO: `/v3/projects/fe18794e373a4d0d82d62bb9d79eb6d6/users/f6ce779bf8174f70889ff5ab9906275c/roles/36909bbf31d04993bb2a9fe587b572dc` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:24.358329 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1548325-2ed2-4940-89c0-4d74b8e0a263 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe18794e373a4d0d82d62bb9d79eb6d6, user_id=f6ce779bf8174f70889ff5ab9906275c, role_id=36909bbf31d04993bb2a9fe587b572dc)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:24.367655 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1548325-2ed2-4940-89c0-4d74b8e0a263 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:24.399947 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 846/1687] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:28:24 2022] PUT /identity/v3/projects/fe18794e373a4d0d82d62bb9d79eb6d6/users/f6ce779bf8174f70889ff5ab9906275c/roles/36909bbf31d04993bb2a9fe587b572dc => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:28:24.401888 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1548325-2ed2-4940-89c0-4d74b8e0a263 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:24.403933 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 842/1688] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:24 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:24.422223 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9533ff-5484-4851-b0d6-e28b48b6b013 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:24.424950 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-5f9533ff-5484-4851-b0d6-e28b48b6b013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:24.577423 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9533ff-5484-4851-b0d6-e28b48b6b013 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:24.579273 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1548325-2ed2-4940-89c0-4d74b8e0a263 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:24.590456 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012d420c-a4d0-4c93-90b9-58ebc88088bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:24.591562 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d420c-a4d0-4c93-90b9-58ebc88088bd admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:24.591799 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d420c-a4d0-4c93-90b9-58ebc88088bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:24.592178 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d420c-a4d0-4c93-90b9-58ebc88088bd admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:24.593092 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012d420c-a4d0-4c93-90b9-58ebc88088bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:24.595008 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012d420c-a4d0-4c93-90b9-58ebc88088bd admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:24.612953 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 847/1689] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:28:24 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:28:24.613896 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012d420c-a4d0-4c93-90b9-58ebc88088bd admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:24.628417 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012d420c-a4d0-4c93-90b9-58ebc88088bd admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:24.635447 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc8962f-1cc0-4ddd-ac85-161c4bba3fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:24.636464 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc8962f-1cc0-4ddd-ac85-161c4bba3fdb admin admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:24.636756 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc8962f-1cc0-4ddd-ac85-161c4bba3fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:24.637476 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc8962f-1cc0-4ddd-ac85-161c4bba3fdb admin admin] PATH_INFO: `/v3/projects/fe18794e373a4d0d82d62bb9d79eb6d6/users/f6ce779bf8174f70889ff5ab9906275c/roles/36909bbf31d04993bb2a9fe587b572dc` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:24.639496 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc8962f-1cc0-4ddd-ac85-161c4bba3fdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe18794e373a4d0d82d62bb9d79eb6d6, user_id=f6ce779bf8174f70889ff5ab9906275c, role_id=36909bbf31d04993bb2a9fe587b572dc)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:24.642843 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc8962f-1cc0-4ddd-ac85-161c4bba3fdb admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:24.657811 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 848/1690] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:28:24 2022] PUT /identity/v3/projects/fe18794e373a4d0d82d62bb9d79eb6d6/users/f6ce779bf8174f70889ff5ab9906275c/roles/36909bbf31d04993bb2a9fe587b572dc => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:28:24.668401 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff9b0bb-2d58-44ca-a986-fd3deba31138 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:24.669624 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff9b0bb-2d58-44ca-a986-fd3deba31138 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:24.670019 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff9b0bb-2d58-44ca-a986-fd3deba31138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:24.705398 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ff8fb7-864b-4882-af8c-acae73571dc9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45219f386f0147b6bd380efe4ab62812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:24.707321 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-dff9b0bb-2d58-44ca-a986-fd3deba31138 None None] MFA Rules not processed for user `f6ce779bf8174f70889ff5ab9906275c`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:24.709532 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff8fb7-864b-4882-af8c-acae73571dc9 service cinder] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:24.709764 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-dff9b0bb-2d58-44ca-a986-fd3deba31138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:24.709887 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff8fb7-864b-4882-af8c-acae73571dc9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:24.710080 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff8fb7-864b-4882-af8c-acae73571dc9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:24.799370 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ff8fb7-864b-4882-af8c-acae73571dc9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:24.801014 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ff8fb7-864b-4882-af8c-acae73571dc9 service cinder] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:24.813273 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 843/1691] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:28:24 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:28:24.839066 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 849/1692] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:24 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:24.854156 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ff8fb7-864b-4882-af8c-acae73571dc9 service cinder] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:24.856010 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-71ff8fb7-864b-4882-af8c-acae73571dc9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:24.870322 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ff8fb7-864b-4882-af8c-acae73571dc9 service cinder] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:24.966746 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9045b8-8896-4abc-9ad5-3a1497a885d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45219f386f0147b6bd380efe4ab62812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:24.967600 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9045b8-8896-4abc-9ad5-3a1497a885d6 service cinder] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:24.968024 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9045b8-8896-4abc-9ad5-3a1497a885d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:24.968436 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9045b8-8896-4abc-9ad5-3a1497a885d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:24.983975 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9045b8-8896-4abc-9ad5-3a1497a885d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:24.985976 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9045b8-8896-4abc-9ad5-3a1497a885d6 service cinder] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:25.001895 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 844/1693] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:28:24 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:28:25.090354 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a28d8-401f-4638-aa08-64a03409bd26 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:25.091660 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a28d8-401f-4638-aa08-64a03409bd26 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:25.091660 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a28d8-401f-4638-aa08-64a03409bd26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:25.184861 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-1e9a28d8-401f-4638-aa08-64a03409bd26 None None] MFA Rules not processed for user `afea8c1288044245a31dff26342b92cc`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:25.185872 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-1e9a28d8-401f-4638-aa08-64a03409bd26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:25.193690 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9045b8-8896-4abc-9ad5-3a1497a885d6 service cinder] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:25.204100 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9045b8-8896-4abc-9ad5-3a1497a885d6 service cinder] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:25.215379 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a56502-1596-427b-8aef-e133990ff0f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45219f386f0147b6bd380efe4ab62812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:25.217229 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a56502-1596-427b-8aef-e133990ff0f1 service cinder] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:25.218318 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a56502-1596-427b-8aef-e133990ff0f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:25.218716 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a56502-1596-427b-8aef-e133990ff0f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:25.314879 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 850/1694] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:25 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:25.354370 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a56502-1596-427b-8aef-e133990ff0f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:25.355952 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a56502-1596-427b-8aef-e133990ff0f1 service cinder] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:25.376736 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 845/1695] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:28:25 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:28:25.436112 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9a28d8-401f-4638-aa08-64a03409bd26 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:25.484512 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a56502-1596-427b-8aef-e133990ff0f1 service cinder] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:25.485978 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-24a56502-1596-427b-8aef-e133990ff0f1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:25.597959 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9a28d8-401f-4638-aa08-64a03409bd26 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:25.611489 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a834081-a3f8-4537-a953-c9b55012e8e2 tempest-VolumeQuotaClassesTest-439548703 tempest-VolumeQuotaClassesTest-439548703-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa02bae88a7f4e218a329bb18aa24f4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '131200c7555b447e8f7f9e2c69a4b5f5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:25.612822 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a834081-a3f8-4537-a953-c9b55012e8e2 tempest-VolumeQuotaClassesTest-439548703 tempest-VolumeQuotaClassesTest-439548703-project-admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:25.613120 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a834081-a3f8-4537-a953-c9b55012e8e2 tempest-VolumeQuotaClassesTest-439548703 tempest-VolumeQuotaClassesTest-439548703-project-admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:25.613404 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a834081-a3f8-4537-a953-c9b55012e8e2 tempest-VolumeQuotaClassesTest-439548703 tempest-VolumeQuotaClassesTest-439548703-project-admin] PATH_INFO: `/v3/domains` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:25.620364 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a834081-a3f8-4537-a953-c9b55012e8e2 tempest-VolumeQuotaClassesTest-439548703 tempest-VolumeQuotaClassesTest-439548703-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:28:25.620644 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a834081-a3f8-4537-a953-c9b55012e8e2 tempest-VolumeQuotaClassesTest-439548703 tempest-VolumeQuotaClassesTest-439548703-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:25.622315 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a834081-a3f8-4537-a953-c9b55012e8e2 tempest-VolumeQuotaClassesTest-439548703 tempest-VolumeQuotaClassesTest-439548703-project-admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:25.638819 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a56502-1596-427b-8aef-e133990ff0f1 service cinder] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:25.651410 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c150d6c1-fe9d-4a90-9d49-fdaaed54e56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:25.652475 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150d6c1-fe9d-4a90-9d49-fdaaed54e56e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:25.654854 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150d6c1-fe9d-4a90-9d49-fdaaed54e56e admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:25.660043 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150d6c1-fe9d-4a90-9d49-fdaaed54e56e admin admin] PATH_INFO: `/v3/users/90e436c041b043529418187b2d2aba85` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:25.663723 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c150d6c1-fe9d-4a90-9d49-fdaaed54e56e admin admin] RBAC: Authorizing `identity:delete_user(user_id=90e436c041b043529418187b2d2aba85)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:25.668818 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c150d6c1-fe9d-4a90-9d49-fdaaed54e56e admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:25.670570 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 851/1696] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Mar 30 01:28:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:28:25.676537 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a834081-a3f8-4537-a953-c9b55012e8e2 tempest-VolumeQuotaClassesTest-439548703 tempest-VolumeQuotaClassesTest-439548703-project-admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:25.689535 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a834081-a3f8-4537-a953-c9b55012e8e2 tempest-VolumeQuotaClassesTest-439548703 tempest-VolumeQuotaClassesTest-439548703-project-admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:25.700537 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bc3d7d-3007-4bc4-a85e-b11308597f1b tempest-VolumeQuotaClassesTest-439548703 tempest-VolumeQuotaClassesTest-439548703-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa02bae88a7f4e218a329bb18aa24f4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '131200c7555b447e8f7f9e2c69a4b5f5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:25.701227 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bc3d7d-3007-4bc4-a85e-b11308597f1b tempest-VolumeQuotaClassesTest-439548703 tempest-VolumeQuotaClassesTest-439548703-project-admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:25.701519 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bc3d7d-3007-4bc4-a85e-b11308597f1b tempest-VolumeQuotaClassesTest-439548703 tempest-VolumeQuotaClassesTest-439548703-project-admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:25.701804 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bc3d7d-3007-4bc4-a85e-b11308597f1b tempest-VolumeQuotaClassesTest-439548703 tempest-VolumeQuotaClassesTest-439548703-project-admin] PATH_INFO: `/v3/projects` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:25.702512 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bc3d7d-3007-4bc4-a85e-b11308597f1b tempest-VolumeQuotaClassesTest-439548703 tempest-VolumeQuotaClassesTest-439548703-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:25.704488 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bc3d7d-3007-4bc4-a85e-b11308597f1b tempest-VolumeQuotaClassesTest-439548703 tempest-VolumeQuotaClassesTest-439548703-project-admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:25.749294 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 852/1697] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:28:25 2022] POST /identity/v3/projects => generated 353 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:28:25.753566 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bc3d7d-3007-4bc4-a85e-b11308597f1b tempest-VolumeQuotaClassesTest-439548703 tempest-VolumeQuotaClassesTest-439548703-project-admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:25.778025 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-c150d6c1-fe9d-4a90-9d49-fdaaed54e56e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90e436c041b043529418187b2d2aba85'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:25.797368 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-c150d6c1-fe9d-4a90-9d49-fdaaed54e56e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90e436c041b043529418187b2d2aba85'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:25.810265 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-c150d6c1-fe9d-4a90-9d49-fdaaed54e56e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90e436c041b043529418187b2d2aba85'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:25.811224 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-c150d6c1-fe9d-4a90-9d49-fdaaed54e56e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90e436c041b043529418187b2d2aba85'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:25.827577 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-c150d6c1-fe9d-4a90-9d49-fdaaed54e56e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90e436c041b043529418187b2d2aba85'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:25.836863 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 846/1698] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:28:25 2022] DELETE /identity/v3/users/90e436c041b043529418187b2d2aba85 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:28:25.841188 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afaa8f0-54e6-4383-9be5-a7e612df8d7d None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:25.841484 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afaa8f0-54e6-4383-9be5-a7e612df8d7d None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:25.841770 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afaa8f0-54e6-4383-9be5-a7e612df8d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:25.884325 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bc3d7d-3007-4bc4-a85e-b11308597f1b tempest-VolumeQuotaClassesTest-439548703 tempest-VolumeQuotaClassesTest-439548703-project-admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:25.898733 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-9afaa8f0-54e6-4383-9be5-a7e612df8d7d None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:25.900289 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-9afaa8f0-54e6-4383-9be5-a7e612df8d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:26.051831 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 847/1699] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:26.061803 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7c5ce3-c4c2-4a05-bd19-f438fadf07b3 tempest-VolumeQuotaClassesTest-439548703 tempest-VolumeQuotaClassesTest-439548703-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa02bae88a7f4e218a329bb18aa24f4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '131200c7555b447e8f7f9e2c69a4b5f5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:26.064659 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c5ce3-c4c2-4a05-bd19-f438fadf07b3 tempest-VolumeQuotaClassesTest-439548703 tempest-VolumeQuotaClassesTest-439548703-project-admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:26.065242 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c5ce3-c4c2-4a05-bd19-f438fadf07b3 tempest-VolumeQuotaClassesTest-439548703 tempest-VolumeQuotaClassesTest-439548703-project-admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:26.068569 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c5ce3-c4c2-4a05-bd19-f438fadf07b3 tempest-VolumeQuotaClassesTest-439548703 tempest-VolumeQuotaClassesTest-439548703-project-admin] PATH_INFO: `/v3/domains` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:26.069360 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7c5ce3-c4c2-4a05-bd19-f438fadf07b3 tempest-VolumeQuotaClassesTest-439548703 tempest-VolumeQuotaClassesTest-439548703-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:28:26.069765 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7c5ce3-c4c2-4a05-bd19-f438fadf07b3 tempest-VolumeQuotaClassesTest-439548703 tempest-VolumeQuotaClassesTest-439548703-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:26.074778 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7c5ce3-c4c2-4a05-bd19-f438fadf07b3 tempest-VolumeQuotaClassesTest-439548703 tempest-VolumeQuotaClassesTest-439548703-project-admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:26.085093 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afaa8f0-54e6-4383-9be5-a7e612df8d7d None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:26.086567 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-9afaa8f0-54e6-4383-9be5-a7e612df8d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:26.165553 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 853/1700] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Mar 30 01:28:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 408 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:28:26.280012 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7c5ce3-c4c2-4a05-bd19-f438fadf07b3 tempest-VolumeQuotaClassesTest-439548703 tempest-VolumeQuotaClassesTest-439548703-project-admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:26.282731 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-bd7c5ce3-c4c2-4a05-bd19-f438fadf07b3 tempest-VolumeQuotaClassesTest-439548703 tempest-VolumeQuotaClassesTest-439548703-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:26.315255 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7c5ce3-c4c2-4a05-bd19-f438fadf07b3 tempest-VolumeQuotaClassesTest-439548703 tempest-VolumeQuotaClassesTest-439548703-project-admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:26.328876 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afaa8f0-54e6-4383-9be5-a7e612df8d7d None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:26.329340 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8726ef76-36c3-4eff-939b-6dadab478617 tempest-VolumeQuotaClassesTest-439548703 tempest-VolumeQuotaClassesTest-439548703-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa02bae88a7f4e218a329bb18aa24f4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '131200c7555b447e8f7f9e2c69a4b5f5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:26.330498 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726ef76-36c3-4eff-939b-6dadab478617 tempest-VolumeQuotaClassesTest-439548703 tempest-VolumeQuotaClassesTest-439548703-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:26.333510 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726ef76-36c3-4eff-939b-6dadab478617 tempest-VolumeQuotaClassesTest-439548703 tempest-VolumeQuotaClassesTest-439548703-project-admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:26.333713 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726ef76-36c3-4eff-939b-6dadab478617 tempest-VolumeQuotaClassesTest-439548703 tempest-VolumeQuotaClassesTest-439548703-project-admin] PATH_INFO: `/v3/projects/4a4de440ece7465d966b07dad7e97697` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:26.336656 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8726ef76-36c3-4eff-939b-6dadab478617 tempest-VolumeQuotaClassesTest-439548703 tempest-VolumeQuotaClassesTest-439548703-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4a4de440ece7465d966b07dad7e97697)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:26.338286 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: WARNING py.warnings [None req-8726ef76-36c3-4eff-939b-6dadab478617 tempest-VolumeQuotaClassesTest-439548703 tempest-VolumeQuotaClassesTest-439548703-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 30 01:28:26.338286 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: warnings.warn(msg) Mar 30 01:28:26.338286 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: Mar 30 01:28:26.339577 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8726ef76-36c3-4eff-939b-6dadab478617 tempest-VolumeQuotaClassesTest-439548703 tempest-VolumeQuotaClassesTest-439548703-project-admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:26.340251 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e79b3e-c4ac-49a9-bfd7-ebdcc01cf344 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:26.342004 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e79b3e-c4ac-49a9-bfd7-ebdcc01cf344 service neutron] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:26.343479 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e79b3e-c4ac-49a9-bfd7-ebdcc01cf344 service neutron] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:26.344974 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e79b3e-c4ac-49a9-bfd7-ebdcc01cf344 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:26.374148 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e79b3e-c4ac-49a9-bfd7-ebdcc01cf344 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:26.378630 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e79b3e-c4ac-49a9-bfd7-ebdcc01cf344 service neutron] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:26.407187 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 848/1701] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:28:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 30 01:28:26.408703 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6789251f-675d-4179-b0fa-b72dca15629d None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:26.408996 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6789251f-675d-4179-b0fa-b72dca15629d None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:26.409285 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6789251f-675d-4179-b0fa-b72dca15629d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:26.488597 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-6789251f-675d-4179-b0fa-b72dca15629d None None] MFA Rules not processed for user `c610ebdafc22479a8a47892591caaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:26.489816 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-6789251f-675d-4179-b0fa-b72dca15629d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:26.492196 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-8726ef76-36c3-4eff-939b-6dadab478617 tempest-VolumeQuotaClassesTest-439548703 tempest-VolumeQuotaClassesTest-439548703-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a4de440ece7465d966b07dad7e97697', 'request_id': 'req-8726ef76-36c3-4eff-939b-6dadab478617'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:26.506440 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-8726ef76-36c3-4eff-939b-6dadab478617 tempest-VolumeQuotaClassesTest-439548703 tempest-VolumeQuotaClassesTest-439548703-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a4de440ece7465d966b07dad7e97697', 'request_id': 'req-8726ef76-36c3-4eff-939b-6dadab478617'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:26.522889 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-8726ef76-36c3-4eff-939b-6dadab478617 tempest-VolumeQuotaClassesTest-439548703 tempest-VolumeQuotaClassesTest-439548703-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a4de440ece7465d966b07dad7e97697', 'request_id': 'req-8726ef76-36c3-4eff-939b-6dadab478617'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:26.551897 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-8726ef76-36c3-4eff-939b-6dadab478617 tempest-VolumeQuotaClassesTest-439548703 tempest-VolumeQuotaClassesTest-439548703-project-admin] The token cache is being invalidate because project 4a4de440ece7465d966b07dad7e97697 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:28:26.552389 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-8726ef76-36c3-4eff-939b-6dadab478617 tempest-VolumeQuotaClassesTest-439548703 tempest-VolumeQuotaClassesTest-439548703-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:26.553386 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-8726ef76-36c3-4eff-939b-6dadab478617 tempest-VolumeQuotaClassesTest-439548703 tempest-VolumeQuotaClassesTest-439548703-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:26.555906 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 854/1702] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:28:26 2022] DELETE /identity/v3/projects/4a4de440ece7465d966b07dad7e97697 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:28:26.625618 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 849/1703] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:26.635521 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75972ed-e02f-4e30-82bd-d934ad73bdc1 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:26.635842 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75972ed-e02f-4e30-82bd-d934ad73bdc1 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:26.636125 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75972ed-e02f-4e30-82bd-d934ad73bdc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:26.665188 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-d75972ed-e02f-4e30-82bd-d934ad73bdc1 None None] MFA Rules not processed for user `c610ebdafc22479a8a47892591caaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:26.666917 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-d75972ed-e02f-4e30-82bd-d934ad73bdc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:26.680698 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 855/1704] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:26.690266 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6789251f-675d-4179-b0fa-b72dca15629d None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:26.691907 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-6789251f-675d-4179-b0fa-b72dca15629d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:26.886939 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6789251f-675d-4179-b0fa-b72dca15629d None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:26.903023 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f53be-f25b-4a9f-b76f-326de44fa8a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140c6d1a20e94192bde06e72040f162d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:26.908035 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f53be-f25b-4a9f-b76f-326de44fa8a3 service nova] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:26.908482 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f53be-f25b-4a9f-b76f-326de44fa8a3 service nova] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:26.908876 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f53be-f25b-4a9f-b76f-326de44fa8a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:26.929052 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63f53be-f25b-4a9f-b76f-326de44fa8a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:26.935034 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63f53be-f25b-4a9f-b76f-326de44fa8a3 service nova] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:26.952993 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 850/1705] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:28:26 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:28:27.002187 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75972ed-e02f-4e30-82bd-d934ad73bdc1 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:27.003710 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-d75972ed-e02f-4e30-82bd-d934ad73bdc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:27.213772 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75972ed-e02f-4e30-82bd-d934ad73bdc1 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:27.225752 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f67c032-a6c5-4f80-be78-f8b1974fa520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:27.227021 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f67c032-a6c5-4f80-be78-f8b1974fa520 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:27.227469 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f67c032-a6c5-4f80-be78-f8b1974fa520 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:27.227882 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f67c032-a6c5-4f80-be78-f8b1974fa520 admin admin] PATH_INFO: `/v3/users/87d9290dee8848f490a743c067345ed9` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:27.237067 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f67c032-a6c5-4f80-be78-f8b1974fa520 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87d9290dee8848f490a743c067345ed9)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:27.239080 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f67c032-a6c5-4f80-be78-f8b1974fa520 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:27.299380 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba216b96-dfcd-4ac4-ba5c-581785e103da None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:27.299717 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba216b96-dfcd-4ac4-ba5c-581785e103da None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:27.300022 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba216b96-dfcd-4ac4-ba5c-581785e103da None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:27.302471 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 851/1706] 10.222.0.30 () {54 vars in 960 bytes} [Wed Mar 30 01:28:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:28:27.311865 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3723e5f-f029-41c1-9cc1-e7c4e8508e2a None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:27.312189 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3723e5f-f029-41c1-9cc1-e7c4e8508e2a None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:27.312630 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3723e5f-f029-41c1-9cc1-e7c4e8508e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:27.320327 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-9f67c032-a6c5-4f80-be78-f8b1974fa520 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87d9290dee8848f490a743c067345ed9'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:27.341422 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-9f67c032-a6c5-4f80-be78-f8b1974fa520 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87d9290dee8848f490a743c067345ed9'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:27.342500 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-9f67c032-a6c5-4f80-be78-f8b1974fa520 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87d9290dee8848f490a743c067345ed9'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:27.351618 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-e3723e5f-f029-41c1-9cc1-e7c4e8508e2a None None] MFA Rules not processed for user `7343cd5457264dabb4c2b3a62df59431`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:27.352850 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-e3723e5f-f029-41c1-9cc1-e7c4e8508e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:27.355699 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-9f67c032-a6c5-4f80-be78-f8b1974fa520 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87d9290dee8848f490a743c067345ed9'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:27.375697 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-9f67c032-a6c5-4f80-be78-f8b1974fa520 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87d9290dee8848f490a743c067345ed9'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:27.396643 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 856/1707] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:28:27 2022] DELETE /identity/v3/users/87d9290dee8848f490a743c067345ed9 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:28:27.402755 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31c96e-669e-4f9f-b2eb-2bfe7fad453b None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:27.403248 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31c96e-669e-4f9f-b2eb-2bfe7fad453b None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:27.403863 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31c96e-669e-4f9f-b2eb-2bfe7fad453b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:27.457353 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-7c31c96e-669e-4f9f-b2eb-2bfe7fad453b None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:27.458639 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-7c31c96e-669e-4f9f-b2eb-2bfe7fad453b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:27.525071 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 852/1708] 10.222.0.30 () {58 vars in 1057 bytes} [Wed Mar 30 01:28:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 01:28:27.539631 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3723e5f-f029-41c1-9cc1-e7c4e8508e2a None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:27.560393 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3723e5f-f029-41c1-9cc1-e7c4e8508e2a None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:27.673886 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 857/1709] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:27.692805 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4329e9bf-11c3-4b0b-bfab-e5be54e7b2b4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7343cd5457264dabb4c2b3a62df59431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:27.693646 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329e9bf-11c3-4b0b-bfab-e5be54e7b2b4 service placement] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:27.694008 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329e9bf-11c3-4b0b-bfab-e5be54e7b2b4 service placement] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:27.694367 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329e9bf-11c3-4b0b-bfab-e5be54e7b2b4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:27.696519 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-4329e9bf-11c3-4b0b-bfab-e5be54e7b2b4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:27.709816 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4329e9bf-11c3-4b0b-bfab-e5be54e7b2b4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:27.711702 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4329e9bf-11c3-4b0b-bfab-e5be54e7b2b4 service placement] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:27.724025 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 853/1710] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:28:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 30 01:28:27.771442 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c31c96e-669e-4f9f-b2eb-2bfe7fad453b None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:27.774114 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-7c31c96e-669e-4f9f-b2eb-2bfe7fad453b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:27.926616 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5f8589-6e75-46f7-933e-db43946eaeb2 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:27.927835 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5f8589-6e75-46f7-933e-db43946eaeb2 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:27.928866 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5f8589-6e75-46f7-933e-db43946eaeb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:27.932574 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c31c96e-669e-4f9f-b2eb-2bfe7fad453b None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:27.940760 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98df216-301d-4e2c-be7c-1680e53af844 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:27.944581 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98df216-301d-4e2c-be7c-1680e53af844 service neutron] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:27.944883 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98df216-301d-4e2c-be7c-1680e53af844 service neutron] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:27.945168 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98df216-301d-4e2c-be7c-1680e53af844 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:27.973793 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-ce5f8589-6e75-46f7-933e-db43946eaeb2 None None] MFA Rules not processed for user `4a2bf75cc4e3465987b8450318708b49`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:27.976848 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-ce5f8589-6e75-46f7-933e-db43946eaeb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:27.989933 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98df216-301d-4e2c-be7c-1680e53af844 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:27.996357 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98df216-301d-4e2c-be7c-1680e53af844 service neutron] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:28.037198 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 858/1711] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:28:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:28:28.100719 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 854/1712] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 01:28:28.101931 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98df216-301d-4e2c-be7c-1680e53af844 service neutron] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:28.103621 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-c98df216-301d-4e2c-be7c-1680e53af844 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:28.269060 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98df216-301d-4e2c-be7c-1680e53af844 service neutron] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:28.276289 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3126446-7bc9-41c2-9853-fa73fe992623 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140c6d1a20e94192bde06e72040f162d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:28.277230 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3126446-7bc9-41c2-9853-fa73fe992623 service nova] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:28.277569 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3126446-7bc9-41c2-9853-fa73fe992623 service nova] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:28.277884 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3126446-7bc9-41c2-9853-fa73fe992623 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:28.290295 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3126446-7bc9-41c2-9853-fa73fe992623 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:28.292675 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3126446-7bc9-41c2-9853-fa73fe992623 service nova] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:28.305511 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 859/1713] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:28:28 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:28:28.613477 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cab54a-c95f-4b4d-a232-ab012162c77b None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:28.613477 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cab54a-c95f-4b4d-a232-ab012162c77b None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:28.613477 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cab54a-c95f-4b4d-a232-ab012162c77b None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:28.614974 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3126446-7bc9-41c2-9853-fa73fe992623 service nova] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:28.615352 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 855/1714] 10.222.0.30 () {54 vars in 912 bytes} [Wed Mar 30 01:28:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:28:28.617248 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-f3126446-7bc9-41c2-9853-fa73fe992623 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:28.628487 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb0a5d-4448-436f-96db-4627e7a1e3f2 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:28.628780 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb0a5d-4448-436f-96db-4627e7a1e3f2 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:28.629060 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb0a5d-4448-436f-96db-4627e7a1e3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:28.658587 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3126446-7bc9-41c2-9853-fa73fe992623 service nova] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:28.679809 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5437e83f-1ece-4fe0-9633-b672b72c1aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:28.683716 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437e83f-1ece-4fe0-9633-b672b72c1aa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:28.684333 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437e83f-1ece-4fe0-9633-b672b72c1aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:28.685337 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437e83f-1ece-4fe0-9633-b672b72c1aa6 admin admin] PATH_INFO: `/v3/projects/22f49ef5f57f4bc08aa083cea4ca4a43` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:28.688096 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5437e83f-1ece-4fe0-9633-b672b72c1aa6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22f49ef5f57f4bc08aa083cea4ca4a43)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:28.690070 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-96bb0a5d-4448-436f-96db-4627e7a1e3f2 None None] MFA Rules not processed for user `41745b7f8a804e75b490a0a34977b23b`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:28.693706 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-96bb0a5d-4448-436f-96db-4627e7a1e3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:28.694264 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5437e83f-1ece-4fe0-9633-b672b72c1aa6 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:28.733597 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 856/1715] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Mar 30 01:28:28 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 01:28:28.740169 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bb0a5d-4448-436f-96db-4627e7a1e3f2 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:28.742923 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-96bb0a5d-4448-436f-96db-4627e7a1e3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:28.790613 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bb0a5d-4448-436f-96db-4627e7a1e3f2 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:28.863172 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-5437e83f-1ece-4fe0-9633-b672b72c1aa6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22f49ef5f57f4bc08aa083cea4ca4a43', 'request_id': 'req-5437e83f-1ece-4fe0-9633-b672b72c1aa6'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:28.879387 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-5437e83f-1ece-4fe0-9633-b672b72c1aa6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22f49ef5f57f4bc08aa083cea4ca4a43', 'request_id': 'req-5437e83f-1ece-4fe0-9633-b672b72c1aa6'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:28.903128 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-5437e83f-1ece-4fe0-9633-b672b72c1aa6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22f49ef5f57f4bc08aa083cea4ca4a43', 'request_id': 'req-5437e83f-1ece-4fe0-9633-b672b72c1aa6'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:28.936376 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-5437e83f-1ece-4fe0-9633-b672b72c1aa6 admin admin] The token cache is being invalidate because project 22f49ef5f57f4bc08aa083cea4ca4a43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:28:28.938034 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-5437e83f-1ece-4fe0-9633-b672b72c1aa6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:28.939175 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-5437e83f-1ece-4fe0-9633-b672b72c1aa6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:28.946668 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 860/1716] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:28:28 2022] DELETE /identity/v3/projects/22f49ef5f57f4bc08aa083cea4ca4a43 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:28:28.950235 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbe28de-11eb-446b-ad1f-6caff4f25315 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:28.950541 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbe28de-11eb-446b-ad1f-6caff4f25315 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:28.950856 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbe28de-11eb-446b-ad1f-6caff4f25315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:29.018741 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-fcbe28de-11eb-446b-ad1f-6caff4f25315 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:29.022262 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-fcbe28de-11eb-446b-ad1f-6caff4f25315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:29.044505 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0cf152-8dfa-46e0-a16a-4226a92d4ab3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:29.045963 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0cf152-8dfa-46e0-a16a-4226a92d4ab3 service neutron] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:29.046471 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0cf152-8dfa-46e0-a16a-4226a92d4ab3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:29.046994 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0cf152-8dfa-46e0-a16a-4226a92d4ab3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:29.051725 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-9d0cf152-8dfa-46e0-a16a-4226a92d4ab3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:29.089507 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0cf152-8dfa-46e0-a16a-4226a92d4ab3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:29.091198 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0cf152-8dfa-46e0-a16a-4226a92d4ab3 service neutron] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:29.112356 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 857/1717] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:28:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:28:29.244296 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 861/1718] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:29.246377 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd08bf-852f-4879-b402-e023f14714be None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:29.246794 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd08bf-852f-4879-b402-e023f14714be None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:29.247156 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd08bf-852f-4879-b402-e023f14714be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:29.301694 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-ddbd08bf-852f-4879-b402-e023f14714be None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:29.308782 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-ddbd08bf-852f-4879-b402-e023f14714be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:29.349849 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 858/1719] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 01:28:29.354487 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbe28de-11eb-446b-ad1f-6caff4f25315 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:29.370927 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbe28de-11eb-446b-ad1f-6caff4f25315 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:29.389666 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666cb6f0-79c7-47b4-85d5-d7866222fdea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:29.390369 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666cb6f0-79c7-47b4-85d5-d7866222fdea admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:29.390654 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666cb6f0-79c7-47b4-85d5-d7866222fdea admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:29.390963 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666cb6f0-79c7-47b4-85d5-d7866222fdea admin admin] PATH_INFO: `/v3/domains` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:29.396745 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666cb6f0-79c7-47b4-85d5-d7866222fdea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:28:29.396745 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666cb6f0-79c7-47b4-85d5-d7866222fdea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:29.405621 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666cb6f0-79c7-47b4-85d5-d7866222fdea admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:29.463843 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 862/1720] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Mar 30 01:28:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:28:29.468402 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd08bf-852f-4879-b402-e023f14714be None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:29.485558 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd08bf-852f-4879-b402-e023f14714be None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:29.502553 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a11928-758b-4813-a14d-620159dc4904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:29.503296 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a11928-758b-4813-a14d-620159dc4904 admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:29.503581 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a11928-758b-4813-a14d-620159dc4904 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:29.503862 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a11928-758b-4813-a14d-620159dc4904 admin admin] PATH_INFO: `/v3/projects` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:29.504595 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a11928-758b-4813-a14d-620159dc4904 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:29.506723 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a11928-758b-4813-a14d-620159dc4904 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:29.567955 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 859/1721] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:28:29 2022] POST /identity/v3/projects => generated 371 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 01:28:29.572124 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666cb6f0-79c7-47b4-85d5-d7866222fdea admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:29.586798 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666cb6f0-79c7-47b4-85d5-d7866222fdea admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:29.892403 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c6da1-d729-44d7-92a6-28f34df738c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:29.893062 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c6da1-d729-44d7-92a6-28f34df738c7 admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:29.893264 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c6da1-d729-44d7-92a6-28f34df738c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:29.893515 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c6da1-d729-44d7-92a6-28f34df738c7 admin admin] PATH_INFO: `/v3/users` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:29.894208 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9c6da1-d729-44d7-92a6-28f34df738c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:29.896173 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9c6da1-d729-44d7-92a6-28f34df738c7 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:29.948805 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 863/1722] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:28:29 2022] POST /identity/v3/users => generated 286 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:28:29.949885 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a11928-758b-4813-a14d-620159dc4904 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:29.965259 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a11928-758b-4813-a14d-620159dc4904 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:29.992263 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddabccf7-bbf9-467e-9410-ee3cc545f5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:29.992962 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddabccf7-bbf9-467e-9410-ee3cc545f5e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:29.993249 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddabccf7-bbf9-467e-9410-ee3cc545f5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:29.993530 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddabccf7-bbf9-467e-9410-ee3cc545f5e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:29.994891 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddabccf7-bbf9-467e-9410-ee3cc545f5e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:30.006928 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddabccf7-bbf9-467e-9410-ee3cc545f5e5 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:30.039105 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 860/1723] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:28:29 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:28:30.043916 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c6da1-d729-44d7-92a6-28f34df738c7 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:30.087124 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c6da1-d729-44d7-92a6-28f34df738c7 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:30.119504 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b4b4f-040a-4de6-94ad-179c7bf2c05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:30.120721 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b4b4f-040a-4de6-94ad-179c7bf2c05b admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:30.121213 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b4b4f-040a-4de6-94ad-179c7bf2c05b admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:30.122195 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b4b4f-040a-4de6-94ad-179c7bf2c05b admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:30.127817 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96b4b4f-040a-4de6-94ad-179c7bf2c05b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:30.133787 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96b4b4f-040a-4de6-94ad-179c7bf2c05b admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:30.170338 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 864/1724] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:28:30 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:28:30.172005 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddabccf7-bbf9-467e-9410-ee3cc545f5e5 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:30.192692 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddabccf7-bbf9-467e-9410-ee3cc545f5e5 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:30.208944 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d30baf7-d6b9-4a45-8c6a-0dd7ef2b9498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:30.209851 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d30baf7-d6b9-4a45-8c6a-0dd7ef2b9498 admin admin] REQUEST_METHOD: `PUT` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:30.215643 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d30baf7-d6b9-4a45-8c6a-0dd7ef2b9498 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:30.216082 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d30baf7-d6b9-4a45-8c6a-0dd7ef2b9498 admin admin] PATH_INFO: `/v3/projects/6760ddecbdbe475e9ae0e8bf48d29099/users/0d277ba629914964a2e99bd4b7ae163e/roles/7185d0cfbcd44502b1613bcfe1b42f6f` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:30.270597 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d30baf7-d6b9-4a45-8c6a-0dd7ef2b9498 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6760ddecbdbe475e9ae0e8bf48d29099, user_id=0d277ba629914964a2e99bd4b7ae163e, role_id=7185d0cfbcd44502b1613bcfe1b42f6f)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:30.274048 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d30baf7-d6b9-4a45-8c6a-0dd7ef2b9498 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:30.331365 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 861/1725] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:28:30 2022] PUT /identity/v3/projects/6760ddecbdbe475e9ae0e8bf48d29099/users/0d277ba629914964a2e99bd4b7ae163e/roles/7185d0cfbcd44502b1613bcfe1b42f6f => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:28:30.343445 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f4aeff-4983-4222-83d3-8f6c22e6d5b7 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:30.343713 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f4aeff-4983-4222-83d3-8f6c22e6d5b7 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:30.344229 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f4aeff-4983-4222-83d3-8f6c22e6d5b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:30.454343 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-10f4aeff-4983-4222-83d3-8f6c22e6d5b7 None None] MFA Rules not processed for user `0d277ba629914964a2e99bd4b7ae163e`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:30.467580 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-10f4aeff-4983-4222-83d3-8f6c22e6d5b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:30.551112 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d30baf7-d6b9-4a45-8c6a-0dd7ef2b9498 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:30.554554 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-9d30baf7-d6b9-4a45-8c6a-0dd7ef2b9498 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:30.611347 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 865/1726] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:30.623223 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f4aeff-4983-4222-83d3-8f6c22e6d5b7 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:30.624675 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-10f4aeff-4983-4222-83d3-8f6c22e6d5b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:30.784617 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d30baf7-d6b9-4a45-8c6a-0dd7ef2b9498 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:30.808084 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65dec7d-9a11-4a37-a8f0-49e070ecc16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:30.814308 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65dec7d-9a11-4a37-a8f0-49e070ecc16d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:30.814682 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65dec7d-9a11-4a37-a8f0-49e070ecc16d admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:30.815026 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65dec7d-9a11-4a37-a8f0-49e070ecc16d admin admin] PATH_INFO: `/v3/users/43f30c12e9314d568ba7443b3b4c84f8` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:30.818931 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65dec7d-9a11-4a37-a8f0-49e070ecc16d admin admin] RBAC: Authorizing `identity:delete_user(user_id=43f30c12e9314d568ba7443b3b4c84f8)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:30.829397 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65dec7d-9a11-4a37-a8f0-49e070ecc16d admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:30.870777 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f4aeff-4983-4222-83d3-8f6c22e6d5b7 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:30.896329 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f5b5f0-4208-4b97-ad33-0faa81df8fd7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140c6d1a20e94192bde06e72040f162d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:30.896999 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5b5f0-4208-4b97-ad33-0faa81df8fd7 service nova] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:30.897283 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5b5f0-4208-4b97-ad33-0faa81df8fd7 service nova] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:30.897560 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5b5f0-4208-4b97-ad33-0faa81df8fd7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:30.935737 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f5b5f0-4208-4b97-ad33-0faa81df8fd7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:30.939748 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f5b5f0-4208-4b97-ad33-0faa81df8fd7 service nova] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:30.992907 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 866/1727] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:28:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:28:31.003786 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f5b5f0-4208-4b97-ad33-0faa81df8fd7 service nova] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:31.004074 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-c65dec7d-9a11-4a37-a8f0-49e070ecc16d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43f30c12e9314d568ba7443b3b4c84f8'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:31.019577 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-92f5b5f0-4208-4b97-ad33-0faa81df8fd7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:31.050344 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-c65dec7d-9a11-4a37-a8f0-49e070ecc16d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43f30c12e9314d568ba7443b3b4c84f8'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:31.064752 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f5b5f0-4208-4b97-ad33-0faa81df8fd7 service nova] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:31.073711 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-c65dec7d-9a11-4a37-a8f0-49e070ecc16d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43f30c12e9314d568ba7443b3b4c84f8'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:31.074380 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-c65dec7d-9a11-4a37-a8f0-49e070ecc16d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43f30c12e9314d568ba7443b3b4c84f8'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:31.091052 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-c65dec7d-9a11-4a37-a8f0-49e070ecc16d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43f30c12e9314d568ba7443b3b4c84f8'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:31.110481 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9518af34-ac49-4c2b-9ad6-ad134c43d1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:31.111601 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518af34-ac49-4c2b-9ad6-ad134c43d1ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:31.112081 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518af34-ac49-4c2b-9ad6-ad134c43d1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:31.112527 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518af34-ac49-4c2b-9ad6-ad134c43d1ef admin admin] PATH_INFO: `/v3/users/ee9cf76a3a384aae8601dda2605776e4` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:31.113601 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 862/1728] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:28:30 2022] DELETE /identity/v3/users/43f30c12e9314d568ba7443b3b4c84f8 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:28:31.114465 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9518af34-ac49-4c2b-9ad6-ad134c43d1ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee9cf76a3a384aae8601dda2605776e4)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:31.121637 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87ae65-f11a-4744-9876-a06e955fc68b None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:31.122124 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87ae65-f11a-4744-9876-a06e955fc68b None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:31.122566 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87ae65-f11a-4744-9876-a06e955fc68b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:31.125494 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9518af34-ac49-4c2b-9ad6-ad134c43d1ef admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:31.172022 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-db87ae65-f11a-4744-9876-a06e955fc68b None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:31.177619 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-db87ae65-f11a-4744-9876-a06e955fc68b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:31.284107 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-9518af34-ac49-4c2b-9ad6-ad134c43d1ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee9cf76a3a384aae8601dda2605776e4'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:31.305430 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-9518af34-ac49-4c2b-9ad6-ad134c43d1ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee9cf76a3a384aae8601dda2605776e4'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:31.306975 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-9518af34-ac49-4c2b-9ad6-ad134c43d1ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee9cf76a3a384aae8601dda2605776e4'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:31.334650 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-9518af34-ac49-4c2b-9ad6-ad134c43d1ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee9cf76a3a384aae8601dda2605776e4'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:31.389784 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-9518af34-ac49-4c2b-9ad6-ad134c43d1ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee9cf76a3a384aae8601dda2605776e4'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:31.393012 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 863/1729] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:31.427805 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db87ae65-f11a-4744-9876-a06e955fc68b None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:31.432049 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 867/1730] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:28:31 2022] DELETE /identity/v3/users/ee9cf76a3a384aae8601dda2605776e4 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:28:31.434185 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-db87ae65-f11a-4744-9876-a06e955fc68b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:31.557793 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0347f-10e9-4225-ade4-79ffe2b07dbd None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:31.558359 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0347f-10e9-4225-ade4-79ffe2b07dbd None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:31.558558 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0347f-10e9-4225-ade4-79ffe2b07dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:31.578161 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db87ae65-f11a-4744-9876-a06e955fc68b None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:31.643331 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-dbb0347f-10e9-4225-ade4-79ffe2b07dbd None None] MFA Rules not processed for user `0503fdca7f834ef0a81422804dc74812`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:31.662348 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-dbb0347f-10e9-4225-ade4-79ffe2b07dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:31.727831 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3ecdca-1ac3-4228-80e3-1c0f96a21df2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:31.731956 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ecdca-1ac3-4228-80e3-1c0f96a21df2 service neutron] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:31.734146 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ecdca-1ac3-4228-80e3-1c0f96a21df2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:31.734547 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ecdca-1ac3-4228-80e3-1c0f96a21df2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:31.921537 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 868/1731] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Mar 30 01:28:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:31.932631 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb0347f-10e9-4225-ade4-79ffe2b07dbd None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:31.940418 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-dbb0347f-10e9-4225-ade4-79ffe2b07dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:31.960041 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3ecdca-1ac3-4228-80e3-1c0f96a21df2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:31.961826 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3ecdca-1ac3-4228-80e3-1c0f96a21df2 service neutron] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:32.019889 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb0347f-10e9-4225-ade4-79ffe2b07dbd None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:32.027137 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 864/1732] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:28:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 600 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 30 01:28:32.031824 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e283a9be-1a23-45cd-aa54-2cfa9910e1a1 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:32.032569 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e283a9be-1a23-45cd-aa54-2cfa9910e1a1 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:32.035274 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e283a9be-1a23-45cd-aa54-2cfa9910e1a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:32.055111 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b337ac-0ac6-4662-a639-651f82863113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:32.056002 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b337ac-0ac6-4662-a639-651f82863113 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:32.056405 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b337ac-0ac6-4662-a639-651f82863113 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:32.056675 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b337ac-0ac6-4662-a639-651f82863113 admin admin] PATH_INFO: `/v3/projects/05420669ba0c4974925180bd3e257274` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:32.069845 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b337ac-0ac6-4662-a639-651f82863113 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05420669ba0c4974925180bd3e257274)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:32.072287 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b337ac-0ac6-4662-a639-651f82863113 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:32.091938 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-e283a9be-1a23-45cd-aa54-2cfa9910e1a1 None None] MFA Rules not processed for user `c610ebdafc22479a8a47892591caaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:32.093400 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-e283a9be-1a23-45cd-aa54-2cfa9910e1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:32.206558 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-b9b337ac-0ac6-4662-a639-651f82863113 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05420669ba0c4974925180bd3e257274', 'request_id': 'req-b9b337ac-0ac6-4662-a639-651f82863113'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:32.214489 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-b9b337ac-0ac6-4662-a639-651f82863113 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05420669ba0c4974925180bd3e257274', 'request_id': 'req-b9b337ac-0ac6-4662-a639-651f82863113'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:32.239958 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-b9b337ac-0ac6-4662-a639-651f82863113 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05420669ba0c4974925180bd3e257274', 'request_id': 'req-b9b337ac-0ac6-4662-a639-651f82863113'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:32.266895 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 865/1733] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:32.267769 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-b9b337ac-0ac6-4662-a639-651f82863113 admin admin] The token cache is being invalidate because project 05420669ba0c4974925180bd3e257274 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:28:32.271328 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-b9b337ac-0ac6-4662-a639-651f82863113 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:32.272361 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-b9b337ac-0ac6-4662-a639-651f82863113 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:32.274484 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 869/1734] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:28:31 2022] DELETE /identity/v3/projects/05420669ba0c4974925180bd3e257274 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:28:32.279817 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e283a9be-1a23-45cd-aa54-2cfa9910e1a1 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:32.304776 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e283a9be-1a23-45cd-aa54-2cfa9910e1a1 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:32.312872 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b337ac-0ac6-4662-a639-651f82863113 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:32.315664 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-b9b337ac-0ac6-4662-a639-651f82863113 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:32.505006 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0acc1a6-998c-4393-b2a4-f50a240d71f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:32.507627 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0acc1a6-998c-4393-b2a4-f50a240d71f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:32.508108 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0acc1a6-998c-4393-b2a4-f50a240d71f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:32.509668 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0acc1a6-998c-4393-b2a4-f50a240d71f1 admin admin] PATH_INFO: `/v3/users/aa02bae88a7f4e218a329bb18aa24f4d` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:32.513097 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0acc1a6-998c-4393-b2a4-f50a240d71f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa02bae88a7f4e218a329bb18aa24f4d)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:32.516818 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0acc1a6-998c-4393-b2a4-f50a240d71f1 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:32.539190 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b337ac-0ac6-4662-a639-651f82863113 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:32.560024 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f6e76-9927-4a6d-bfa3-ff498da64617 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f16de81dfb4c14b027cd6cd1e6ff2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:32.564333 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f6e76-9927-4a6d-bfa3-ff498da64617 service swift] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:32.565386 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f6e76-9927-4a6d-bfa3-ff498da64617 service swift] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:32.566123 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f6e76-9927-4a6d-bfa3-ff498da64617 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:32.575206 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-671f6e76-9927-4a6d-bfa3-ff498da64617 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:32.648729 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-a0acc1a6-998c-4393-b2a4-f50a240d71f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa02bae88a7f4e218a329bb18aa24f4d'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:32.686179 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-a0acc1a6-998c-4393-b2a4-f50a240d71f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa02bae88a7f4e218a329bb18aa24f4d'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:32.702532 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-a0acc1a6-998c-4393-b2a4-f50a240d71f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa02bae88a7f4e218a329bb18aa24f4d'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:32.703340 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-a0acc1a6-998c-4393-b2a4-f50a240d71f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa02bae88a7f4e218a329bb18aa24f4d'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:32.716291 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-a0acc1a6-998c-4393-b2a4-f50a240d71f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa02bae88a7f4e218a329bb18aa24f4d'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:32.731560 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 866/1735] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:28:32 2022] DELETE /identity/v3/users/aa02bae88a7f4e218a329bb18aa24f4d => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:28:32.781011 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671f6e76-9927-4a6d-bfa3-ff498da64617 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:32.789553 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671f6e76-9927-4a6d-bfa3-ff498da64617 service swift] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:32.834285 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 870/1736] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Mar 30 01:28:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Mar 30 01:28:33.315755 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0acc1a6-998c-4393-b2a4-f50a240d71f1 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:33.317928 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-a0acc1a6-998c-4393-b2a4-f50a240d71f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:33.514920 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0acc1a6-998c-4393-b2a4-f50a240d71f1 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:33.535511 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5638dd9d-4b00-42d8-8ed8-53f1e8663377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:33.550792 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5638dd9d-4b00-42d8-8ed8-53f1e8663377 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:33.551301 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5638dd9d-4b00-42d8-8ed8-53f1e8663377 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:33.551793 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5638dd9d-4b00-42d8-8ed8-53f1e8663377 admin admin] PATH_INFO: `/v3/projects/1d66e98408d64eb4b9a1073a56005f19` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:33.553668 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5638dd9d-4b00-42d8-8ed8-53f1e8663377 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d66e98408d64eb4b9a1073a56005f19)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:33.567628 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5638dd9d-4b00-42d8-8ed8-53f1e8663377 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:33.785256 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-5638dd9d-4b00-42d8-8ed8-53f1e8663377 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d66e98408d64eb4b9a1073a56005f19', 'request_id': 'req-5638dd9d-4b00-42d8-8ed8-53f1e8663377'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:33.821194 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-5638dd9d-4b00-42d8-8ed8-53f1e8663377 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d66e98408d64eb4b9a1073a56005f19', 'request_id': 'req-5638dd9d-4b00-42d8-8ed8-53f1e8663377'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:33.842589 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-5638dd9d-4b00-42d8-8ed8-53f1e8663377 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d66e98408d64eb4b9a1073a56005f19', 'request_id': 'req-5638dd9d-4b00-42d8-8ed8-53f1e8663377'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:33.867991 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-5638dd9d-4b00-42d8-8ed8-53f1e8663377 admin admin] The token cache is being invalidate because project 1d66e98408d64eb4b9a1073a56005f19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:28:33.868821 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-5638dd9d-4b00-42d8-8ed8-53f1e8663377 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:33.870277 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-5638dd9d-4b00-42d8-8ed8-53f1e8663377 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:33.874647 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 867/1737] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:28:33 2022] DELETE /identity/v3/projects/1d66e98408d64eb4b9a1073a56005f19 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:28:33.879251 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f6e76-9927-4a6d-bfa3-ff498da64617 service swift] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:33.884625 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-671f6e76-9927-4a6d-bfa3-ff498da64617 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:33.913830 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f6e76-9927-4a6d-bfa3-ff498da64617 service swift] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:34.122233 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3659031-7aa4-4df0-91e6-50e3a9b58e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:34.123180 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3659031-7aa4-4df0-91e6-50e3a9b58e13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:34.123467 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3659031-7aa4-4df0-91e6-50e3a9b58e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:34.123748 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3659031-7aa4-4df0-91e6-50e3a9b58e13 admin admin] PATH_INFO: `/v3/users/afea8c1288044245a31dff26342b92cc` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:34.127679 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3659031-7aa4-4df0-91e6-50e3a9b58e13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afea8c1288044245a31dff26342b92cc)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:34.134677 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3659031-7aa4-4df0-91e6-50e3a9b58e13 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:34.335969 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-b3659031-7aa4-4df0-91e6-50e3a9b58e13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afea8c1288044245a31dff26342b92cc'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:34.355592 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-b3659031-7aa4-4df0-91e6-50e3a9b58e13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afea8c1288044245a31dff26342b92cc'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:34.357432 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-b3659031-7aa4-4df0-91e6-50e3a9b58e13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afea8c1288044245a31dff26342b92cc'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:34.372543 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-b3659031-7aa4-4df0-91e6-50e3a9b58e13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afea8c1288044245a31dff26342b92cc'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:34.417061 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-b3659031-7aa4-4df0-91e6-50e3a9b58e13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afea8c1288044245a31dff26342b92cc'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:34.447216 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 871/1738] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:28:33 2022] DELETE /identity/v3/users/afea8c1288044245a31dff26342b92cc => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:28:35.549808 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5638dd9d-4b00-42d8-8ed8-53f1e8663377 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:35.551838 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-5638dd9d-4b00-42d8-8ed8-53f1e8663377 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:35.581591 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5638dd9d-4b00-42d8-8ed8-53f1e8663377 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:35.701228 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3659031-7aa4-4df0-91e6-50e3a9b58e13 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:35.705007 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-b3659031-7aa4-4df0-91e6-50e3a9b58e13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:35.745288 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec914d0-407f-4c29-96ea-2132009a6bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:35.746445 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec914d0-407f-4c29-96ea-2132009a6bdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:35.747107 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec914d0-407f-4c29-96ea-2132009a6bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:35.747530 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec914d0-407f-4c29-96ea-2132009a6bdd admin admin] PATH_INFO: `/v3/users/0d277ba629914964a2e99bd4b7ae163e` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:35.751116 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec914d0-407f-4c29-96ea-2132009a6bdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d277ba629914964a2e99bd4b7ae163e)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:35.753296 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec914d0-407f-4c29-96ea-2132009a6bdd admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:35.882432 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-9ec914d0-407f-4c29-96ea-2132009a6bdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d277ba629914964a2e99bd4b7ae163e'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:35.928158 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-9ec914d0-407f-4c29-96ea-2132009a6bdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d277ba629914964a2e99bd4b7ae163e'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:35.954838 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-9ec914d0-407f-4c29-96ea-2132009a6bdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d277ba629914964a2e99bd4b7ae163e'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:35.955529 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-9ec914d0-407f-4c29-96ea-2132009a6bdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d277ba629914964a2e99bd4b7ae163e'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:35.972700 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-9ec914d0-407f-4c29-96ea-2132009a6bdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d277ba629914964a2e99bd4b7ae163e'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:35.975984 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3659031-7aa4-4df0-91e6-50e3a9b58e13 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:35.995784 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 868/1739] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:28:35 2022] DELETE /identity/v3/users/0d277ba629914964a2e99bd4b7ae163e => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:28:36.000325 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c84fa-21ea-4efe-b0b8-94e8baadd3fd None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:36.000624 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c84fa-21ea-4efe-b0b8-94e8baadd3fd None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:36.000933 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c84fa-21ea-4efe-b0b8-94e8baadd3fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:36.006529 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e6ba05-e453-46a2-a1be-e19ae8f09256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:36.007450 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e6ba05-e453-46a2-a1be-e19ae8f09256 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:36.007736 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e6ba05-e453-46a2-a1be-e19ae8f09256 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:36.008016 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e6ba05-e453-46a2-a1be-e19ae8f09256 admin admin] PATH_INFO: `/v3/projects/6b8cd6901a754b5da51fadd625c3426a` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:36.017946 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e6ba05-e453-46a2-a1be-e19ae8f09256 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b8cd6901a754b5da51fadd625c3426a)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:36.025890 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e6ba05-e453-46a2-a1be-e19ae8f09256 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:36.061074 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-330c84fa-21ea-4efe-b0b8-94e8baadd3fd None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:36.062284 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-330c84fa-21ea-4efe-b0b8-94e8baadd3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:36.126182 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-d2e6ba05-e453-46a2-a1be-e19ae8f09256 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b8cd6901a754b5da51fadd625c3426a', 'request_id': 'req-d2e6ba05-e453-46a2-a1be-e19ae8f09256'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:36.133868 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-d2e6ba05-e453-46a2-a1be-e19ae8f09256 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b8cd6901a754b5da51fadd625c3426a', 'request_id': 'req-d2e6ba05-e453-46a2-a1be-e19ae8f09256'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:36.144040 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-d2e6ba05-e453-46a2-a1be-e19ae8f09256 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b8cd6901a754b5da51fadd625c3426a', 'request_id': 'req-d2e6ba05-e453-46a2-a1be-e19ae8f09256'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:36.164933 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-d2e6ba05-e453-46a2-a1be-e19ae8f09256 admin admin] The token cache is being invalidate because project 6b8cd6901a754b5da51fadd625c3426a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:28:36.166069 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-d2e6ba05-e453-46a2-a1be-e19ae8f09256 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:36.167082 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-d2e6ba05-e453-46a2-a1be-e19ae8f09256 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:36.172029 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 872/1740] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:28:35 2022] DELETE /identity/v3/projects/6b8cd6901a754b5da51fadd625c3426a => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:28:36.174246 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e6ba05-e453-46a2-a1be-e19ae8f09256 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:36.176023 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-d2e6ba05-e453-46a2-a1be-e19ae8f09256 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:36.227233 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 869/1741] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:36.271742 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e6ba05-e453-46a2-a1be-e19ae8f09256 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:36.279067 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd79ff-a2b8-4456-a237-6e75fd5450fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:36.280782 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd79ff-a2b8-4456-a237-6e75fd5450fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:36.281077 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd79ff-a2b8-4456-a237-6e75fd5450fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:36.281378 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd79ff-a2b8-4456-a237-6e75fd5450fd admin admin] PATH_INFO: `/v3/users/f6ce779bf8174f70889ff5ab9906275c` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:36.285450 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacd79ff-a2b8-4456-a237-6e75fd5450fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6ce779bf8174f70889ff5ab9906275c)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:36.287789 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacd79ff-a2b8-4456-a237-6e75fd5450fd admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:36.317057 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c84fa-21ea-4efe-b0b8-94e8baadd3fd None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:36.320114 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-330c84fa-21ea-4efe-b0b8-94e8baadd3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:36.403798 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-dacd79ff-a2b8-4456-a237-6e75fd5450fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6ce779bf8174f70889ff5ab9906275c'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:36.458673 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-dacd79ff-a2b8-4456-a237-6e75fd5450fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6ce779bf8174f70889ff5ab9906275c'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:36.460148 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-dacd79ff-a2b8-4456-a237-6e75fd5450fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6ce779bf8174f70889ff5ab9906275c'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:36.469988 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-dacd79ff-a2b8-4456-a237-6e75fd5450fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6ce779bf8174f70889ff5ab9906275c'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:36.485659 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-dacd79ff-a2b8-4456-a237-6e75fd5450fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6ce779bf8174f70889ff5ab9906275c'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:36.504464 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 873/1742] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:28:36 2022] DELETE /identity/v3/users/f6ce779bf8174f70889ff5ab9906275c => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:28:36.566468 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c84fa-21ea-4efe-b0b8-94e8baadd3fd None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:36.708843 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473aec03-3e10-4202-9415-6875f7aa2e37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:36.709698 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473aec03-3e10-4202-9415-6875f7aa2e37 service neutron] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:36.710034 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473aec03-3e10-4202-9415-6875f7aa2e37 service neutron] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:36.710289 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473aec03-3e10-4202-9415-6875f7aa2e37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:36.718860 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-473aec03-3e10-4202-9415-6875f7aa2e37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:36.904356 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473aec03-3e10-4202-9415-6875f7aa2e37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:36.906296 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473aec03-3e10-4202-9415-6875f7aa2e37 service neutron] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:36.924649 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 870/1743] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:28:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 608 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:28:37.338102 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd79ff-a2b8-4456-a237-6e75fd5450fd admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:37.340078 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-dacd79ff-a2b8-4456-a237-6e75fd5450fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:37.359399 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd79ff-a2b8-4456-a237-6e75fd5450fd admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:37.370127 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f40d5bd-a847-4c91-9fa0-3b7661178607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:37.371266 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f40d5bd-a847-4c91-9fa0-3b7661178607 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:37.371604 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f40d5bd-a847-4c91-9fa0-3b7661178607 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:37.372178 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f40d5bd-a847-4c91-9fa0-3b7661178607 admin admin] PATH_INFO: `/v3/projects/131200c7555b447e8f7f9e2c69a4b5f5` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:37.373598 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f40d5bd-a847-4c91-9fa0-3b7661178607 admin admin] RBAC: Authorizing `identity:delete_project(project_id=131200c7555b447e8f7f9e2c69a4b5f5)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:37.375714 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f40d5bd-a847-4c91-9fa0-3b7661178607 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:37.491071 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-4f40d5bd-a847-4c91-9fa0-3b7661178607 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '131200c7555b447e8f7f9e2c69a4b5f5', 'request_id': 'req-4f40d5bd-a847-4c91-9fa0-3b7661178607'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:37.510187 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473aec03-3e10-4202-9415-6875f7aa2e37 service neutron] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:37.511726 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-473aec03-3e10-4202-9415-6875f7aa2e37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:37.525424 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-4f40d5bd-a847-4c91-9fa0-3b7661178607 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '131200c7555b447e8f7f9e2c69a4b5f5', 'request_id': 'req-4f40d5bd-a847-4c91-9fa0-3b7661178607'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:37.550518 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-4f40d5bd-a847-4c91-9fa0-3b7661178607 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '131200c7555b447e8f7f9e2c69a4b5f5', 'request_id': 'req-4f40d5bd-a847-4c91-9fa0-3b7661178607'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:37.551861 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473aec03-3e10-4202-9415-6875f7aa2e37 service neutron] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:37.589047 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-4f40d5bd-a847-4c91-9fa0-3b7661178607 admin admin] The token cache is being invalidate because project 131200c7555b447e8f7f9e2c69a4b5f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:28:37.589548 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-4f40d5bd-a847-4c91-9fa0-3b7661178607 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:37.594094 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-4f40d5bd-a847-4c91-9fa0-3b7661178607 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:37.602375 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 874/1744] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:28:37 2022] DELETE /identity/v3/projects/131200c7555b447e8f7f9e2c69a4b5f5 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:28:37.607627 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb9304-fd43-415d-b2fc-0f49062646e4 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:37.607926 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb9304-fd43-415d-b2fc-0f49062646e4 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:37.608211 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb9304-fd43-415d-b2fc-0f49062646e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:37.663288 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-96bb9304-fd43-415d-b2fc-0f49062646e4 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:37.664683 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-96bb9304-fd43-415d-b2fc-0f49062646e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:37.683787 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee233e9c-b0ed-4007-8ca7-c0e54bc1787b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:37.684942 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee233e9c-b0ed-4007-8ca7-c0e54bc1787b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:37.685324 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee233e9c-b0ed-4007-8ca7-c0e54bc1787b admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:37.687044 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee233e9c-b0ed-4007-8ca7-c0e54bc1787b admin admin] PATH_INFO: `/v3/projects/0820e41d54864df6954e2d71fa6ac6ff` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:37.691198 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee233e9c-b0ed-4007-8ca7-c0e54bc1787b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0820e41d54864df6954e2d71fa6ac6ff)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:37.699481 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee233e9c-b0ed-4007-8ca7-c0e54bc1787b admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:37.935605 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-ee233e9c-b0ed-4007-8ca7-c0e54bc1787b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0820e41d54864df6954e2d71fa6ac6ff', 'request_id': 'req-ee233e9c-b0ed-4007-8ca7-c0e54bc1787b'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:37.980404 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-ee233e9c-b0ed-4007-8ca7-c0e54bc1787b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0820e41d54864df6954e2d71fa6ac6ff', 'request_id': 'req-ee233e9c-b0ed-4007-8ca7-c0e54bc1787b'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:37.999531 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 875/1745] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:38.016242 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eaa929-18e6-4b47-b5fd-ca6b2d76b7bc None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:38.017511 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eaa929-18e6-4b47-b5fd-ca6b2d76b7bc None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:38.021347 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eaa929-18e6-4b47-b5fd-ca6b2d76b7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:38.025195 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-ee233e9c-b0ed-4007-8ca7-c0e54bc1787b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0820e41d54864df6954e2d71fa6ac6ff', 'request_id': 'req-ee233e9c-b0ed-4007-8ca7-c0e54bc1787b'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:38.091035 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-ee233e9c-b0ed-4007-8ca7-c0e54bc1787b admin admin] The token cache is being invalidate because project 0820e41d54864df6954e2d71fa6ac6ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:28:38.091335 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-ee233e9c-b0ed-4007-8ca7-c0e54bc1787b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:38.096341 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-ee233e9c-b0ed-4007-8ca7-c0e54bc1787b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:38.102332 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 871/1746] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:28:37 2022] DELETE /identity/v3/projects/0820e41d54864df6954e2d71fa6ac6ff => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:28:38.104880 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63946d8-1466-41bd-900a-6b00739dc10f None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:38.108572 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63946d8-1466-41bd-900a-6b00739dc10f None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:38.108912 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63946d8-1466-41bd-900a-6b00739dc10f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:38.111754 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-00eaa929-18e6-4b47-b5fd-ca6b2d76b7bc None None] MFA Rules not processed for user `41745b7f8a804e75b490a0a34977b23b`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:38.113064 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-00eaa929-18e6-4b47-b5fd-ca6b2d76b7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:38.168612 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-f63946d8-1466-41bd-900a-6b00739dc10f None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:38.170029 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-f63946d8-1466-41bd-900a-6b00739dc10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:38.268235 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 876/1747] 10.222.0.10 () {58 vars in 1015 bytes} [Wed Mar 30 01:28:38 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:38.272938 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78af186-f25a-44d6-98f6-03367205bea5 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:38.273420 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78af186-f25a-44d6-98f6-03367205bea5 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:38.274538 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78af186-f25a-44d6-98f6-03367205bea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:38.361494 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 872/1748] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:38.365893 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63946d8-1466-41bd-900a-6b00739dc10f None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:38.385728 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-a78af186-f25a-44d6-98f6-03367205bea5 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:38.388742 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-a78af186-f25a-44d6-98f6-03367205bea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:38.413515 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 877/1749] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:38.415986 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78af186-f25a-44d6-98f6-03367205bea5 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:38.419075 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-a78af186-f25a-44d6-98f6-03367205bea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:38.427168 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63946d8-1466-41bd-900a-6b00739dc10f None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:38.446859 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80139eae-ad87-4b64-8eee-ba70fbc33676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:38.451358 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78af186-f25a-44d6-98f6-03367205bea5 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:38.459456 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80139eae-ad87-4b64-8eee-ba70fbc33676 admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:38.460666 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80139eae-ad87-4b64-8eee-ba70fbc33676 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:38.460887 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80139eae-ad87-4b64-8eee-ba70fbc33676 admin admin] PATH_INFO: `/v3/domains` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:38.465768 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23187843-8dbe-4cfe-9fde-3929fbea617c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:38.466571 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23187843-8dbe-4cfe-9fde-3929fbea617c service neutron] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:38.466778 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23187843-8dbe-4cfe-9fde-3929fbea617c service neutron] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:38.467619 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23187843-8dbe-4cfe-9fde-3929fbea617c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:38.473672 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80139eae-ad87-4b64-8eee-ba70fbc33676 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:28:38.475189 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80139eae-ad87-4b64-8eee-ba70fbc33676 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:38.482663 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80139eae-ad87-4b64-8eee-ba70fbc33676 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:38.492404 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23187843-8dbe-4cfe-9fde-3929fbea617c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:38.499293 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23187843-8dbe-4cfe-9fde-3929fbea617c service neutron] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:38.530624 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 878/1750] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:28:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:28:38.536137 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 873/1751] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Mar 30 01:28:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:28:38.536412 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc2c17-52ad-4429-a769-29bb51eb853f None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:38.536961 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc2c17-52ad-4429-a769-29bb51eb853f None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:38.537268 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc2c17-52ad-4429-a769-29bb51eb853f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:38.538268 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80139eae-ad87-4b64-8eee-ba70fbc33676 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:38.574363 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80139eae-ad87-4b64-8eee-ba70fbc33676 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:38.581048 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-69cc2c17-52ad-4429-a769-29bb51eb853f None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:38.585243 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-69cc2c17-52ad-4429-a769-29bb51eb853f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:38.589103 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de35cb0e-b026-4389-8e28-bf3e8e6fff85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:38.590336 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de35cb0e-b026-4389-8e28-bf3e8e6fff85 admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:38.591542 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de35cb0e-b026-4389-8e28-bf3e8e6fff85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:38.592408 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de35cb0e-b026-4389-8e28-bf3e8e6fff85 admin admin] PATH_INFO: `/v3/projects` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:38.594541 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de35cb0e-b026-4389-8e28-bf3e8e6fff85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:38.603948 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de35cb0e-b026-4389-8e28-bf3e8e6fff85 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:38.621146 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 879/1752] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:38.626152 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cc2c17-52ad-4429-a769-29bb51eb853f None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:38.677914 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cc2c17-52ad-4429-a769-29bb51eb853f None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:38.704742 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabef8d7-d4b9-4e2e-b5f4-d9bbacba1e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:38.708316 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabef8d7-d4b9-4e2e-b5f4-d9bbacba1e48 admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:38.710842 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabef8d7-d4b9-4e2e-b5f4-d9bbacba1e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:38.711164 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabef8d7-d4b9-4e2e-b5f4-d9bbacba1e48 admin admin] PATH_INFO: `/v3/domains` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:38.715069 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabef8d7-d4b9-4e2e-b5f4-d9bbacba1e48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:28:38.715280 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabef8d7-d4b9-4e2e-b5f4-d9bbacba1e48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:38.719365 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 874/1753] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:28:38 2022] POST /identity/v3/projects => generated 377 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:28:38.720328 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de35cb0e-b026-4389-8e28-bf3e8e6fff85 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:38.725350 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabef8d7-d4b9-4e2e-b5f4-d9bbacba1e48 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:38.777767 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 880/1754] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Mar 30 01:28:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:28:38.783868 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabef8d7-d4b9-4e2e-b5f4-d9bbacba1e48 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:38.815182 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabef8d7-d4b9-4e2e-b5f4-d9bbacba1e48 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:38.883981 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de35cb0e-b026-4389-8e28-bf3e8e6fff85 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:38.913417 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b857e-64f6-453d-a03f-0298e929d17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:38.914114 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b857e-64f6-453d-a03f-0298e929d17b admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:38.914394 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b857e-64f6-453d-a03f-0298e929d17b admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:38.914667 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b857e-64f6-453d-a03f-0298e929d17b admin admin] PATH_INFO: `/v3/users` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:38.916102 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3b857e-64f6-453d-a03f-0298e929d17b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:38.940051 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3b857e-64f6-453d-a03f-0298e929d17b admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:38.991615 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 875/1755] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:28:38 2022] POST /identity/v3/users => generated 289 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:28:38.995881 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b857e-64f6-453d-a03f-0298e929d17b admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:39.015127 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b857e-64f6-453d-a03f-0298e929d17b admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:39.036613 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92364a9-18c4-4c8a-905f-10645d622765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:39.037293 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92364a9-18c4-4c8a-905f-10645d622765 admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:39.038074 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92364a9-18c4-4c8a-905f-10645d622765 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:39.038443 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92364a9-18c4-4c8a-905f-10645d622765 admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:39.039239 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92364a9-18c4-4c8a-905f-10645d622765 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:39.043154 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92364a9-18c4-4c8a-905f-10645d622765 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:39.065130 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb4adb6-06c9-4a7e-8540-ab8ce138e32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:39.065824 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4adb6-06c9-4a7e-8540-ab8ce138e32c admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:39.066108 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4adb6-06c9-4a7e-8540-ab8ce138e32c admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:39.066379 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4adb6-06c9-4a7e-8540-ab8ce138e32c admin admin] PATH_INFO: `/v3/projects` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:39.067102 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb4adb6-06c9-4a7e-8540-ab8ce138e32c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:39.075576 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 876/1756] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:28:38 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 01:28:39.084486 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb4adb6-06c9-4a7e-8540-ab8ce138e32c admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:39.090907 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92364a9-18c4-4c8a-905f-10645d622765 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:39.115044 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92364a9-18c4-4c8a-905f-10645d622765 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:39.123201 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c8e732-fb30-447c-be5c-eea77a80d57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:39.123902 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c8e732-fb30-447c-be5c-eea77a80d57b admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:39.124188 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c8e732-fb30-447c-be5c-eea77a80d57b admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:39.124461 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c8e732-fb30-447c-be5c-eea77a80d57b admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:39.125198 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c8e732-fb30-447c-be5c-eea77a80d57b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:39.126934 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c8e732-fb30-447c-be5c-eea77a80d57b admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:39.158455 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 877/1757] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:28:39 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:28:39.159530 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c8e732-fb30-447c-be5c-eea77a80d57b admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:39.179056 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c8e732-fb30-447c-be5c-eea77a80d57b admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:39.187283 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 881/1758] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:28:38 2022] POST /identity/v3/projects => generated 371 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:28:39.188476 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb4adb6-06c9-4a7e-8540-ab8ce138e32c admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:39.314116 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e9c79f-534c-47d5-a5dd-0cec1b6e839b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:39.315123 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e9c79f-534c-47d5-a5dd-0cec1b6e839b admin admin] REQUEST_METHOD: `PUT` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:39.315480 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e9c79f-534c-47d5-a5dd-0cec1b6e839b admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:39.329468 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e9c79f-534c-47d5-a5dd-0cec1b6e839b admin admin] PATH_INFO: `/v3/projects/f1673aa9e58b462f9d7898c0dd221d27/users/41ab99d15f3842268dbfbccd342dea37/roles/7185d0cfbcd44502b1613bcfe1b42f6f` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:39.381517 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb4adb6-06c9-4a7e-8540-ab8ce138e32c admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:39.384874 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e9c79f-534c-47d5-a5dd-0cec1b6e839b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1673aa9e58b462f9d7898c0dd221d27, user_id=41ab99d15f3842268dbfbccd342dea37, role_id=7185d0cfbcd44502b1613bcfe1b42f6f)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:39.388231 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e9c79f-534c-47d5-a5dd-0cec1b6e839b admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:39.390359 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ccd4a0-b34e-4631-8d41-c04b44578040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:39.392157 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ccd4a0-b34e-4631-8d41-c04b44578040 admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:39.401014 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ccd4a0-b34e-4631-8d41-c04b44578040 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:39.402929 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ccd4a0-b34e-4631-8d41-c04b44578040 admin admin] PATH_INFO: `/v3/users` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:39.404385 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ccd4a0-b34e-4631-8d41-c04b44578040 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:39.408266 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ccd4a0-b34e-4631-8d41-c04b44578040 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:39.427450 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 878/1759] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:28:39 2022] PUT /identity/v3/projects/f1673aa9e58b462f9d7898c0dd221d27/users/41ab99d15f3842268dbfbccd342dea37/roles/7185d0cfbcd44502b1613bcfe1b42f6f => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:28:39.438482 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e6ef0-4802-4be5-a730-3ae8ec7a6d22 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:39.439281 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e6ef0-4802-4be5-a730-3ae8ec7a6d22 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:39.439767 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e6ef0-4802-4be5-a730-3ae8ec7a6d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:39.473236 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 882/1760] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:28:39 2022] POST /identity/v3/users => generated 286 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:28:39.475377 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ccd4a0-b34e-4631-8d41-c04b44578040 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:39.499112 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-6a1e6ef0-4802-4be5-a730-3ae8ec7a6d22 None None] MFA Rules not processed for user `41ab99d15f3842268dbfbccd342dea37`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:39.500951 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-6a1e6ef0-4802-4be5-a730-3ae8ec7a6d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:39.505554 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ccd4a0-b34e-4631-8d41-c04b44578040 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:39.631448 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3429ebfa-70d1-48d7-8ee2-92797baa6bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:39.632311 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429ebfa-70d1-48d7-8ee2-92797baa6bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:39.632708 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429ebfa-70d1-48d7-8ee2-92797baa6bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:39.633098 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429ebfa-70d1-48d7-8ee2-92797baa6bf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:39.634949 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3429ebfa-70d1-48d7-8ee2-92797baa6bf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:39.638374 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3429ebfa-70d1-48d7-8ee2-92797baa6bf0 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:39.658667 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 879/1761] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 01:28:39.663073 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1e6ef0-4802-4be5-a730-3ae8ec7a6d22 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:39.670109 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 883/1762] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:28:39 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:28:39.673088 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3429ebfa-70d1-48d7-8ee2-92797baa6bf0 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:39.684317 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1e6ef0-4802-4be5-a730-3ae8ec7a6d22 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:39.697409 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3429ebfa-70d1-48d7-8ee2-92797baa6bf0 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:39.700325 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73409452-a6b3-476d-b976-8371a6f57270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:39.700961 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73409452-a6b3-476d-b976-8371a6f57270 admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:39.701254 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73409452-a6b3-476d-b976-8371a6f57270 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:39.701513 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73409452-a6b3-476d-b976-8371a6f57270 admin admin] PATH_INFO: `/v3/projects` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:39.702211 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73409452-a6b3-476d-b976-8371a6f57270 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:39.704473 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73409452-a6b3-476d-b976-8371a6f57270 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:39.709111 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13514dc4-6098-47a8-82ef-8dcf2fa158bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:39.709978 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13514dc4-6098-47a8-82ef-8dcf2fa158bd admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:39.710378 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13514dc4-6098-47a8-82ef-8dcf2fa158bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:39.710794 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13514dc4-6098-47a8-82ef-8dcf2fa158bd admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:39.711659 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13514dc4-6098-47a8-82ef-8dcf2fa158bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:39.714426 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13514dc4-6098-47a8-82ef-8dcf2fa158bd admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:39.742608 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 884/1763] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:28:39 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:28:39.744308 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13514dc4-6098-47a8-82ef-8dcf2fa158bd admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:39.768175 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13514dc4-6098-47a8-82ef-8dcf2fa158bd admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:39.773183 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 880/1764] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:28:39 2022] POST /identity/v3/projects => generated 379 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 01:28:39.778202 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73409452-a6b3-476d-b976-8371a6f57270 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:39.787243 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb762d9d-c7ec-477f-b944-595e514d1c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:39.788335 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb762d9d-c7ec-477f-b944-595e514d1c77 admin admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:39.788789 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb762d9d-c7ec-477f-b944-595e514d1c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:39.789254 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb762d9d-c7ec-477f-b944-595e514d1c77 admin admin] PATH_INFO: `/v3/projects/070db20447f14ec1848de1413770c4fa/users/e68f21880c5f447fb071559a7c0788f7/roles/7185d0cfbcd44502b1613bcfe1b42f6f` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:39.838448 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb762d9d-c7ec-477f-b944-595e514d1c77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=070db20447f14ec1848de1413770c4fa, user_id=e68f21880c5f447fb071559a7c0788f7, role_id=7185d0cfbcd44502b1613bcfe1b42f6f)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:39.841470 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb762d9d-c7ec-477f-b944-595e514d1c77 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:39.884289 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 885/1765] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:28:39 2022] PUT /identity/v3/projects/070db20447f14ec1848de1413770c4fa/users/e68f21880c5f447fb071559a7c0788f7/roles/7185d0cfbcd44502b1613bcfe1b42f6f => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:28:39.886625 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4763d-0c35-4667-8b76-78c8407e673f None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:39.890422 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4763d-0c35-4667-8b76-78c8407e673f None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:39.891362 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4763d-0c35-4667-8b76-78c8407e673f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:39.975191 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73409452-a6b3-476d-b976-8371a6f57270 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:39.987740 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-a9f4763d-0c35-4667-8b76-78c8407e673f None None] MFA Rules not processed for user `e68f21880c5f447fb071559a7c0788f7`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:39.989195 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-a9f4763d-0c35-4667-8b76-78c8407e673f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:40.111415 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa5db4b-fc3f-4c34-ad69-cfed2462f290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:40.112099 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa5db4b-fc3f-4c34-ad69-cfed2462f290 admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:40.112930 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa5db4b-fc3f-4c34-ad69-cfed2462f290 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:40.113216 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa5db4b-fc3f-4c34-ad69-cfed2462f290 admin admin] PATH_INFO: `/v3/users` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:40.113920 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa5db4b-fc3f-4c34-ad69-cfed2462f290 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:40.116673 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa5db4b-fc3f-4c34-ad69-cfed2462f290 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:40.168388 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 881/1766] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:28:39 2022] POST /identity/v3/users => generated 296 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:28:40.172508 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa5db4b-fc3f-4c34-ad69-cfed2462f290 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:40.186893 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 886/1767] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:40.188066 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f4763d-0c35-4667-8b76-78c8407e673f None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:40.225580 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f4763d-0c35-4667-8b76-78c8407e673f None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:40.231741 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa5db4b-fc3f-4c34-ad69-cfed2462f290 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:40.252750 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f066eb7-3028-4d36-a8d5-c82eeb9ece7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:40.253377 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f066eb7-3028-4d36-a8d5-c82eeb9ece7a admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:40.253663 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f066eb7-3028-4d36-a8d5-c82eeb9ece7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:40.253938 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f066eb7-3028-4d36-a8d5-c82eeb9ece7a admin admin] PATH_INFO: `/v3/projects` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:40.254650 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f066eb7-3028-4d36-a8d5-c82eeb9ece7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:40.260087 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e394a8dd-4d1b-44a5-be39-dc4df965ebb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:40.260834 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e394a8dd-4d1b-44a5-be39-dc4df965ebb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:40.261188 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e394a8dd-4d1b-44a5-be39-dc4df965ebb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:40.261468 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e394a8dd-4d1b-44a5-be39-dc4df965ebb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:40.278222 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e394a8dd-4d1b-44a5-be39-dc4df965ebb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:40.279603 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f066eb7-3028-4d36-a8d5-c82eeb9ece7a admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:40.286015 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e394a8dd-4d1b-44a5-be39-dc4df965ebb6 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:40.332011 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 882/1768] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:28:40 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:28:40.336773 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e394a8dd-4d1b-44a5-be39-dc4df965ebb6 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:40.346377 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-e394a8dd-4d1b-44a5-be39-dc4df965ebb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:40.391476 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 887/1769] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:28:40 2022] POST /identity/v3/projects => generated 371 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:28:40.392419 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f066eb7-3028-4d36-a8d5-c82eeb9ece7a admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:40.404875 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e394a8dd-4d1b-44a5-be39-dc4df965ebb6 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:40.565397 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f066eb7-3028-4d36-a8d5-c82eeb9ece7a admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:40.595365 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f784b4db-8d95-429c-9683-a32b196f5362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:40.596517 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f784b4db-8d95-429c-9683-a32b196f5362 admin admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:40.596947 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f784b4db-8d95-429c-9683-a32b196f5362 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:40.597330 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f784b4db-8d95-429c-9683-a32b196f5362 admin admin] PATH_INFO: `/v3/projects/5a562283ee49408ca56b007907636134/users/aacffaa21c0549f785e83a7d438377ad/roles/36909bbf31d04993bb2a9fe587b572dc` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:40.643466 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f784b4db-8d95-429c-9683-a32b196f5362 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a562283ee49408ca56b007907636134, user_id=aacffaa21c0549f785e83a7d438377ad, role_id=36909bbf31d04993bb2a9fe587b572dc)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:40.656870 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f033574a-0e5f-4e40-a144-569f81e43765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:40.658908 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f033574a-0e5f-4e40-a144-569f81e43765 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:40.660107 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f784b4db-8d95-429c-9683-a32b196f5362 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:40.662401 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f033574a-0e5f-4e40-a144-569f81e43765 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:40.665993 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f033574a-0e5f-4e40-a144-569f81e43765 admin admin] PATH_INFO: `/v3/projects/6760ddecbdbe475e9ae0e8bf48d29099` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:40.674050 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f033574a-0e5f-4e40-a144-569f81e43765 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6760ddecbdbe475e9ae0e8bf48d29099)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:40.681372 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f033574a-0e5f-4e40-a144-569f81e43765 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:40.710151 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 888/1770] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:28:40 2022] PUT /identity/v3/projects/5a562283ee49408ca56b007907636134/users/aacffaa21c0549f785e83a7d438377ad/roles/36909bbf31d04993bb2a9fe587b572dc => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:28:40.711109 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f784b4db-8d95-429c-9683-a32b196f5362 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:40.811447 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-f033574a-0e5f-4e40-a144-569f81e43765 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6760ddecbdbe475e9ae0e8bf48d29099', 'request_id': 'req-f033574a-0e5f-4e40-a144-569f81e43765'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:40.822057 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-f033574a-0e5f-4e40-a144-569f81e43765 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6760ddecbdbe475e9ae0e8bf48d29099', 'request_id': 'req-f033574a-0e5f-4e40-a144-569f81e43765'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:40.833661 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-f033574a-0e5f-4e40-a144-569f81e43765 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6760ddecbdbe475e9ae0e8bf48d29099', 'request_id': 'req-f033574a-0e5f-4e40-a144-569f81e43765'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:40.856525 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-f033574a-0e5f-4e40-a144-569f81e43765 admin admin] The token cache is being invalidate because project 6760ddecbdbe475e9ae0e8bf48d29099 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:28:40.857130 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-f033574a-0e5f-4e40-a144-569f81e43765 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:40.858367 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-f033574a-0e5f-4e40-a144-569f81e43765 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:40.861066 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 883/1771] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:28:40 2022] DELETE /identity/v3/projects/6760ddecbdbe475e9ae0e8bf48d29099 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:28:40.866558 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea102542-3ee6-4dbe-84f9-defbf7e7064e None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:40.867341 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea102542-3ee6-4dbe-84f9-defbf7e7064e None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:40.867630 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea102542-3ee6-4dbe-84f9-defbf7e7064e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:40.887492 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f784b4db-8d95-429c-9683-a32b196f5362 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:40.930678 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-ea102542-3ee6-4dbe-84f9-defbf7e7064e None None] MFA Rules not processed for user `b5e24981873246ea9df9d121c8dc22a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:40.936910 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-ea102542-3ee6-4dbe-84f9-defbf7e7064e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:41.120015 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 884/1772] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:41.122611 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea102542-3ee6-4dbe-84f9-defbf7e7064e None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:41.126101 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-ea102542-3ee6-4dbe-84f9-defbf7e7064e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:41.133121 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3319e3b5-b21d-4a56-90e2-66df5c9d2a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:41.138213 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3319e3b5-b21d-4a56-90e2-66df5c9d2a8c admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:41.138213 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3319e3b5-b21d-4a56-90e2-66df5c9d2a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:41.140418 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3319e3b5-b21d-4a56-90e2-66df5c9d2a8c admin admin] PATH_INFO: `/v3/users` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:41.142304 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3319e3b5-b21d-4a56-90e2-66df5c9d2a8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:41.151781 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3319e3b5-b21d-4a56-90e2-66df5c9d2a8c admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:41.160342 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea102542-3ee6-4dbe-84f9-defbf7e7064e None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:41.173956 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2402d2c3-386e-453b-b98d-ab3b2d89fb71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:41.174653 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402d2c3-386e-453b-b98d-ab3b2d89fb71 admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:41.177205 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402d2c3-386e-453b-b98d-ab3b2d89fb71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:41.177493 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402d2c3-386e-453b-b98d-ab3b2d89fb71 admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:41.180477 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2402d2c3-386e-453b-b98d-ab3b2d89fb71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:41.185476 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2402d2c3-386e-453b-b98d-ab3b2d89fb71 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:41.227461 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 885/1773] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:28:41 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:28:41.227461 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2402d2c3-386e-453b-b98d-ab3b2d89fb71 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:41.231573 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-2402d2c3-386e-453b-b98d-ab3b2d89fb71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:41.237999 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 889/1774] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:28:40 2022] POST /identity/v3/users => generated 292 bytes in 524 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:28:41.237999 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ec24f-3b47-4feb-9a73-fd1e7f6d3369 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:41.237999 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ec24f-3b47-4feb-9a73-fd1e7f6d3369 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:41.237999 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ec24f-3b47-4feb-9a73-fd1e7f6d3369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:41.272187 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2402d2c3-386e-453b-b98d-ab3b2d89fb71 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:41.286214 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a969a9ec-6fb3-40c0-bd39-119259767d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:41.287136 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a969a9ec-6fb3-40c0-bd39-119259767d3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:41.289378 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a969a9ec-6fb3-40c0-bd39-119259767d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:41.291111 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a969a9ec-6fb3-40c0-bd39-119259767d3b admin admin] PATH_INFO: `/v3/projects/fe18794e373a4d0d82d62bb9d79eb6d6` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:41.297882 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a969a9ec-6fb3-40c0-bd39-119259767d3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe18794e373a4d0d82d62bb9d79eb6d6)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:41.311557 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a969a9ec-6fb3-40c0-bd39-119259767d3b admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:41.354762 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-af3ec24f-3b47-4feb-9a73-fd1e7f6d3369 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:41.361553 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-af3ec24f-3b47-4feb-9a73-fd1e7f6d3369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:41.409267 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 890/1775] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:41.411248 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3ec24f-3b47-4feb-9a73-fd1e7f6d3369 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:41.418569 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-af3ec24f-3b47-4feb-9a73-fd1e7f6d3369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:41.482823 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-a969a9ec-6fb3-40c0-bd39-119259767d3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe18794e373a4d0d82d62bb9d79eb6d6', 'request_id': 'req-a969a9ec-6fb3-40c0-bd39-119259767d3b'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:41.509419 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-a969a9ec-6fb3-40c0-bd39-119259767d3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe18794e373a4d0d82d62bb9d79eb6d6', 'request_id': 'req-a969a9ec-6fb3-40c0-bd39-119259767d3b'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:41.527416 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-a969a9ec-6fb3-40c0-bd39-119259767d3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe18794e373a4d0d82d62bb9d79eb6d6', 'request_id': 'req-a969a9ec-6fb3-40c0-bd39-119259767d3b'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:41.556335 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-a969a9ec-6fb3-40c0-bd39-119259767d3b admin admin] The token cache is being invalidate because project fe18794e373a4d0d82d62bb9d79eb6d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:28:41.556538 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-a969a9ec-6fb3-40c0-bd39-119259767d3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:41.572287 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-a969a9ec-6fb3-40c0-bd39-119259767d3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:41.582237 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 886/1776] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:28:41 2022] DELETE /identity/v3/projects/fe18794e373a4d0d82d62bb9d79eb6d6 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:28:41.585651 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a969a9ec-6fb3-40c0-bd39-119259767d3b admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:41.589863 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-a969a9ec-6fb3-40c0-bd39-119259767d3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:41.656565 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3ec24f-3b47-4feb-9a73-fd1e7f6d3369 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:41.782675 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a969a9ec-6fb3-40c0-bd39-119259767d3b admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:41.799795 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d732c6-070a-4297-96c6-6a6d1c50b125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:41.801355 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d732c6-070a-4297-96c6-6a6d1c50b125 admin admin] REQUEST_METHOD: `PUT` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:41.801810 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d732c6-070a-4297-96c6-6a6d1c50b125 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:41.802269 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d732c6-070a-4297-96c6-6a6d1c50b125 admin admin] PATH_INFO: `/v3/projects/5a562283ee49408ca56b007907636134/users/aacffaa21c0549f785e83a7d438377ad/roles/36909bbf31d04993bb2a9fe587b572dc` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:41.805258 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d732c6-070a-4297-96c6-6a6d1c50b125 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a562283ee49408ca56b007907636134, user_id=aacffaa21c0549f785e83a7d438377ad, role_id=36909bbf31d04993bb2a9fe587b572dc)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:41.809515 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d732c6-070a-4297-96c6-6a6d1c50b125 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:41.825763 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 887/1777] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:28:41 2022] PUT /identity/v3/projects/5a562283ee49408ca56b007907636134/users/aacffaa21c0549f785e83a7d438377ad/roles/36909bbf31d04993bb2a9fe587b572dc => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:28:41.830477 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d732c6-070a-4297-96c6-6a6d1c50b125 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:41.832650 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-63d732c6-070a-4297-96c6-6a6d1c50b125 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:41.865349 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc202b6-853a-4ef7-b0aa-4d6192bae1d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140c6d1a20e94192bde06e72040f162d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:41.866040 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc202b6-853a-4ef7-b0aa-4d6192bae1d6 service nova] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:41.866336 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc202b6-853a-4ef7-b0aa-4d6192bae1d6 service nova] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:41.866605 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc202b6-853a-4ef7-b0aa-4d6192bae1d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:41.872374 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-9fc202b6-853a-4ef7-b0aa-4d6192bae1d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:41.958977 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d732c6-070a-4297-96c6-6a6d1c50b125 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:41.967185 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e413a79-d332-420b-8fb9-9b55a91fa44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:41.967879 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e413a79-d332-420b-8fb9-9b55a91fa44a admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:41.968315 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e413a79-d332-420b-8fb9-9b55a91fa44a admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:41.968595 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e413a79-d332-420b-8fb9-9b55a91fa44a admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:41.969483 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e413a79-d332-420b-8fb9-9b55a91fa44a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:41.971970 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e413a79-d332-420b-8fb9-9b55a91fa44a admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:41.996154 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 888/1778] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:28:41 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:28:41.998079 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5e480-d9e3-46fc-be23-612d86132af1 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:41.998453 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5e480-d9e3-46fc-be23-612d86132af1 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:41.999242 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5e480-d9e3-46fc-be23-612d86132af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:42.026141 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-d8c5e480-d9e3-46fc-be23-612d86132af1 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:42.029316 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-d8c5e480-d9e3-46fc-be23-612d86132af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:42.040098 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 889/1779] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:42.042737 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c14e2-28c9-4b6a-ac00-450539d46153 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:42.043039 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c14e2-28c9-4b6a-ac00-450539d46153 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:42.043319 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c14e2-28c9-4b6a-ac00-450539d46153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:42.083547 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-db2c14e2-28c9-4b6a-ac00-450539d46153 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:42.084878 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-db2c14e2-28c9-4b6a-ac00-450539d46153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:42.088677 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc202b6-853a-4ef7-b0aa-4d6192bae1d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:42.090318 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc202b6-853a-4ef7-b0aa-4d6192bae1d6 service nova] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:42.107024 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 890/1780] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:42.109621 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c9fb0-0530-42ca-addc-ede70308d8c0 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:42.118947 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c9fb0-0530-42ca-addc-ede70308d8c0 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:42.119356 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c9fb0-0530-42ca-addc-ede70308d8c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:42.122309 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 891/1781] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:28:41 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 712 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:28:42.127208 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc202b6-853a-4ef7-b0aa-4d6192bae1d6 service nova] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:42.160332 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc202b6-853a-4ef7-b0aa-4d6192bae1d6 service nova] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:42.174036 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69892087-c32a-413e-874b-9b1cdc2a2c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:42.174968 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69892087-c32a-413e-874b-9b1cdc2a2c76 admin admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:42.175252 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69892087-c32a-413e-874b-9b1cdc2a2c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:42.175532 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69892087-c32a-413e-874b-9b1cdc2a2c76 admin admin] PATH_INFO: `/v3/projects/32525a4885e349f7b99d4ad28c17b892/users/ff2ea9e83cbe49b9b233302b0d632ad1/roles/36909bbf31d04993bb2a9fe587b572dc` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:42.211734 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-2f6c9fb0-0530-42ca-addc-ede70308d8c0 None None] MFA Rules not processed for user `aacffaa21c0549f785e83a7d438377ad`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:42.219666 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-2f6c9fb0-0530-42ca-addc-ede70308d8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:42.233506 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69892087-c32a-413e-874b-9b1cdc2a2c76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32525a4885e349f7b99d4ad28c17b892, user_id=ff2ea9e83cbe49b9b233302b0d632ad1, role_id=36909bbf31d04993bb2a9fe587b572dc)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:42.240278 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69892087-c32a-413e-874b-9b1cdc2a2c76 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:42.275471 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 892/1782] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:28:42 2022] PUT /identity/v3/projects/32525a4885e349f7b99d4ad28c17b892/users/ff2ea9e83cbe49b9b233302b0d632ad1/roles/36909bbf31d04993bb2a9fe587b572dc => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:28:42.276552 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69892087-c32a-413e-874b-9b1cdc2a2c76 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:42.426993 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 891/1783] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:42 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:42.428504 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda2e745-7578-453d-8ab2-99385c48f91b None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:42.428809 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda2e745-7578-453d-8ab2-99385c48f91b None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:42.429100 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda2e745-7578-453d-8ab2-99385c48f91b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:42.469009 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69892087-c32a-413e-874b-9b1cdc2a2c76 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:42.481092 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-dda2e745-7578-453d-8ab2-99385c48f91b None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:42.482345 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-dda2e745-7578-453d-8ab2-99385c48f91b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:42.492674 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5564f940-de87-436c-8ebf-76eac3fb5b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:42.495413 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564f940-de87-436c-8ebf-76eac3fb5b7f admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:42.495749 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564f940-de87-436c-8ebf-76eac3fb5b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:42.496077 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564f940-de87-436c-8ebf-76eac3fb5b7f admin admin] PATH_INFO: `/v3/domains` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:42.496876 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5564f940-de87-436c-8ebf-76eac3fb5b7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:28:42.497188 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5564f940-de87-436c-8ebf-76eac3fb5b7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:42.509068 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 892/1784] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:42.509068 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda2e745-7578-453d-8ab2-99385c48f91b None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:42.512111 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5564f940-de87-436c-8ebf-76eac3fb5b7f admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:42.538121 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda2e745-7578-453d-8ab2-99385c48f91b None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:42.554737 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 893/1785] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Mar 30 01:28:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:28:42.554928 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c56e3db-defd-45b7-bef4-6e836dda17bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:42.554928 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56e3db-defd-45b7-bef4-6e836dda17bb admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:42.554928 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56e3db-defd-45b7-bef4-6e836dda17bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:42.554928 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56e3db-defd-45b7-bef4-6e836dda17bb admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:42.555423 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c56e3db-defd-45b7-bef4-6e836dda17bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:42.557846 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5564f940-de87-436c-8ebf-76eac3fb5b7f admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:42.559480 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c56e3db-defd-45b7-bef4-6e836dda17bb admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:42.567751 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-5564f940-de87-436c-8ebf-76eac3fb5b7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:42.593735 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 893/1786] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:28:42 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:28:42.612369 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c56e3db-defd-45b7-bef4-6e836dda17bb admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:42.633103 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c56e3db-defd-45b7-bef4-6e836dda17bb admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:42.649230 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe313035-8a84-43b2-b76b-8ed81fca89be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:42.669297 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe313035-8a84-43b2-b76b-8ed81fca89be admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:42.670524 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5564f940-de87-436c-8ebf-76eac3fb5b7f admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:42.671688 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe313035-8a84-43b2-b76b-8ed81fca89be admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:42.671688 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe313035-8a84-43b2-b76b-8ed81fca89be admin admin] PATH_INFO: `/v3/domains` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:42.676973 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe313035-8a84-43b2-b76b-8ed81fca89be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:28:42.676973 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe313035-8a84-43b2-b76b-8ed81fca89be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:42.680793 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe313035-8a84-43b2-b76b-8ed81fca89be admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:42.681578 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34662fb-aac8-4f2c-841f-98727951efc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45219f386f0147b6bd380efe4ab62812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:42.682816 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34662fb-aac8-4f2c-841f-98727951efc7 service cinder] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:42.683408 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34662fb-aac8-4f2c-841f-98727951efc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:42.683855 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34662fb-aac8-4f2c-841f-98727951efc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:42.746141 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 894/1787] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Mar 30 01:28:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:28:42.750985 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe313035-8a84-43b2-b76b-8ed81fca89be admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:42.783121 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe313035-8a84-43b2-b76b-8ed81fca89be admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:42.802525 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be0c17-f269-4d45-b53e-4e3ec5e256bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:42.805790 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be0c17-f269-4d45-b53e-4e3ec5e256bf admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:42.807813 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be0c17-f269-4d45-b53e-4e3ec5e256bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:42.808051 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be0c17-f269-4d45-b53e-4e3ec5e256bf admin admin] PATH_INFO: `/v3/projects` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:42.811893 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51be0c17-f269-4d45-b53e-4e3ec5e256bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:42.816363 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51be0c17-f269-4d45-b53e-4e3ec5e256bf admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:42.912770 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34662fb-aac8-4f2c-841f-98727951efc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:42.913268 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 895/1788] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:28:42 2022] POST /identity/v3/projects => generated 377 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:28:42.920678 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be0c17-f269-4d45-b53e-4e3ec5e256bf admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:42.920902 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34662fb-aac8-4f2c-841f-98727951efc7 service cinder] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:42.946198 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 894/1789] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:28:42 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:28:42.947247 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34662fb-aac8-4f2c-841f-98727951efc7 service cinder] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:42.998349 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34662fb-aac8-4f2c-841f-98727951efc7 service cinder] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:43.117784 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be0c17-f269-4d45-b53e-4e3ec5e256bf admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:43.140559 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9e2dca-a711-4610-a42f-8b561837b409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:43.143892 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e2dca-a711-4610-a42f-8b561837b409 admin admin] REQUEST_METHOD: `PUT` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:43.149392 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e2dca-a711-4610-a42f-8b561837b409 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:43.153283 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e2dca-a711-4610-a42f-8b561837b409 admin admin] PATH_INFO: `/v3/projects/32525a4885e349f7b99d4ad28c17b892/users/ff2ea9e83cbe49b9b233302b0d632ad1/roles/36909bbf31d04993bb2a9fe587b572dc` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:43.163024 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9e2dca-a711-4610-a42f-8b561837b409 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32525a4885e349f7b99d4ad28c17b892, user_id=ff2ea9e83cbe49b9b233302b0d632ad1, role_id=36909bbf31d04993bb2a9fe587b572dc)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:43.176324 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9e2dca-a711-4610-a42f-8b561837b409 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:43.190647 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3339743-9449-45cf-ad07-b2237c997807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:43.194161 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3339743-9449-45cf-ad07-b2237c997807 admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:43.194449 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3339743-9449-45cf-ad07-b2237c997807 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:43.194748 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3339743-9449-45cf-ad07-b2237c997807 admin admin] PATH_INFO: `/v3/projects` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:43.199189 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3339743-9449-45cf-ad07-b2237c997807 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:43.203456 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3339743-9449-45cf-ad07-b2237c997807 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:43.213993 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 896/1790] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:28:42 2022] PUT /identity/v3/projects/32525a4885e349f7b99d4ad28c17b892/users/ff2ea9e83cbe49b9b233302b0d632ad1/roles/36909bbf31d04993bb2a9fe587b572dc => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:28:43.223970 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f14d6-5306-4516-9a83-f1144e8a3be5 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:43.224311 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f14d6-5306-4516-9a83-f1144e8a3be5 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:43.224642 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f14d6-5306-4516-9a83-f1144e8a3be5 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:43.226658 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 897/1791] 10.222.0.30 () {54 vars in 921 bytes} [Wed Mar 30 01:28:43 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:28:43.227285 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40f14d6-5306-4516-9a83-f1144e8a3be5 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:43.334869 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 895/1792] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:28:42 2022] POST /identity/v3/projects => generated 389 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:28:43.342969 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa43c7f8-8597-44bd-be86-b708dcb910f6 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:43.343384 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa43c7f8-8597-44bd-be86-b708dcb910f6 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:43.344601 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa43c7f8-8597-44bd-be86-b708dcb910f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:43.431203 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-aa43c7f8-8597-44bd-be86-b708dcb910f6 None None] MFA Rules not processed for user `ff2ea9e83cbe49b9b233302b0d632ad1`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:43.432797 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-aa43c7f8-8597-44bd-be86-b708dcb910f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:43.497505 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40f14d6-5306-4516-9a83-f1144e8a3be5 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:43.645439 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe7aeff-6f0d-49e6-ab0c-300d5c691c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:43.646649 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe7aeff-6f0d-49e6-ab0c-300d5c691c20 admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:43.647104 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe7aeff-6f0d-49e6-ab0c-300d5c691c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:43.647522 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe7aeff-6f0d-49e6-ab0c-300d5c691c20 admin admin] PATH_INFO: `/v3/users` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:43.648337 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe7aeff-6f0d-49e6-ab0c-300d5c691c20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:43.659145 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe7aeff-6f0d-49e6-ab0c-300d5c691c20 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:43.706671 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 898/1793] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:28:43 2022] POST /identity/v3/users => generated 289 bytes in 479 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:28:43.713992 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 896/1794] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:43 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:43.715056 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb44bf8-22cb-41c4-a4f6-f782884f1143 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:43.715370 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa43c7f8-8597-44bd-be86-b708dcb910f6 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:43.715661 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb44bf8-22cb-41c4-a4f6-f782884f1143 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:43.716085 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb44bf8-22cb-41c4-a4f6-f782884f1143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:43.754323 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa43c7f8-8597-44bd-be86-b708dcb910f6 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:43.757873 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-8cb44bf8-22cb-41c4-a4f6-f782884f1143 None None] MFA Rules not processed for user `140c6d1a20e94192bde06e72040f162d`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:43.760939 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-8cb44bf8-22cb-41c4-a4f6-f782884f1143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:43.761725 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9323e8f-cba3-4507-96a5-2aa6083b8930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:43.762680 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9323e8f-cba3-4507-96a5-2aa6083b8930 admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:43.763139 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9323e8f-cba3-4507-96a5-2aa6083b8930 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:43.763578 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9323e8f-cba3-4507-96a5-2aa6083b8930 admin admin] PATH_INFO: `/v3/users` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:43.764433 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9323e8f-cba3-4507-96a5-2aa6083b8930 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:43.766547 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9323e8f-cba3-4507-96a5-2aa6083b8930 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:43.803966 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 897/1795] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:28:43 2022] POST /identity/v3/users => generated 295 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:28:43.808151 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd750d34-b64b-44d7-b3f5-004b410eec4b None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:43.808477 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd750d34-b64b-44d7-b3f5-004b410eec4b None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:43.810641 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd750d34-b64b-44d7-b3f5-004b410eec4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:43.866449 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-bd750d34-b64b-44d7-b3f5-004b410eec4b None None] MFA Rules not processed for user `4a2bf75cc4e3465987b8450318708b49`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:43.869677 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-bd750d34-b64b-44d7-b3f5-004b410eec4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:43.906723 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 899/1796] 10.222.0.30 () {58 vars in 1018 bytes} [Wed Mar 30 01:28:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:43.908000 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb44bf8-22cb-41c4-a4f6-f782884f1143 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:43.926421 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb44bf8-22cb-41c4-a4f6-f782884f1143 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:43.932455 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86c9a4d-49c4-4f80-917a-1b1f904ed34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:43.933627 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c9a4d-49c4-4f80-917a-1b1f904ed34c admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:43.933627 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c9a4d-49c4-4f80-917a-1b1f904ed34c admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:43.933962 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c9a4d-49c4-4f80-917a-1b1f904ed34c admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:43.934820 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86c9a4d-49c4-4f80-917a-1b1f904ed34c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:43.937062 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86c9a4d-49c4-4f80-917a-1b1f904ed34c admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:43.950666 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 900/1797] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:28:43 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:28:43.951748 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86c9a4d-49c4-4f80-917a-1b1f904ed34c admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:43.953689 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-a86c9a4d-49c4-4f80-917a-1b1f904ed34c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:44.000926 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 898/1798] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:44.000926 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd750d34-b64b-44d7-b3f5-004b410eec4b None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:44.017291 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd750d34-b64b-44d7-b3f5-004b410eec4b None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:44.027128 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cf78e0-df5b-4852-bb9a-294cfda930c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:44.028720 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf78e0-df5b-4852-bb9a-294cfda930c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:44.029112 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf78e0-df5b-4852-bb9a-294cfda930c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:44.029530 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf78e0-df5b-4852-bb9a-294cfda930c1 admin admin] PATH_INFO: `/v3/users/41ab99d15f3842268dbfbccd342dea37` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:44.032519 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cf78e0-df5b-4852-bb9a-294cfda930c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41ab99d15f3842268dbfbccd342dea37)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:44.035945 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cf78e0-df5b-4852-bb9a-294cfda930c1 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:44.117381 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86c9a4d-49c4-4f80-917a-1b1f904ed34c admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:44.125637 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd87a37-1fc9-46c9-8224-0ccd610a336b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45219f386f0147b6bd380efe4ab62812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:44.126544 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd87a37-1fc9-46c9-8224-0ccd610a336b service cinder] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:44.126792 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd87a37-1fc9-46c9-8224-0ccd610a336b service cinder] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:44.127175 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd87a37-1fc9-46c9-8224-0ccd610a336b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:44.129514 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-d5cf78e0-df5b-4852-bb9a-294cfda930c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41ab99d15f3842268dbfbccd342dea37'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:44.151871 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd87a37-1fc9-46c9-8224-0ccd610a336b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:44.153793 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd87a37-1fc9-46c9-8224-0ccd610a336b service cinder] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:44.170015 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-d5cf78e0-df5b-4852-bb9a-294cfda930c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41ab99d15f3842268dbfbccd342dea37'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:44.171579 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-d5cf78e0-df5b-4852-bb9a-294cfda930c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41ab99d15f3842268dbfbccd342dea37'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:44.211111 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 901/1799] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:28:43 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:28:44.226001 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-d5cf78e0-df5b-4852-bb9a-294cfda930c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41ab99d15f3842268dbfbccd342dea37'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:44.227484 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd87a37-1fc9-46c9-8224-0ccd610a336b service cinder] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:44.250481 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-d5cf78e0-df5b-4852-bb9a-294cfda930c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41ab99d15f3842268dbfbccd342dea37'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:44.256578 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd87a37-1fc9-46c9-8224-0ccd610a336b service cinder] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:44.258405 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 899/1800] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:28:43 2022] DELETE /identity/v3/users/41ab99d15f3842268dbfbccd342dea37 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:28:44.260058 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cf78e0-df5b-4852-bb9a-294cfda930c1 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:44.276473 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-d5cf78e0-df5b-4852-bb9a-294cfda930c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:44.480545 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f0eb7-419f-4f8e-8513-5d523b5112ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:44.481231 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f0eb7-419f-4f8e-8513-5d523b5112ae admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:44.481635 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f0eb7-419f-4f8e-8513-5d523b5112ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:44.481815 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f0eb7-419f-4f8e-8513-5d523b5112ae admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:44.482513 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700f0eb7-419f-4f8e-8513-5d523b5112ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:44.484644 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700f0eb7-419f-4f8e-8513-5d523b5112ae admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:44.536141 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cf78e0-df5b-4852-bb9a-294cfda930c1 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:44.549501 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 902/1801] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:28:44 2022] GET /identity/v3/roles => generated 1420 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:28:44.558019 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05241b1-c2cf-4c57-9f8a-0bfae092eafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:44.558284 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b4dcb-5072-4db6-80fc-a903ed8d576e None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:44.558595 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b4dcb-5072-4db6-80fc-a903ed8d576e None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:44.559111 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b4dcb-5072-4db6-80fc-a903ed8d576e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:44.574430 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05241b1-c2cf-4c57-9f8a-0bfae092eafe admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:44.576061 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05241b1-c2cf-4c57-9f8a-0bfae092eafe admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:44.576497 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05241b1-c2cf-4c57-9f8a-0bfae092eafe admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:44.579849 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05241b1-c2cf-4c57-9f8a-0bfae092eafe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:44.598665 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05241b1-c2cf-4c57-9f8a-0bfae092eafe admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:44.628634 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-291b4dcb-5072-4db6-80fc-a903ed8d576e None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:44.630042 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-291b4dcb-5072-4db6-80fc-a903ed8d576e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:44.646692 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 900/1802] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:28:44 2022] GET /identity/v3/roles => generated 1420 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:28:44.650723 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05241b1-c2cf-4c57-9f8a-0bfae092eafe admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:44.655692 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 903/1803] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:44.655692 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b4dcb-5072-4db6-80fc-a903ed8d576e None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:44.659577 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-b05241b1-c2cf-4c57-9f8a-0bfae092eafe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:44.678205 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b4dcb-5072-4db6-80fc-a903ed8d576e None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:44.697528 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8d15f4-fbae-4123-8f14-43f12ea0fc1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:44.698826 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d15f4-fbae-4123-8f14-43f12ea0fc1d admin admin] REQUEST_METHOD: `PUT` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:44.699326 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d15f4-fbae-4123-8f14-43f12ea0fc1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:44.699828 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d15f4-fbae-4123-8f14-43f12ea0fc1d admin admin] PATH_INFO: `/v3/projects/fc15de24eee04f669e56ee8b4a0fe53b/users/c0c48a39c4874b258f04e2346e9ae888/roles/7185d0cfbcd44502b1613bcfe1b42f6f` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:44.714002 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05241b1-c2cf-4c57-9f8a-0bfae092eafe admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:44.730298 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2f5a71-7835-43fe-85d5-40ef6a096fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:44.731295 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f5a71-7835-43fe-85d5-40ef6a096fb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:44.732422 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8d15f4-fbae-4123-8f14-43f12ea0fc1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc15de24eee04f669e56ee8b4a0fe53b, user_id=c0c48a39c4874b258f04e2346e9ae888, role_id=7185d0cfbcd44502b1613bcfe1b42f6f)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:44.741541 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8d15f4-fbae-4123-8f14-43f12ea0fc1d admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:44.746437 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f5a71-7835-43fe-85d5-40ef6a096fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:44.747492 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f5a71-7835-43fe-85d5-40ef6a096fb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:44.749777 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2f5a71-7835-43fe-85d5-40ef6a096fb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:44.751488 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2f5a71-7835-43fe-85d5-40ef6a096fb9 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:44.781405 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 904/1804] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:28:44 2022] PUT /identity/v3/projects/fc15de24eee04f669e56ee8b4a0fe53b/users/c0c48a39c4874b258f04e2346e9ae888/roles/7185d0cfbcd44502b1613bcfe1b42f6f => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:28:44.784690 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c76fa-5c3b-404f-b4ae-53b34dfa94cb None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:44.787299 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c76fa-5c3b-404f-b4ae-53b34dfa94cb None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:44.788013 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c76fa-5c3b-404f-b4ae-53b34dfa94cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:44.800906 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 901/1805] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:28:44 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:28:44.804619 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2f5a71-7835-43fe-85d5-40ef6a096fb9 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:44.811045 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-6f2f5a71-7835-43fe-85d5-40ef6a096fb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:44.878436 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-0f3c76fa-5c3b-404f-b4ae-53b34dfa94cb None None] MFA Rules not processed for user `c0c48a39c4874b258f04e2346e9ae888`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:44.880789 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-0f3c76fa-5c3b-404f-b4ae-53b34dfa94cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:44.953853 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2f5a71-7835-43fe-85d5-40ef6a096fb9 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:45.075735 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cea544-8790-43f4-9cab-b96ed57e903b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:45.076474 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cea544-8790-43f4-9cab-b96ed57e903b service neutron] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:45.076705 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cea544-8790-43f4-9cab-b96ed57e903b service neutron] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:45.076990 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cea544-8790-43f4-9cab-b96ed57e903b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:45.171525 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 905/1806] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:45.171525 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3c76fa-5c3b-404f-b4ae-53b34dfa94cb None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:45.242900 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cea544-8790-43f4-9cab-b96ed57e903b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:45.247018 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cea544-8790-43f4-9cab-b96ed57e903b service neutron] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:45.292574 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 902/1807] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:28:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:28:45.298049 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cea544-8790-43f4-9cab-b96ed57e903b service neutron] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:45.321683 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cea544-8790-43f4-9cab-b96ed57e903b service neutron] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:45.342303 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3c76fa-5c3b-404f-b4ae-53b34dfa94cb None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:45.343137 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b7909b-3922-41c3-abb5-e445d57795ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:45.343936 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7909b-3922-41c3-abb5-e445d57795ac admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:45.344401 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7909b-3922-41c3-abb5-e445d57795ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:45.344840 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7909b-3922-41c3-abb5-e445d57795ac admin admin] PATH_INFO: `/v3/projects` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:45.345652 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b7909b-3922-41c3-abb5-e445d57795ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:45.347204 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e807bc-5242-410e-bc86-9a9600a162b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:45.348107 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e807bc-5242-410e-bc86-9a9600a162b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:45.348391 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e807bc-5242-410e-bc86-9a9600a162b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:45.348606 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b7909b-3922-41c3-abb5-e445d57795ac admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:45.348722 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e807bc-5242-410e-bc86-9a9600a162b9 admin admin] PATH_INFO: `/v3/projects/7889c89608644401a56e169daf69d5c3/users/7a7cdc0661bd422b8672facee3932c32/roles/7185d0cfbcd44502b1613bcfe1b42f6f` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:45.391700 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e807bc-5242-410e-bc86-9a9600a162b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7889c89608644401a56e169daf69d5c3, user_id=7a7cdc0661bd422b8672facee3932c32, role_id=7185d0cfbcd44502b1613bcfe1b42f6f)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:45.394463 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e807bc-5242-410e-bc86-9a9600a162b9 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:45.436703 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 903/1808] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:28:45 2022] POST /identity/v3/projects => generated 381 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:28:45.437173 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 906/1809] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:28:45 2022] PUT /identity/v3/projects/7889c89608644401a56e169daf69d5c3/users/7a7cdc0661bd422b8672facee3932c32/roles/7185d0cfbcd44502b1613bcfe1b42f6f => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:28:45.437585 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b7909b-3922-41c3-abb5-e445d57795ac admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:45.439317 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e807bc-5242-410e-bc86-9a9600a162b9 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:45.439425 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-e3b7909b-3922-41c3-abb5-e445d57795ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:45.452633 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-98e807bc-5242-410e-bc86-9a9600a162b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:45.594858 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b7909b-3922-41c3-abb5-e445d57795ac admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:45.624315 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0726963-0238-4218-856c-d3af8d9cb365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:45.625307 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0726963-0238-4218-856c-d3af8d9cb365 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:45.625506 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0726963-0238-4218-856c-d3af8d9cb365 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:45.625782 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0726963-0238-4218-856c-d3af8d9cb365 admin admin] PATH_INFO: `/v3/users/e68f21880c5f447fb071559a7c0788f7` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:45.631083 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0726963-0238-4218-856c-d3af8d9cb365 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e68f21880c5f447fb071559a7c0788f7)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:45.633045 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e807bc-5242-410e-bc86-9a9600a162b9 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:45.638209 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0726963-0238-4218-856c-d3af8d9cb365 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:45.793847 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a65a1-bd40-44aa-ab1b-64e212816615 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140c6d1a20e94192bde06e72040f162d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:45.794578 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a65a1-bd40-44aa-ab1b-64e212816615 service nova] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:45.794917 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a65a1-bd40-44aa-ab1b-64e212816615 service nova] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:45.795223 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a65a1-bd40-44aa-ab1b-64e212816615 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:45.803529 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-de3a65a1-bd40-44aa-ab1b-64e212816615 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:45.818976 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-b0726963-0238-4218-856c-d3af8d9cb365 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e68f21880c5f447fb071559a7c0788f7'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:45.833049 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3a65a1-bd40-44aa-ab1b-64e212816615 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:45.838060 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3a65a1-bd40-44aa-ab1b-64e212816615 service nova] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:45.841982 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-b0726963-0238-4218-856c-d3af8d9cb365 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e68f21880c5f447fb071559a7c0788f7'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:45.843164 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-b0726963-0238-4218-856c-d3af8d9cb365 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e68f21880c5f447fb071559a7c0788f7'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:45.855396 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-b0726963-0238-4218-856c-d3af8d9cb365 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e68f21880c5f447fb071559a7c0788f7'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:45.879057 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-b0726963-0238-4218-856c-d3af8d9cb365 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e68f21880c5f447fb071559a7c0788f7'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:45.890565 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 907/1811] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:28:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:28:45.892684 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a65a1-bd40-44aa-ab1b-64e212816615 service nova] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:45.904686 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 904/1811] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:28:45 2022] DELETE /identity/v3/users/e68f21880c5f447fb071559a7c0788f7 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:28:45.916936 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69745a4c-b286-4514-9b69-469e12deab58 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:45.918001 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69745a4c-b286-4514-9b69-469e12deab58 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:45.919077 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69745a4c-b286-4514-9b69-469e12deab58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:45.927868 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a65a1-bd40-44aa-ab1b-64e212816615 service nova] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:45.997237 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-69745a4c-b286-4514-9b69-469e12deab58 None None] MFA Rules not processed for user `7a7cdc0661bd422b8672facee3932c32`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:45.999883 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-69745a4c-b286-4514-9b69-469e12deab58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:46.170141 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770fe789-e23a-4ec2-b501-124fdba97fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:46.173205 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770fe789-e23a-4ec2-b501-124fdba97fd2 admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:46.174358 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770fe789-e23a-4ec2-b501-124fdba97fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:46.174648 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770fe789-e23a-4ec2-b501-124fdba97fd2 admin admin] PATH_INFO: `/v3/users` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:46.182207 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770fe789-e23a-4ec2-b501-124fdba97fd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:46.184266 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770fe789-e23a-4ec2-b501-124fdba97fd2 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:46.206738 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 905/1812] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:46.213905 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8719f33-650c-4773-a840-6944e199ec42 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:46.213905 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8719f33-650c-4773-a840-6944e199ec42 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:46.213905 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8719f33-650c-4773-a840-6944e199ec42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:46.253584 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 908/1813] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:28:45 2022] POST /identity/v3/users => generated 297 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:28:46.254694 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770fe789-e23a-4ec2-b501-124fdba97fd2 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:46.265298 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-770fe789-e23a-4ec2-b501-124fdba97fd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:46.290147 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-c8719f33-650c-4773-a840-6944e199ec42 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:46.292295 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-c8719f33-650c-4773-a840-6944e199ec42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:46.297479 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770fe789-e23a-4ec2-b501-124fdba97fd2 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:46.326194 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2f407b-03c8-4691-8dad-1631ddfbf951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:46.327395 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f407b-03c8-4691-8dad-1631ddfbf951 admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:46.332517 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f407b-03c8-4691-8dad-1631ddfbf951 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:46.332517 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f407b-03c8-4691-8dad-1631ddfbf951 admin admin] PATH_INFO: `/v3/projects` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:46.332517 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2f407b-03c8-4691-8dad-1631ddfbf951 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:46.332517 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2f407b-03c8-4691-8dad-1631ddfbf951 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:46.347777 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 906/1814] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:46.347777 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8719f33-650c-4773-a840-6944e199ec42 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:46.349789 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-c8719f33-650c-4773-a840-6944e199ec42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:46.368979 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8719f33-650c-4773-a840-6944e199ec42 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:46.376924 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d19f6dd-0536-4240-90ef-d0785283c5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:46.378398 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19f6dd-0536-4240-90ef-d0785283c5ac admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:46.378825 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19f6dd-0536-4240-90ef-d0785283c5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:46.379283 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19f6dd-0536-4240-90ef-d0785283c5ac admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:46.380355 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d19f6dd-0536-4240-90ef-d0785283c5ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:46.396576 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d19f6dd-0536-4240-90ef-d0785283c5ac admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:46.427518 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 907/1815] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:28:46.432902 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d19f6dd-0536-4240-90ef-d0785283c5ac admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:46.435070 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-9d19f6dd-0536-4240-90ef-d0785283c5ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:46.437767 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 909/1816] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:28:46 2022] POST /identity/v3/projects => generated 387 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:28:46.439676 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2f407b-03c8-4691-8dad-1631ddfbf951 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:46.621335 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2f407b-03c8-4691-8dad-1631ddfbf951 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:46.637307 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc1fbe3-22b8-43fa-b6e3-aeaa0a2efeed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:46.641272 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc1fbe3-22b8-43fa-b6e3-aeaa0a2efeed admin admin] REQUEST_METHOD: `PUT` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:46.644144 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc1fbe3-22b8-43fa-b6e3-aeaa0a2efeed admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:46.645500 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc1fbe3-22b8-43fa-b6e3-aeaa0a2efeed admin admin] PATH_INFO: `/v3/projects/a807066f6ef24293b5d3acafe9316209/users/3865f23b628941359db3ed7be1614ea5/roles/36909bbf31d04993bb2a9fe587b572dc` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:46.648687 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d19f6dd-0536-4240-90ef-d0785283c5ac admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:46.693220 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc1fbe3-22b8-43fa-b6e3-aeaa0a2efeed admin admin] RBAC: Authorizing `identity:create_grant(project_id=a807066f6ef24293b5d3acafe9316209, user_id=3865f23b628941359db3ed7be1614ea5, role_id=36909bbf31d04993bb2a9fe587b572dc)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:46.697192 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc1fbe3-22b8-43fa-b6e3-aeaa0a2efeed admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:46.736122 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 910/1817] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:28:46 2022] PUT /identity/v3/projects/a807066f6ef24293b5d3acafe9316209/users/3865f23b628941359db3ed7be1614ea5/roles/36909bbf31d04993bb2a9fe587b572dc => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:28:46.739508 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc1fbe3-22b8-43fa-b6e3-aeaa0a2efeed admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:46.812423 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb66cce-9b8a-4526-8225-ab460efc544a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:46.813029 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb66cce-9b8a-4526-8225-ab460efc544a service neutron] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:46.813398 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb66cce-9b8a-4526-8225-ab460efc544a service neutron] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:46.813677 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb66cce-9b8a-4526-8225-ab460efc544a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:46.847503 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb66cce-9b8a-4526-8225-ab460efc544a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:46.849195 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb66cce-9b8a-4526-8225-ab460efc544a service neutron] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:46.861721 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 908/1818] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:28:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:28:46.863168 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9399c-e83b-4c4e-b5d5-00294d406092 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:46.863457 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9399c-e83b-4c4e-b5d5-00294d406092 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:46.863890 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9399c-e83b-4c4e-b5d5-00294d406092 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:46.867424 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 909/1819] 10.222.0.30 () {54 vars in 921 bytes} [Wed Mar 30 01:28:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:28:46.879194 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a9399c-e83b-4c4e-b5d5-00294d406092 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:46.882089 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc1fbe3-22b8-43fa-b6e3-aeaa0a2efeed admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:46.888264 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1086ad2c-45a5-4c24-bfa5-c5e1b28caf71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:46.889179 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086ad2c-45a5-4c24-bfa5-c5e1b28caf71 admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:46.889621 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086ad2c-45a5-4c24-bfa5-c5e1b28caf71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:46.890170 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086ad2c-45a5-4c24-bfa5-c5e1b28caf71 admin admin] PATH_INFO: `/v3/users` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:46.891066 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1086ad2c-45a5-4c24-bfa5-c5e1b28caf71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:46.893216 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1086ad2c-45a5-4c24-bfa5-c5e1b28caf71 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:46.897103 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a9399c-e83b-4c4e-b5d5-00294d406092 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:46.903579 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a0bab7-7ff8-4392-998c-f4680b8e03e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:46.904782 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0bab7-7ff8-4392-998c-f4680b8e03e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:46.904782 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0bab7-7ff8-4392-998c-f4680b8e03e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:46.905173 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0bab7-7ff8-4392-998c-f4680b8e03e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:46.905901 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a0bab7-7ff8-4392-998c-f4680b8e03e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:46.907936 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a0bab7-7ff8-4392-998c-f4680b8e03e1 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:46.934578 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 910/1820] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:28:46.939172 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 911/1821] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:28:46 2022] POST /identity/v3/users => generated 300 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:28:46.940664 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1086ad2c-45a5-4c24-bfa5-c5e1b28caf71 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:46.940784 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a0bab7-7ff8-4392-998c-f4680b8e03e1 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:46.953193 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a0bab7-7ff8-4392-998c-f4680b8e03e1 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:46.970605 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1086ad2c-45a5-4c24-bfa5-c5e1b28caf71 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:46.973196 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8551ce-a825-4fdd-b944-2afe34484a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:46.974184 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8551ce-a825-4fdd-b944-2afe34484a49 admin admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:46.974395 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8551ce-a825-4fdd-b944-2afe34484a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:46.974673 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8551ce-a825-4fdd-b944-2afe34484a49 admin admin] PATH_INFO: `/v3/projects/a807066f6ef24293b5d3acafe9316209/users/3865f23b628941359db3ed7be1614ea5/roles/36909bbf31d04993bb2a9fe587b572dc` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:46.977025 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8551ce-a825-4fdd-b944-2afe34484a49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a807066f6ef24293b5d3acafe9316209, user_id=3865f23b628941359db3ed7be1614ea5, role_id=36909bbf31d04993bb2a9fe587b572dc)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:46.981691 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8551ce-a825-4fdd-b944-2afe34484a49 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:46.993674 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3532f4d-24d5-481a-b38d-237e24153c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:46.995366 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3532f4d-24d5-481a-b38d-237e24153c97 admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:46.995366 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3532f4d-24d5-481a-b38d-237e24153c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:46.995366 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3532f4d-24d5-481a-b38d-237e24153c97 admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:47.004986 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3532f4d-24d5-481a-b38d-237e24153c97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:47.006640 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3532f4d-24d5-481a-b38d-237e24153c97 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:47.026193 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 911/1822] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:28:46 2022] PUT /identity/v3/projects/a807066f6ef24293b5d3acafe9316209/users/3865f23b628941359db3ed7be1614ea5/roles/36909bbf31d04993bb2a9fe587b572dc => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:28:47.028054 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9a5b51-6bd2-4b14-9e42-5c0fde9044b1 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:47.028352 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9a5b51-6bd2-4b14-9e42-5c0fde9044b1 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:47.028650 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9a5b51-6bd2-4b14-9e42-5c0fde9044b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:47.052866 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 912/1823] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:28:47.052866 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c271c7-8e37-4b05-a1cf-95f2aef32f97 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:47.054472 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-ef9a5b51-6bd2-4b14-9e42-5c0fde9044b1 None None] MFA Rules not processed for user `140c6d1a20e94192bde06e72040f162d`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:47.054593 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c271c7-8e37-4b05-a1cf-95f2aef32f97 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:47.054831 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c271c7-8e37-4b05-a1cf-95f2aef32f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:47.057461 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-ef9a5b51-6bd2-4b14-9e42-5c0fde9044b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:47.148158 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-a1c271c7-8e37-4b05-a1cf-95f2aef32f97 None None] MFA Rules not processed for user `3865f23b628941359db3ed7be1614ea5`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:47.154657 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-a1c271c7-8e37-4b05-a1cf-95f2aef32f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:47.279116 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 912/1824] 10.222.0.30 () {58 vars in 1018 bytes} [Wed Mar 30 01:28:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:47.280519 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9a5b51-6bd2-4b14-9e42-5c0fde9044b1 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:47.287846 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 913/1825] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:47 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:47.301260 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c271c7-8e37-4b05-a1cf-95f2aef32f97 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:47.303297 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-a1c271c7-8e37-4b05-a1cf-95f2aef32f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:47.392437 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c271c7-8e37-4b05-a1cf-95f2aef32f97 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:47.399503 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf8e8a-b9de-4ee1-b37c-2020073b1f0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45219f386f0147b6bd380efe4ab62812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:47.400489 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf8e8a-b9de-4ee1-b37c-2020073b1f0f service cinder] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:47.401616 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf8e8a-b9de-4ee1-b37c-2020073b1f0f service cinder] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:47.402062 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf8e8a-b9de-4ee1-b37c-2020073b1f0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:47.436954 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbf8e8a-b9de-4ee1-b37c-2020073b1f0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:47.440414 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbf8e8a-b9de-4ee1-b37c-2020073b1f0f service cinder] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:47.483883 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 914/1826] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:28:47 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 30 01:28:47.484221 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9a5b51-6bd2-4b14-9e42-5c0fde9044b1 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:47.495205 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da4df23-b304-42af-aa2f-27b2e385c3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:47.496312 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da4df23-b304-42af-aa2f-27b2e385c3c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:47.496689 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da4df23-b304-42af-aa2f-27b2e385c3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:47.497046 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da4df23-b304-42af-aa2f-27b2e385c3c5 admin admin] PATH_INFO: `/v3/projects/8e36d85c36574188badc7fbe896ae7a7/users/60f087748ecb4573bb047566a142aae4/roles/36909bbf31d04993bb2a9fe587b572dc` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:47.525157 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da4df23-b304-42af-aa2f-27b2e385c3c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e36d85c36574188badc7fbe896ae7a7, user_id=60f087748ecb4573bb047566a142aae4, role_id=36909bbf31d04993bb2a9fe587b572dc)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:47.534314 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da4df23-b304-42af-aa2f-27b2e385c3c5 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:47.560319 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 913/1827] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:28:47 2022] PUT /identity/v3/projects/8e36d85c36574188badc7fbe896ae7a7/users/60f087748ecb4573bb047566a142aae4/roles/36909bbf31d04993bb2a9fe587b572dc => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:28:47.564633 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf8e8a-b9de-4ee1-b37c-2020073b1f0f service cinder] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:47.581307 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf8e8a-b9de-4ee1-b37c-2020073b1f0f service cinder] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:47.633120 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da4df23-b304-42af-aa2f-27b2e385c3c5 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:47.689875 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6483ac-0ec5-49a1-b394-8fb55a41b579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:47.690568 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6483ac-0ec5-49a1-b394-8fb55a41b579 admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:47.690889 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6483ac-0ec5-49a1-b394-8fb55a41b579 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:47.691573 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6483ac-0ec5-49a1-b394-8fb55a41b579 admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:47.692337 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6483ac-0ec5-49a1-b394-8fb55a41b579 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:47.695268 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6483ac-0ec5-49a1-b394-8fb55a41b579 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:47.709584 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 915/1828] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:28:47.716068 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6483ac-0ec5-49a1-b394-8fb55a41b579 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:47.732197 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6483ac-0ec5-49a1-b394-8fb55a41b579 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:47.739766 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bc7c8b-f66e-422f-9940-228662b275a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:47.741564 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc7c8b-f66e-422f-9940-228662b275a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:47.742021 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc7c8b-f66e-422f-9940-228662b275a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:47.742399 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc7c8b-f66e-422f-9940-228662b275a3 admin admin] PATH_INFO: `/v3/projects/8e36d85c36574188badc7fbe896ae7a7/users/60f087748ecb4573bb047566a142aae4/roles/36909bbf31d04993bb2a9fe587b572dc` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:47.746415 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bc7c8b-f66e-422f-9940-228662b275a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e36d85c36574188badc7fbe896ae7a7, user_id=60f087748ecb4573bb047566a142aae4, role_id=36909bbf31d04993bb2a9fe587b572dc)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:47.754050 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bc7c8b-f66e-422f-9940-228662b275a3 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:47.754453 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da4df23-b304-42af-aa2f-27b2e385c3c5 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:47.767837 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b173db5-f219-4ed4-8f0f-b49ca91a5ed7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45219f386f0147b6bd380efe4ab62812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:47.768556 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b173db5-f219-4ed4-8f0f-b49ca91a5ed7 service cinder] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:47.769044 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b173db5-f219-4ed4-8f0f-b49ca91a5ed7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:47.769523 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b173db5-f219-4ed4-8f0f-b49ca91a5ed7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:47.781802 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-9b173db5-f219-4ed4-8f0f-b49ca91a5ed7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:47.782788 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 916/1829] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:28:47 2022] PUT /identity/v3/projects/8e36d85c36574188badc7fbe896ae7a7/users/60f087748ecb4573bb047566a142aae4/roles/36909bbf31d04993bb2a9fe587b572dc => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:28:47.786567 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e26c3e0-2b11-4556-9d97-b085a0a69826 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:47.787536 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e26c3e0-2b11-4556-9d97-b085a0a69826 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:47.788339 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e26c3e0-2b11-4556-9d97-b085a0a69826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:47.834540 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-0e26c3e0-2b11-4556-9d97-b085a0a69826 None None] MFA Rules not processed for user `60f087748ecb4573bb047566a142aae4`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:47.836393 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-0e26c3e0-2b11-4556-9d97-b085a0a69826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:47.927348 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b173db5-f219-4ed4-8f0f-b49ca91a5ed7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:47.929221 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b173db5-f219-4ed4-8f0f-b49ca91a5ed7 service cinder] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:47.958931 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 914/1830] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:28:47 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 30 01:28:48.022511 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 917/1831] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:47 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:48.032948 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b173db5-f219-4ed4-8f0f-b49ca91a5ed7 service cinder] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:48.036845 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-9b173db5-f219-4ed4-8f0f-b49ca91a5ed7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:48.083493 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b173db5-f219-4ed4-8f0f-b49ca91a5ed7 service cinder] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:48.267439 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe444cc-8b26-4e39-99a8-58082b7d93d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45219f386f0147b6bd380efe4ab62812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:48.268348 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe444cc-8b26-4e39-99a8-58082b7d93d0 service cinder] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:48.268704 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe444cc-8b26-4e39-99a8-58082b7d93d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:48.268902 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe444cc-8b26-4e39-99a8-58082b7d93d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:48.299587 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe444cc-8b26-4e39-99a8-58082b7d93d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:48.301196 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe444cc-8b26-4e39-99a8-58082b7d93d0 service cinder] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:48.315972 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 915/1832] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:28:48 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:28:48.487717 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e26c3e0-2b11-4556-9d97-b085a0a69826 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:48.585667 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e26c3e0-2b11-4556-9d97-b085a0a69826 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:48.593270 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe444cc-8b26-4e39-99a8-58082b7d93d0 service cinder] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:48.596650 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-3fe444cc-8b26-4e39-99a8-58082b7d93d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:48.600356 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b3a9f-7543-42c5-bf91-c504b3632c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:48.601316 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b3a9f-7543-42c5-bf91-c504b3632c09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:48.601609 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b3a9f-7543-42c5-bf91-c504b3632c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:48.602863 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b3a9f-7543-42c5-bf91-c504b3632c09 admin admin] PATH_INFO: `/v3/users/7a7cdc0661bd422b8672facee3932c32` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:48.604158 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b3a9f-7543-42c5-bf91-c504b3632c09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a7cdc0661bd422b8672facee3932c32)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:48.606115 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b3a9f-7543-42c5-bf91-c504b3632c09 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:48.655116 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe444cc-8b26-4e39-99a8-58082b7d93d0 service cinder] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:48.671683 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace0003-cb84-4e21-a8b1-2c5262b2e57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:48.681061 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace0003-cb84-4e21-a8b1-2c5262b2e57a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:48.681617 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace0003-cb84-4e21-a8b1-2c5262b2e57a admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:48.681967 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace0003-cb84-4e21-a8b1-2c5262b2e57a admin admin] PATH_INFO: `/v3/projects/f1673aa9e58b462f9d7898c0dd221d27` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:48.687254 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ace0003-cb84-4e21-a8b1-2c5262b2e57a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1673aa9e58b462f9d7898c0dd221d27)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:48.689277 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ace0003-cb84-4e21-a8b1-2c5262b2e57a admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:48.710216 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-787b3a9f-7543-42c5-bf91-c504b3632c09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a7cdc0661bd422b8672facee3932c32'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:48.725651 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-787b3a9f-7543-42c5-bf91-c504b3632c09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a7cdc0661bd422b8672facee3932c32'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:48.737534 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-787b3a9f-7543-42c5-bf91-c504b3632c09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a7cdc0661bd422b8672facee3932c32'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:48.739061 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-787b3a9f-7543-42c5-bf91-c504b3632c09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a7cdc0661bd422b8672facee3932c32'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:48.758571 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-787b3a9f-7543-42c5-bf91-c504b3632c09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a7cdc0661bd422b8672facee3932c32'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:48.775499 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 918/1833] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:28:48 2022] DELETE /identity/v3/users/7a7cdc0661bd422b8672facee3932c32 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:28:48.780478 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64602807-697f-44e7-b6ef-6deb9cbae11c None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:48.780966 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64602807-697f-44e7-b6ef-6deb9cbae11c None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:48.781392 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64602807-697f-44e7-b6ef-6deb9cbae11c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:48.792079 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-5ace0003-cb84-4e21-a8b1-2c5262b2e57a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1673aa9e58b462f9d7898c0dd221d27', 'request_id': 'req-5ace0003-cb84-4e21-a8b1-2c5262b2e57a'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:48.804130 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-5ace0003-cb84-4e21-a8b1-2c5262b2e57a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1673aa9e58b462f9d7898c0dd221d27', 'request_id': 'req-5ace0003-cb84-4e21-a8b1-2c5262b2e57a'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:48.816003 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-5ace0003-cb84-4e21-a8b1-2c5262b2e57a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1673aa9e58b462f9d7898c0dd221d27', 'request_id': 'req-5ace0003-cb84-4e21-a8b1-2c5262b2e57a'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:48.823679 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-64602807-697f-44e7-b6ef-6deb9cbae11c None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:48.825111 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-64602807-697f-44e7-b6ef-6deb9cbae11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:48.835987 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-5ace0003-cb84-4e21-a8b1-2c5262b2e57a admin admin] The token cache is being invalidate because project f1673aa9e58b462f9d7898c0dd221d27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:28:48.837763 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-5ace0003-cb84-4e21-a8b1-2c5262b2e57a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:48.838850 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-5ace0003-cb84-4e21-a8b1-2c5262b2e57a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:48.844784 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 916/1834] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:28:48 2022] DELETE /identity/v3/projects/f1673aa9e58b462f9d7898c0dd221d27 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:28:48.847300 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace0003-cb84-4e21-a8b1-2c5262b2e57a admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:48.849808 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-5ace0003-cb84-4e21-a8b1-2c5262b2e57a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:48.938052 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 919/1835] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 01:28:48.938052 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64602807-697f-44e7-b6ef-6deb9cbae11c None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:48.938841 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-64602807-697f-44e7-b6ef-6deb9cbae11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:48.988142 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace0003-cb84-4e21-a8b1-2c5262b2e57a admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:49.009255 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc04049a-e93a-4017-97e6-4fe33ec42ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:49.013051 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04049a-e93a-4017-97e6-4fe33ec42ecf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:49.013354 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04049a-e93a-4017-97e6-4fe33ec42ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:49.013642 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04049a-e93a-4017-97e6-4fe33ec42ecf admin admin] PATH_INFO: `/v3/users/aacffaa21c0549f785e83a7d438377ad` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:49.016969 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc04049a-e93a-4017-97e6-4fe33ec42ecf admin admin] RBAC: Authorizing `identity:delete_user(user_id=aacffaa21c0549f785e83a7d438377ad)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:49.019684 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc04049a-e93a-4017-97e6-4fe33ec42ecf admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:49.102689 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-dc04049a-e93a-4017-97e6-4fe33ec42ecf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aacffaa21c0549f785e83a7d438377ad'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:49.108853 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64602807-697f-44e7-b6ef-6deb9cbae11c None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:49.138601 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92befba8-4987-41fe-ac4a-63d13d554f75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140c6d1a20e94192bde06e72040f162d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:49.139256 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92befba8-4987-41fe-ac4a-63d13d554f75 service nova] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:49.139545 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92befba8-4987-41fe-ac4a-63d13d554f75 service nova] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:49.139822 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92befba8-4987-41fe-ac4a-63d13d554f75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:49.141753 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-92befba8-4987-41fe-ac4a-63d13d554f75 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:49.151537 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-dc04049a-e93a-4017-97e6-4fe33ec42ecf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aacffaa21c0549f785e83a7d438377ad'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:49.152464 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-dc04049a-e93a-4017-97e6-4fe33ec42ecf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aacffaa21c0549f785e83a7d438377ad'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:49.171530 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92befba8-4987-41fe-ac4a-63d13d554f75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:49.174189 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92befba8-4987-41fe-ac4a-63d13d554f75 service nova] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:49.178159 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-dc04049a-e93a-4017-97e6-4fe33ec42ecf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aacffaa21c0549f785e83a7d438377ad'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:49.200292 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 920/1836] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:28:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:28:49.201145 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92befba8-4987-41fe-ac4a-63d13d554f75 service nova] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:49.204529 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-92befba8-4987-41fe-ac4a-63d13d554f75 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:49.253056 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-dc04049a-e93a-4017-97e6-4fe33ec42ecf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aacffaa21c0549f785e83a7d438377ad'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:49.286437 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 917/1837] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:28:48 2022] DELETE /identity/v3/users/aacffaa21c0549f785e83a7d438377ad => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:28:49.289112 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc04049a-e93a-4017-97e6-4fe33ec42ecf admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:49.292445 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-dc04049a-e93a-4017-97e6-4fe33ec42ecf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:49.354575 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92befba8-4987-41fe-ac4a-63d13d554f75 service nova] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:49.439198 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351292e8-2a25-4e0b-bca0-3181ea2eb092 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:49.443968 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351292e8-2a25-4e0b-bca0-3181ea2eb092 service neutron] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:49.445114 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351292e8-2a25-4e0b-bca0-3181ea2eb092 service neutron] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:49.445575 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351292e8-2a25-4e0b-bca0-3181ea2eb092 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:49.452265 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-351292e8-2a25-4e0b-bca0-3181ea2eb092 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:49.516556 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc04049a-e93a-4017-97e6-4fe33ec42ecf admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:49.531647 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d950ac14-938a-4a3f-89e3-f115a07c3887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:49.535170 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950ac14-938a-4a3f-89e3-f115a07c3887 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:49.536889 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950ac14-938a-4a3f-89e3-f115a07c3887 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:49.537351 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950ac14-938a-4a3f-89e3-f115a07c3887 admin admin] PATH_INFO: `/v3/projects/070db20447f14ec1848de1413770c4fa` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:49.540940 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d950ac14-938a-4a3f-89e3-f115a07c3887 admin admin] RBAC: Authorizing `identity:delete_project(project_id=070db20447f14ec1848de1413770c4fa)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:49.547520 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d950ac14-938a-4a3f-89e3-f115a07c3887 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:49.657158 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351292e8-2a25-4e0b-bca0-3181ea2eb092 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:49.660174 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351292e8-2a25-4e0b-bca0-3181ea2eb092 service neutron] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:49.687512 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 921/1838] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:28:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:28:49.697557 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-d950ac14-938a-4a3f-89e3-f115a07c3887 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '070db20447f14ec1848de1413770c4fa', 'request_id': 'req-d950ac14-938a-4a3f-89e3-f115a07c3887'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:49.703944 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-d950ac14-938a-4a3f-89e3-f115a07c3887 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '070db20447f14ec1848de1413770c4fa', 'request_id': 'req-d950ac14-938a-4a3f-89e3-f115a07c3887'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:49.715916 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-d950ac14-938a-4a3f-89e3-f115a07c3887 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '070db20447f14ec1848de1413770c4fa', 'request_id': 'req-d950ac14-938a-4a3f-89e3-f115a07c3887'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:49.744892 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-d950ac14-938a-4a3f-89e3-f115a07c3887 admin admin] The token cache is being invalidate because project 070db20447f14ec1848de1413770c4fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:28:49.745450 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-d950ac14-938a-4a3f-89e3-f115a07c3887 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:49.746348 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-d950ac14-938a-4a3f-89e3-f115a07c3887 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:49.748723 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 918/1839] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:28:49 2022] DELETE /identity/v3/projects/070db20447f14ec1848de1413770c4fa => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:28:49.752696 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351292e8-2a25-4e0b-bca0-3181ea2eb092 service neutron] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:49.782150 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351292e8-2a25-4e0b-bca0-3181ea2eb092 service neutron] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:49.977717 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce58eb-00e1-4544-870d-5c9eb6f65004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:49.984077 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce58eb-00e1-4544-870d-5c9eb6f65004 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:49.984745 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce58eb-00e1-4544-870d-5c9eb6f65004 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:49.986737 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce58eb-00e1-4544-870d-5c9eb6f65004 admin admin] PATH_INFO: `/v3/users/ff2ea9e83cbe49b9b233302b0d632ad1` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:49.988902 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ce58eb-00e1-4544-870d-5c9eb6f65004 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff2ea9e83cbe49b9b233302b0d632ad1)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:49.992795 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ce58eb-00e1-4544-870d-5c9eb6f65004 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:50.120215 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-27ce58eb-00e1-4544-870d-5c9eb6f65004 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff2ea9e83cbe49b9b233302b0d632ad1'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:50.171707 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-27ce58eb-00e1-4544-870d-5c9eb6f65004 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff2ea9e83cbe49b9b233302b0d632ad1'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:50.183048 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-27ce58eb-00e1-4544-870d-5c9eb6f65004 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff2ea9e83cbe49b9b233302b0d632ad1'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:50.183768 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-27ce58eb-00e1-4544-870d-5c9eb6f65004 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff2ea9e83cbe49b9b233302b0d632ad1'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:50.197258 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-27ce58eb-00e1-4544-870d-5c9eb6f65004 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff2ea9e83cbe49b9b233302b0d632ad1'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:50.208254 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 922/1840] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:28:49 2022] DELETE /identity/v3/users/ff2ea9e83cbe49b9b233302b0d632ad1 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:28:50.338530 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d950ac14-938a-4a3f-89e3-f115a07c3887 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:50.340203 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-d950ac14-938a-4a3f-89e3-f115a07c3887 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:50.355382 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d950ac14-938a-4a3f-89e3-f115a07c3887 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:50.444655 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890441e2-cbdb-4cef-a03e-da749a595e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:50.446782 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890441e2-cbdb-4cef-a03e-da749a595e9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:50.447446 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890441e2-cbdb-4cef-a03e-da749a595e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:50.447922 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890441e2-cbdb-4cef-a03e-da749a595e9b admin admin] PATH_INFO: `/v3/projects/5a562283ee49408ca56b007907636134` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:50.449711 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890441e2-cbdb-4cef-a03e-da749a595e9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a562283ee49408ca56b007907636134)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:50.452060 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890441e2-cbdb-4cef-a03e-da749a595e9b admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:50.491660 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7047421-779d-4e5c-8fa6-80d5b37edeaa None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:50.491830 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7047421-779d-4e5c-8fa6-80d5b37edeaa None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:50.492322 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7047421-779d-4e5c-8fa6-80d5b37edeaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:50.531406 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-f7047421-779d-4e5c-8fa6-80d5b37edeaa None None] MFA Rules not processed for user `b5e24981873246ea9df9d121c8dc22a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:50.534389 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-f7047421-779d-4e5c-8fa6-80d5b37edeaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:50.570893 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-890441e2-cbdb-4cef-a03e-da749a595e9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a562283ee49408ca56b007907636134', 'request_id': 'req-890441e2-cbdb-4cef-a03e-da749a595e9b'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:50.583142 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-890441e2-cbdb-4cef-a03e-da749a595e9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a562283ee49408ca56b007907636134', 'request_id': 'req-890441e2-cbdb-4cef-a03e-da749a595e9b'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:50.610822 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-890441e2-cbdb-4cef-a03e-da749a595e9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a562283ee49408ca56b007907636134', 'request_id': 'req-890441e2-cbdb-4cef-a03e-da749a595e9b'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:50.636793 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-890441e2-cbdb-4cef-a03e-da749a595e9b admin admin] The token cache is being invalidate because project 5a562283ee49408ca56b007907636134 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:28:50.638593 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-890441e2-cbdb-4cef-a03e-da749a595e9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:50.639570 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-890441e2-cbdb-4cef-a03e-da749a595e9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:50.644619 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 923/1841] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:50.647019 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 919/1842] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:28:50 2022] DELETE /identity/v3/projects/5a562283ee49408ca56b007907636134 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:28:50.657545 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f52cf0-43c8-459a-be6a-7c1d47ab6f74 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:50.658518 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f52cf0-43c8-459a-be6a-7c1d47ab6f74 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:50.659664 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f52cf0-43c8-459a-be6a-7c1d47ab6f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:50.687120 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-04f52cf0-43c8-459a-be6a-7c1d47ab6f74 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:50.688525 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-04f52cf0-43c8-459a-be6a-7c1d47ab6f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:50.803646 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 924/1843] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:50.812447 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04107ab6-725f-4afd-8e8f-be6c227e0052 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:50.812760 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04107ab6-725f-4afd-8e8f-be6c227e0052 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:50.813866 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04107ab6-725f-4afd-8e8f-be6c227e0052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:50.836487 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-04107ab6-725f-4afd-8e8f-be6c227e0052 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:50.846869 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-04107ab6-725f-4afd-8e8f-be6c227e0052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:50.859421 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 920/1844] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 01:28:50.865762 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f52cf0-43c8-459a-be6a-7c1d47ab6f74 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:50.886476 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f52cf0-43c8-459a-be6a-7c1d47ab6f74 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:50.897233 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c34afd2-9e4b-4c91-b508-79973b1ee314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:50.897233 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34afd2-9e4b-4c91-b508-79973b1ee314 admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:50.897233 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34afd2-9e4b-4c91-b508-79973b1ee314 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:50.897233 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34afd2-9e4b-4c91-b508-79973b1ee314 admin admin] PATH_INFO: `/v3/domains` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:50.897512 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c34afd2-9e4b-4c91-b508-79973b1ee314 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:28:50.897512 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c34afd2-9e4b-4c91-b508-79973b1ee314 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:50.899072 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04107ab6-725f-4afd-8e8f-be6c227e0052 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:50.899806 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c34afd2-9e4b-4c91-b508-79973b1ee314 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:50.901422 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-04107ab6-725f-4afd-8e8f-be6c227e0052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:50.921230 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 925/1845] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Mar 30 01:28:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:28:50.922728 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c34afd2-9e4b-4c91-b508-79973b1ee314 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:50.932411 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04107ab6-725f-4afd-8e8f-be6c227e0052 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:50.939107 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9746b85e-201e-45ae-b2d7-77c08ff25612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:50.940270 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746b85e-201e-45ae-b2d7-77c08ff25612 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:50.940778 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746b85e-201e-45ae-b2d7-77c08ff25612 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:50.941244 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746b85e-201e-45ae-b2d7-77c08ff25612 admin admin] PATH_INFO: `/v3/projects/32525a4885e349f7b99d4ad28c17b892` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:50.941344 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c34afd2-9e4b-4c91-b508-79973b1ee314 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:50.943803 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9746b85e-201e-45ae-b2d7-77c08ff25612 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32525a4885e349f7b99d4ad28c17b892)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:50.948606 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9746b85e-201e-45ae-b2d7-77c08ff25612 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:50.954279 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c1e83-d870-4d25-9055-68efa56a4c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:50.956924 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c1e83-d870-4d25-9055-68efa56a4c93 admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:50.957787 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c1e83-d870-4d25-9055-68efa56a4c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:50.960113 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c1e83-d870-4d25-9055-68efa56a4c93 admin admin] PATH_INFO: `/v3/projects` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:50.960984 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257c1e83-d870-4d25-9055-68efa56a4c93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:50.966808 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257c1e83-d870-4d25-9055-68efa56a4c93 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:51.026971 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 926/1846] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:28:50 2022] POST /identity/v3/projects => generated 381 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:28:51.026971 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c1e83-d870-4d25-9055-68efa56a4c93 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:51.047085 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-257c1e83-d870-4d25-9055-68efa56a4c93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:51.072809 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-9746b85e-201e-45ae-b2d7-77c08ff25612 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32525a4885e349f7b99d4ad28c17b892', 'request_id': 'req-9746b85e-201e-45ae-b2d7-77c08ff25612'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:51.080083 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-9746b85e-201e-45ae-b2d7-77c08ff25612 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32525a4885e349f7b99d4ad28c17b892', 'request_id': 'req-9746b85e-201e-45ae-b2d7-77c08ff25612'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:51.089245 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-9746b85e-201e-45ae-b2d7-77c08ff25612 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32525a4885e349f7b99d4ad28c17b892', 'request_id': 'req-9746b85e-201e-45ae-b2d7-77c08ff25612'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:51.107676 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-9746b85e-201e-45ae-b2d7-77c08ff25612 admin admin] The token cache is being invalidate because project 32525a4885e349f7b99d4ad28c17b892 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:28:51.108013 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-9746b85e-201e-45ae-b2d7-77c08ff25612 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:51.108778 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-9746b85e-201e-45ae-b2d7-77c08ff25612 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:51.113759 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 921/1847] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:28:50 2022] DELETE /identity/v3/projects/32525a4885e349f7b99d4ad28c17b892 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:28:51.113759 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9746b85e-201e-45ae-b2d7-77c08ff25612 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:51.113759 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-9746b85e-201e-45ae-b2d7-77c08ff25612 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:51.145707 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c1e83-d870-4d25-9055-68efa56a4c93 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:51.209650 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9746b85e-201e-45ae-b2d7-77c08ff25612 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:51.217962 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38538cac-385a-4115-88cf-34ce2bf1d8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:51.218574 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38538cac-385a-4115-88cf-34ce2bf1d8ae admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:51.218977 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38538cac-385a-4115-88cf-34ce2bf1d8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:51.219254 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38538cac-385a-4115-88cf-34ce2bf1d8ae admin admin] PATH_INFO: `/v3/users` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:51.220545 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38538cac-385a-4115-88cf-34ce2bf1d8ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:51.222128 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f947630-d54f-4dc1-9c39-94676d360027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:51.223146 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f947630-d54f-4dc1-9c39-94676d360027 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:51.223347 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38538cac-385a-4115-88cf-34ce2bf1d8ae admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:51.223496 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f947630-d54f-4dc1-9c39-94676d360027 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:51.223895 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f947630-d54f-4dc1-9c39-94676d360027 admin admin] PATH_INFO: `/v3/projects/7889c89608644401a56e169daf69d5c3` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:51.225332 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f947630-d54f-4dc1-9c39-94676d360027 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7889c89608644401a56e169daf69d5c3)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:51.228098 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f947630-d54f-4dc1-9c39-94676d360027 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:51.250814 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 922/1848] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:28:51 2022] POST /identity/v3/users => generated 291 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:28:51.252232 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f63a66-6adb-4442-98ee-33980a2789dd None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:51.252531 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f63a66-6adb-4442-98ee-33980a2789dd None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:51.252813 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f63a66-6adb-4442-98ee-33980a2789dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:51.287661 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-12f63a66-6adb-4442-98ee-33980a2789dd None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:51.289095 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-12f63a66-6adb-4442-98ee-33980a2789dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:51.322341 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-6f947630-d54f-4dc1-9c39-94676d360027 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7889c89608644401a56e169daf69d5c3', 'request_id': 'req-6f947630-d54f-4dc1-9c39-94676d360027'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:51.344086 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-6f947630-d54f-4dc1-9c39-94676d360027 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7889c89608644401a56e169daf69d5c3', 'request_id': 'req-6f947630-d54f-4dc1-9c39-94676d360027'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:51.352899 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-6f947630-d54f-4dc1-9c39-94676d360027 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7889c89608644401a56e169daf69d5c3', 'request_id': 'req-6f947630-d54f-4dc1-9c39-94676d360027'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:51.369965 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-6f947630-d54f-4dc1-9c39-94676d360027 admin admin] The token cache is being invalidate because project 7889c89608644401a56e169daf69d5c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:28:51.370285 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-6f947630-d54f-4dc1-9c39-94676d360027 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:51.370990 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-6f947630-d54f-4dc1-9c39-94676d360027 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:51.373132 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 927/1849] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:28:51 2022] DELETE /identity/v3/projects/7889c89608644401a56e169daf69d5c3 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:28:51.376272 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f947630-d54f-4dc1-9c39-94676d360027 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:51.376272 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-6f947630-d54f-4dc1-9c39-94676d360027 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:51.394345 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 923/1850] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:51.396050 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f63a66-6adb-4442-98ee-33980a2789dd None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:51.397698 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-12f63a66-6adb-4442-98ee-33980a2789dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:51.427231 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f947630-d54f-4dc1-9c39-94676d360027 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:51.432382 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f63a66-6adb-4442-98ee-33980a2789dd None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:51.441072 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e306a5d9-2eb3-4b20-8bac-d86d54ecb98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:51.441743 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e306a5d9-2eb3-4b20-8bac-d86d54ecb98b admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:51.442038 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e306a5d9-2eb3-4b20-8bac-d86d54ecb98b admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:51.442316 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e306a5d9-2eb3-4b20-8bac-d86d54ecb98b admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:51.443085 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e306a5d9-2eb3-4b20-8bac-d86d54ecb98b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:51.445157 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f113cc-4c72-4ec6-a704-a70f1969f4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:51.448256 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f113cc-4c72-4ec6-a704-a70f1969f4a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:51.448865 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e306a5d9-2eb3-4b20-8bac-d86d54ecb98b admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:51.449268 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f113cc-4c72-4ec6-a704-a70f1969f4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:51.449675 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f113cc-4c72-4ec6-a704-a70f1969f4a0 admin admin] PATH_INFO: `/v3/users/60f087748ecb4573bb047566a142aae4` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:51.453242 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f113cc-4c72-4ec6-a704-a70f1969f4a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60f087748ecb4573bb047566a142aae4)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:51.459249 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f113cc-4c72-4ec6-a704-a70f1969f4a0 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:51.479731 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 928/1851] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:28:51 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:28:51.481187 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7e0d3-8e80-4eed-9adc-948317c1e536 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:51.481479 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7e0d3-8e80-4eed-9adc-948317c1e536 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:51.481775 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7e0d3-8e80-4eed-9adc-948317c1e536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:51.526216 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-a1f7e0d3-8e80-4eed-9adc-948317c1e536 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:51.528351 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-a1f7e0d3-8e80-4eed-9adc-948317c1e536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:51.550933 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 929/1852] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:51.553789 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f7e0d3-8e80-4eed-9adc-948317c1e536 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:51.578116 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f7e0d3-8e80-4eed-9adc-948317c1e536 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:51.592222 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dc40d7-64b1-461b-9f7d-7ba5b345e8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:51.592968 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dc40d7-64b1-461b-9f7d-7ba5b345e8a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:51.593245 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dc40d7-64b1-461b-9f7d-7ba5b345e8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:51.593521 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dc40d7-64b1-461b-9f7d-7ba5b345e8a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:51.594251 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dc40d7-64b1-461b-9f7d-7ba5b345e8a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:51.595933 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dc40d7-64b1-461b-9f7d-7ba5b345e8a9 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:51.600420 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-f9f113cc-4c72-4ec6-a704-a70f1969f4a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60f087748ecb4573bb047566a142aae4'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:51.607485 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 930/1853] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:28:51 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:28:51.608638 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dc40d7-64b1-461b-9f7d-7ba5b345e8a9 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:51.624596 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-f9f113cc-4c72-4ec6-a704-a70f1969f4a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60f087748ecb4573bb047566a142aae4'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:51.625589 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-f9f113cc-4c72-4ec6-a704-a70f1969f4a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60f087748ecb4573bb047566a142aae4'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:51.627362 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dc40d7-64b1-461b-9f7d-7ba5b345e8a9 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:51.633492 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2709e6e6-1036-49f7-a959-2f04eba158f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:51.634471 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2709e6e6-1036-49f7-a959-2f04eba158f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:51.635076 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2709e6e6-1036-49f7-a959-2f04eba158f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:51.635419 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2709e6e6-1036-49f7-a959-2f04eba158f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:51.636158 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2709e6e6-1036-49f7-a959-2f04eba158f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:28:51.636642 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2709e6e6-1036-49f7-a959-2f04eba158f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:51.637641 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-f9f113cc-4c72-4ec6-a704-a70f1969f4a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60f087748ecb4573bb047566a142aae4'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:51.638478 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2709e6e6-1036-49f7-a959-2f04eba158f2 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:51.662507 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-f9f113cc-4c72-4ec6-a704-a70f1969f4a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60f087748ecb4573bb047566a142aae4'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:51.669534 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 924/1854] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:28:51 2022] DELETE /identity/v3/users/60f087748ecb4573bb047566a142aae4 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:28:51.670643 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f113cc-4c72-4ec6-a704-a70f1969f4a0 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:51.677085 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 931/1855] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Mar 30 01:28:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:28:51.686506 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-f9f113cc-4c72-4ec6-a704-a70f1969f4a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:51.693956 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2709e6e6-1036-49f7-a959-2f04eba158f2 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:51.700393 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-2709e6e6-1036-49f7-a959-2f04eba158f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:51.725446 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2709e6e6-1036-49f7-a959-2f04eba158f2 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:51.820909 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f113cc-4c72-4ec6-a704-a70f1969f4a0 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:51.830198 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4327a59f-1c71-4051-aada-6e4ed75026e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:51.831374 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4327a59f-1c71-4051-aada-6e4ed75026e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:51.831660 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4327a59f-1c71-4051-aada-6e4ed75026e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:51.832111 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4327a59f-1c71-4051-aada-6e4ed75026e1 admin admin] PATH_INFO: `/v3/projects/755855ebad014a72bb1f56205a7a7a06/users/ce70fc19fdf1402da4370c4b979b7d7c/roles/7185d0cfbcd44502b1613bcfe1b42f6f` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:51.856457 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4327a59f-1c71-4051-aada-6e4ed75026e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=755855ebad014a72bb1f56205a7a7a06, user_id=ce70fc19fdf1402da4370c4b979b7d7c, role_id=7185d0cfbcd44502b1613bcfe1b42f6f)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:51.858900 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f0bdec-16f1-4fdc-afa9-6e7c11c05e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:51.859621 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f0bdec-16f1-4fdc-afa9-6e7c11c05e4a admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:51.859853 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4327a59f-1c71-4051-aada-6e4ed75026e1 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:51.859954 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f0bdec-16f1-4fdc-afa9-6e7c11c05e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:51.860169 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f0bdec-16f1-4fdc-afa9-6e7c11c05e4a admin admin] PATH_INFO: `/v3/projects` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:51.863567 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f0bdec-16f1-4fdc-afa9-6e7c11c05e4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:51.870356 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f0bdec-16f1-4fdc-afa9-6e7c11c05e4a admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:51.899066 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 925/1856] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:28:51 2022] PUT /identity/v3/projects/755855ebad014a72bb1f56205a7a7a06/users/ce70fc19fdf1402da4370c4b979b7d7c/roles/7185d0cfbcd44502b1613bcfe1b42f6f => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:28:51.926767 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72b2f8-e87b-4b6f-9b56-5f74a4488f5e None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:51.927327 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72b2f8-e87b-4b6f-9b56-5f74a4488f5e None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:51.927451 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72b2f8-e87b-4b6f-9b56-5f74a4488f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:51.966134 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 932/1857] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:28:51 2022] POST /identity/v3/projects => generated 387 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:28:51.969923 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f0bdec-16f1-4fdc-afa9-6e7c11c05e4a admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:51.991391 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-5f72b2f8-e87b-4b6f-9b56-5f74a4488f5e None None] MFA Rules not processed for user `ce70fc19fdf1402da4370c4b979b7d7c`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:51.994859 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-5f72b2f8-e87b-4b6f-9b56-5f74a4488f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:52.096709 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f0bdec-16f1-4fdc-afa9-6e7c11c05e4a admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:52.111110 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627327b-7e6a-4a02-b74a-952c5a5eef38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:52.112817 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627327b-7e6a-4a02-b74a-952c5a5eef38 admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:52.113372 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627327b-7e6a-4a02-b74a-952c5a5eef38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:52.114774 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627327b-7e6a-4a02-b74a-952c5a5eef38 admin admin] PATH_INFO: `/v3/users` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:52.115916 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5627327b-7e6a-4a02-b74a-952c5a5eef38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:52.120831 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5627327b-7e6a-4a02-b74a-952c5a5eef38 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:52.148927 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 926/1858] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:52.154682 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f72b2f8-e87b-4b6f-9b56-5f74a4488f5e None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:52.160877 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 933/1859] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:28:51 2022] POST /identity/v3/users => generated 294 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 01:28:52.165972 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627327b-7e6a-4a02-b74a-952c5a5eef38 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:52.166839 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f72b2f8-e87b-4b6f-9b56-5f74a4488f5e None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:52.178319 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f6108f-1b6d-49c4-a18b-9c342d450b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:52.179343 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6108f-1b6d-49c4-a18b-9c342d450b13 admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:52.183411 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6108f-1b6d-49c4-a18b-9c342d450b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:52.184013 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6108f-1b6d-49c4-a18b-9c342d450b13 admin admin] PATH_INFO: `/v3/projects` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:52.184999 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f6108f-1b6d-49c4-a18b-9c342d450b13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:52.188894 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f6108f-1b6d-49c4-a18b-9c342d450b13 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:52.192774 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627327b-7e6a-4a02-b74a-952c5a5eef38 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:52.199138 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdbde27-cdb0-4efd-b484-56cccb27fae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:52.200372 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdbde27-cdb0-4efd-b484-56cccb27fae0 admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:52.200698 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdbde27-cdb0-4efd-b484-56cccb27fae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:52.200929 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdbde27-cdb0-4efd-b484-56cccb27fae0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:52.201663 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdbde27-cdb0-4efd-b484-56cccb27fae0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:52.203957 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdbde27-cdb0-4efd-b484-56cccb27fae0 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:52.224308 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 934/1860] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:28:52 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:28:52.229029 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdbde27-cdb0-4efd-b484-56cccb27fae0 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:52.244539 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 927/1861] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:28:52 2022] POST /identity/v3/projects => generated 383 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:28:52.246495 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f6108f-1b6d-49c4-a18b-9c342d450b13 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:52.254907 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdbde27-cdb0-4efd-b484-56cccb27fae0 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:52.353189 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c006d-092d-4b76-94c9-e3f0df1d4c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:52.354171 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c006d-092d-4b76-94c9-e3f0df1d4c66 admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:52.354801 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c006d-092d-4b76-94c9-e3f0df1d4c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:52.355218 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c006d-092d-4b76-94c9-e3f0df1d4c66 admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:52.356106 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92c006d-092d-4b76-94c9-e3f0df1d4c66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:52.362018 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92c006d-092d-4b76-94c9-e3f0df1d4c66 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:52.372109 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f6108f-1b6d-49c4-a18b-9c342d450b13 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:52.379291 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f11db3-15f7-4a91-adf6-c65c2bd44474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:52.380192 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f11db3-15f7-4a91-adf6-c65c2bd44474 admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:52.381524 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f11db3-15f7-4a91-adf6-c65c2bd44474 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:52.382174 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f11db3-15f7-4a91-adf6-c65c2bd44474 admin admin] PATH_INFO: `/v3/users` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:52.383517 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f11db3-15f7-4a91-adf6-c65c2bd44474 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:52.388306 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 935/1862] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:28:52 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:28:52.393483 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c006d-092d-4b76-94c9-e3f0df1d4c66 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:52.393782 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f11db3-15f7-4a91-adf6-c65c2bd44474 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:52.418362 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c006d-092d-4b76-94c9-e3f0df1d4c66 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:52.425240 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f507e59a-cffb-475c-a94f-ea3d593c382b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:52.427227 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507e59a-cffb-475c-a94f-ea3d593c382b admin admin] REQUEST_METHOD: `PUT` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:52.427695 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507e59a-cffb-475c-a94f-ea3d593c382b admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:52.428111 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507e59a-cffb-475c-a94f-ea3d593c382b admin admin] PATH_INFO: `/v3/projects/f116c84766be4935821f54f373eda267/users/2b9c53e51a9a41e99b1613a79de0849c/roles/7185d0cfbcd44502b1613bcfe1b42f6f` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:52.440231 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 928/1863] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:28:52 2022] POST /identity/v3/users => generated 298 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:28:52.440231 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f11db3-15f7-4a91-adf6-c65c2bd44474 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:52.441554 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-d9f11db3-15f7-4a91-adf6-c65c2bd44474 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:52.450166 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f507e59a-cffb-475c-a94f-ea3d593c382b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f116c84766be4935821f54f373eda267, user_id=2b9c53e51a9a41e99b1613a79de0849c, role_id=7185d0cfbcd44502b1613bcfe1b42f6f)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:52.469291 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f11db3-15f7-4a91-adf6-c65c2bd44474 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:52.471392 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f507e59a-cffb-475c-a94f-ea3d593c382b admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:52.476355 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef04b74-a081-4e3a-9c44-60a3354b800b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:52.478644 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef04b74-a081-4e3a-9c44-60a3354b800b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:52.479186 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef04b74-a081-4e3a-9c44-60a3354b800b admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:52.479472 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef04b74-a081-4e3a-9c44-60a3354b800b admin admin] PATH_INFO: `/v3/projects/8e36d85c36574188badc7fbe896ae7a7` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:52.480743 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef04b74-a081-4e3a-9c44-60a3354b800b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e36d85c36574188badc7fbe896ae7a7)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:52.483926 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef04b74-a081-4e3a-9c44-60a3354b800b admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:52.494661 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 936/1864] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:28:52 2022] PUT /identity/v3/projects/f116c84766be4935821f54f373eda267/users/2b9c53e51a9a41e99b1613a79de0849c/roles/7185d0cfbcd44502b1613bcfe1b42f6f => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:28:52.496109 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f507e59a-cffb-475c-a94f-ea3d593c382b admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:52.544708 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-7ef04b74-a081-4e3a-9c44-60a3354b800b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e36d85c36574188badc7fbe896ae7a7', 'request_id': 'req-7ef04b74-a081-4e3a-9c44-60a3354b800b'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:52.550130 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-7ef04b74-a081-4e3a-9c44-60a3354b800b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e36d85c36574188badc7fbe896ae7a7', 'request_id': 'req-7ef04b74-a081-4e3a-9c44-60a3354b800b'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:52.559094 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-7ef04b74-a081-4e3a-9c44-60a3354b800b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e36d85c36574188badc7fbe896ae7a7', 'request_id': 'req-7ef04b74-a081-4e3a-9c44-60a3354b800b'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:52.573441 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-7ef04b74-a081-4e3a-9c44-60a3354b800b admin admin] The token cache is being invalidate because project 8e36d85c36574188badc7fbe896ae7a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:28:52.573773 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-7ef04b74-a081-4e3a-9c44-60a3354b800b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:52.574483 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-7ef04b74-a081-4e3a-9c44-60a3354b800b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:52.575944 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f507e59a-cffb-475c-a94f-ea3d593c382b admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:52.576426 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 929/1865] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:28:52 2022] DELETE /identity/v3/projects/8e36d85c36574188badc7fbe896ae7a7 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:28:52.578038 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e4501-afe7-41cb-b741-a1aa1e0c139e None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:52.578374 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e4501-afe7-41cb-b741-a1aa1e0c139e None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:52.578712 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e4501-afe7-41cb-b741-a1aa1e0c139e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:52.607138 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-169e4501-afe7-41cb-b741-a1aa1e0c139e None None] MFA Rules not processed for user `2b9c53e51a9a41e99b1613a79de0849c`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:52.608960 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-169e4501-afe7-41cb-b741-a1aa1e0c139e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:52.635810 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d014e9f1-80bd-4d44-8842-47aac6ab20da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:52.636445 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d014e9f1-80bd-4d44-8842-47aac6ab20da admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:52.636733 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d014e9f1-80bd-4d44-8842-47aac6ab20da admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:52.637020 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d014e9f1-80bd-4d44-8842-47aac6ab20da admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:52.637749 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d014e9f1-80bd-4d44-8842-47aac6ab20da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:52.639416 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d014e9f1-80bd-4d44-8842-47aac6ab20da admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:52.649037 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 937/1866] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:28:52 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:28:52.654829 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f58819-b51e-4e38-8afd-0165ec8e824f None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:52.654829 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f58819-b51e-4e38-8afd-0165ec8e824f None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:52.654829 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f58819-b51e-4e38-8afd-0165ec8e824f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:52.670676 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-69f58819-b51e-4e38-8afd-0165ec8e824f None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:52.671910 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-69f58819-b51e-4e38-8afd-0165ec8e824f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:52.677820 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 930/1867] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:52.678635 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169e4501-afe7-41cb-b741-a1aa1e0c139e None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:52.679892 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-169e4501-afe7-41cb-b741-a1aa1e0c139e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:52.684119 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 938/1868] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:52.685003 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f58819-b51e-4e38-8afd-0165ec8e824f None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:52.686234 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-69f58819-b51e-4e38-8afd-0165ec8e824f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:52.694124 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169e4501-afe7-41cb-b741-a1aa1e0c139e None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:52.700614 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f58819-b51e-4e38-8afd-0165ec8e824f None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:52.701495 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bad395-6bec-408f-8d46-8fc69e332472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:52.702554 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bad395-6bec-408f-8d46-8fc69e332472 admin admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:52.702997 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bad395-6bec-408f-8d46-8fc69e332472 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:52.703366 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bad395-6bec-408f-8d46-8fc69e332472 admin admin] PATH_INFO: `/v3/projects/e231be7faf6d44ee9abc73d817ce1c5f/users/6e7406a6fdcf47a48c8384e87ccc97d7/roles/36909bbf31d04993bb2a9fe587b572dc` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:52.705879 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a74bcb-3527-494b-bf95-4f6808d79b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:52.706220 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a74bcb-3527-494b-bf95-4f6808d79b70 admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:52.706509 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a74bcb-3527-494b-bf95-4f6808d79b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:52.706939 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a74bcb-3527-494b-bf95-4f6808d79b70 admin admin] PATH_INFO: `/v3/projects` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:52.707638 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a74bcb-3527-494b-bf95-4f6808d79b70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:52.710110 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a74bcb-3527-494b-bf95-4f6808d79b70 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:52.721050 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bad395-6bec-408f-8d46-8fc69e332472 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e231be7faf6d44ee9abc73d817ce1c5f, user_id=6e7406a6fdcf47a48c8384e87ccc97d7, role_id=36909bbf31d04993bb2a9fe587b572dc)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:52.723887 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bad395-6bec-408f-8d46-8fc69e332472 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:52.752737 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 931/1869] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:28:52 2022] PUT /identity/v3/projects/e231be7faf6d44ee9abc73d817ce1c5f/users/6e7406a6fdcf47a48c8384e87ccc97d7/roles/36909bbf31d04993bb2a9fe587b572dc => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:28:52.752737 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678eb09-5bdb-4db6-b045-f98a46188fa0 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:52.752737 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678eb09-5bdb-4db6-b045-f98a46188fa0 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:52.752737 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678eb09-5bdb-4db6-b045-f98a46188fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:52.766146 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 939/1870] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:28:52 2022] POST /identity/v3/projects => generated 385 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:28:52.767527 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a74bcb-3527-494b-bf95-4f6808d79b70 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:52.775073 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-a678eb09-5bdb-4db6-b045-f98a46188fa0 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:52.776398 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-a678eb09-5bdb-4db6-b045-f98a46188fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:52.833318 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a74bcb-3527-494b-bf95-4f6808d79b70 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:52.839288 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7bbb5a-8785-45c0-a1ee-febe69121237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:52.839962 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7bbb5a-8785-45c0-a1ee-febe69121237 admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:52.840248 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7bbb5a-8785-45c0-a1ee-febe69121237 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:52.840525 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7bbb5a-8785-45c0-a1ee-febe69121237 admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:52.841257 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7bbb5a-8785-45c0-a1ee-febe69121237 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:52.842878 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7bbb5a-8785-45c0-a1ee-febe69121237 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:52.843277 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 932/1871] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:52.844150 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a678eb09-5bdb-4db6-b045-f98a46188fa0 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:52.856279 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 940/1872] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:28:52 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:28:52.856429 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a678eb09-5bdb-4db6-b045-f98a46188fa0 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:52.856505 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7bbb5a-8785-45c0-a1ee-febe69121237 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:52.858180 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb668ed-efc0-46da-9545-202265375c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:52.858877 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb668ed-efc0-46da-9545-202265375c0a admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:52.859161 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb668ed-efc0-46da-9545-202265375c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:52.859439 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb668ed-efc0-46da-9545-202265375c0a admin admin] PATH_INFO: `/v3/users` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:52.860120 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb668ed-efc0-46da-9545-202265375c0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:52.862027 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb668ed-efc0-46da-9545-202265375c0a admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:52.863549 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7bbb5a-8785-45c0-a1ee-febe69121237 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:52.868771 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5790616e-61f4-43f3-92d1-b924eed074bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:52.869628 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5790616e-61f4-43f3-92d1-b924eed074bb admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:52.869911 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5790616e-61f4-43f3-92d1-b924eed074bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:52.870417 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5790616e-61f4-43f3-92d1-b924eed074bb admin admin] PATH_INFO: `/v3/domains` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:52.870932 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5790616e-61f4-43f3-92d1-b924eed074bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:28:52.871266 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5790616e-61f4-43f3-92d1-b924eed074bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:52.872816 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5790616e-61f4-43f3-92d1-b924eed074bb admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:52.882306 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 933/1873] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:28:52 2022] POST /identity/v3/users => generated 293 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:28:52.883067 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb668ed-efc0-46da-9545-202265375c0a admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:52.887187 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 941/1874] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Mar 30 01:28:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:28:52.887881 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5790616e-61f4-43f3-92d1-b924eed074bb admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:52.895714 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb668ed-efc0-46da-9545-202265375c0a admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:52.897108 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5790616e-61f4-43f3-92d1-b924eed074bb admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:52.901310 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d14af8e-90af-4db0-a6fb-a0004ba6fecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:52.902204 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d14af8e-90af-4db0-a6fb-a0004ba6fecb admin admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:52.902485 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d14af8e-90af-4db0-a6fb-a0004ba6fecb admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:52.902793 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d14af8e-90af-4db0-a6fb-a0004ba6fecb admin admin] PATH_INFO: `/v3/projects/e231be7faf6d44ee9abc73d817ce1c5f/users/6e7406a6fdcf47a48c8384e87ccc97d7/roles/36909bbf31d04993bb2a9fe587b572dc` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:52.903485 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6584469-d2a8-419c-a079-d0d77a3edbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:52.904273 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6584469-d2a8-419c-a079-d0d77a3edbe3 admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:52.904630 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6584469-d2a8-419c-a079-d0d77a3edbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:52.904797 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d14af8e-90af-4db0-a6fb-a0004ba6fecb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e231be7faf6d44ee9abc73d817ce1c5f, user_id=6e7406a6fdcf47a48c8384e87ccc97d7, role_id=36909bbf31d04993bb2a9fe587b572dc)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:52.905022 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6584469-d2a8-419c-a079-d0d77a3edbe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:52.905818 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6584469-d2a8-419c-a079-d0d77a3edbe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:52.907802 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6584469-d2a8-419c-a079-d0d77a3edbe3 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:52.908060 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d14af8e-90af-4db0-a6fb-a0004ba6fecb admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:52.919205 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 942/1875] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:28:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:28:52.919925 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6584469-d2a8-419c-a079-d0d77a3edbe3 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:52.920370 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 934/1876] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:28:52 2022] PUT /identity/v3/projects/e231be7faf6d44ee9abc73d817ce1c5f/users/6e7406a6fdcf47a48c8384e87ccc97d7/roles/36909bbf31d04993bb2a9fe587b572dc => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:28:52.929380 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d14af8e-90af-4db0-a6fb-a0004ba6fecb admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:52.932495 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6584469-d2a8-419c-a079-d0d77a3edbe3 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:52.991820 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b5a90e-a726-4c5f-98df-59fd50a86b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:52.992497 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5a90e-a726-4c5f-98df-59fd50a86b83 admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:52.992782 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5a90e-a726-4c5f-98df-59fd50a86b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:52.993590 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5a90e-a726-4c5f-98df-59fd50a86b83 admin admin] PATH_INFO: `/v3/projects` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:52.994290 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b5a90e-a726-4c5f-98df-59fd50a86b83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:52.996259 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b5a90e-a726-4c5f-98df-59fd50a86b83 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:53.000313 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d14af8e-90af-4db0-a6fb-a0004ba6fecb admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:53.007131 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95bc7fb-1918-4699-8077-6dba790e752d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:53.007952 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95bc7fb-1918-4699-8077-6dba790e752d admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:53.008373 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95bc7fb-1918-4699-8077-6dba790e752d admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:53.008965 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95bc7fb-1918-4699-8077-6dba790e752d admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:53.009840 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95bc7fb-1918-4699-8077-6dba790e752d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:53.011843 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95bc7fb-1918-4699-8077-6dba790e752d admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:53.026667 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 935/1877] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:28:52 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:28:53.026667 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b878371-cbbc-4e4a-a859-b7ccc9237405 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:53.026667 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b878371-cbbc-4e4a-a859-b7ccc9237405 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:53.026667 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b878371-cbbc-4e4a-a859-b7ccc9237405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:53.034141 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 943/1878] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:28:52 2022] POST /identity/v3/projects => generated 371 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:28:53.038714 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b5a90e-a726-4c5f-98df-59fd50a86b83 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:53.053207 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-9b878371-cbbc-4e4a-a859-b7ccc9237405 None None] MFA Rules not processed for user `6e7406a6fdcf47a48c8384e87ccc97d7`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:53.054429 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-9b878371-cbbc-4e4a-a859-b7ccc9237405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:53.102992 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b5a90e-a726-4c5f-98df-59fd50a86b83 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:53.107790 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb0d6f-de02-4e76-be53-4e257e08caef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:53.108685 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb0d6f-de02-4e76-be53-4e257e08caef admin admin] REQUEST_METHOD: `PUT` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:53.108965 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb0d6f-de02-4e76-be53-4e257e08caef admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:53.109238 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb0d6f-de02-4e76-be53-4e257e08caef admin admin] PATH_INFO: `/v3/projects/827d6fe8cf0d4b24aa42d44ee2697ba1/users/ff5264e889644e26b18a648995e48264/roles/7185d0cfbcd44502b1613bcfe1b42f6f` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:53.123994 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeb0d6f-de02-4e76-be53-4e257e08caef admin admin] RBAC: Authorizing `identity:create_grant(project_id=827d6fe8cf0d4b24aa42d44ee2697ba1, user_id=ff5264e889644e26b18a648995e48264, role_id=7185d0cfbcd44502b1613bcfe1b42f6f)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:53.125704 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 936/1879] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:53 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:53.126668 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b878371-cbbc-4e4a-a859-b7ccc9237405 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:53.127006 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeb0d6f-de02-4e76-be53-4e257e08caef admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:53.138628 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b878371-cbbc-4e4a-a859-b7ccc9237405 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:53.142090 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 944/1880] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:28:53 2022] PUT /identity/v3/projects/827d6fe8cf0d4b24aa42d44ee2697ba1/users/ff5264e889644e26b18a648995e48264/roles/7185d0cfbcd44502b1613bcfe1b42f6f => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:28:53.152296 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb0d6f-de02-4e76-be53-4e257e08caef admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:53.152296 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-ebeb0d6f-de02-4e76-be53-4e257e08caef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:53.196685 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aa931b-0b70-48fc-99cb-dd25b39a64d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:53.197828 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa931b-0b70-48fc-99cb-dd25b39a64d3 admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:53.198324 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa931b-0b70-48fc-99cb-dd25b39a64d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:53.198773 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa931b-0b70-48fc-99cb-dd25b39a64d3 admin admin] PATH_INFO: `/v3/users` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:53.199894 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aa931b-0b70-48fc-99cb-dd25b39a64d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:53.201801 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aa931b-0b70-48fc-99cb-dd25b39a64d3 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:53.207061 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb0d6f-de02-4e76-be53-4e257e08caef admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:53.211010 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2576d77f-01f4-42de-96f3-1d6ec545220a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45219f386f0147b6bd380efe4ab62812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:53.211797 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2576d77f-01f4-42de-96f3-1d6ec545220a service cinder] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:53.212138 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2576d77f-01f4-42de-96f3-1d6ec545220a service cinder] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:53.212353 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2576d77f-01f4-42de-96f3-1d6ec545220a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:53.229007 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 937/1881] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:28:53 2022] POST /identity/v3/users => generated 286 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:28:53.229007 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84662923-375d-42f1-8ba7-bd0489dc56e5 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:53.229007 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84662923-375d-42f1-8ba7-bd0489dc56e5 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:53.229007 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84662923-375d-42f1-8ba7-bd0489dc56e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:53.257049 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-84662923-375d-42f1-8ba7-bd0489dc56e5 None None] MFA Rules not processed for user `ff5264e889644e26b18a648995e48264`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:53.258276 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-84662923-375d-42f1-8ba7-bd0489dc56e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:53.290301 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2576d77f-01f4-42de-96f3-1d6ec545220a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:53.291941 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2576d77f-01f4-42de-96f3-1d6ec545220a service cinder] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:53.301735 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 945/1882] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:28:53 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:28:53.302559 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2576d77f-01f4-42de-96f3-1d6ec545220a service cinder] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:53.312559 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2576d77f-01f4-42de-96f3-1d6ec545220a service cinder] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:53.318152 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1618449c-fe48-4794-841c-a9e11ca6e2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:53.318856 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1618449c-fe48-4794-841c-a9e11ca6e2d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:53.319141 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1618449c-fe48-4794-841c-a9e11ca6e2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:53.319416 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1618449c-fe48-4794-841c-a9e11ca6e2d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:53.320141 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1618449c-fe48-4794-841c-a9e11ca6e2d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:53.322950 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1618449c-fe48-4794-841c-a9e11ca6e2d7 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:53.337688 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 946/1883] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:28:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:28:53.338924 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1618449c-fe48-4794-841c-a9e11ca6e2d7 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:53.342841 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 938/1884] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:53.346904 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84662923-375d-42f1-8ba7-bd0489dc56e5 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:53.349735 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1618449c-fe48-4794-841c-a9e11ca6e2d7 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:53.355844 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f86898d-4c09-42f1-b9ec-90ba496adfab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:53.356518 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f86898d-4c09-42f1-b9ec-90ba496adfab admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:53.356804 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f86898d-4c09-42f1-b9ec-90ba496adfab admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:53.357083 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f86898d-4c09-42f1-b9ec-90ba496adfab admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:53.357979 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f86898d-4c09-42f1-b9ec-90ba496adfab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:53.359901 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f86898d-4c09-42f1-b9ec-90ba496adfab admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:53.370895 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84662923-375d-42f1-8ba7-bd0489dc56e5 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:53.374669 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 947/1885] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:28:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:28:53.375559 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f86898d-4c09-42f1-b9ec-90ba496adfab admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:53.377278 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae1979f-4549-4eef-8b1e-11769123b113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:53.378116 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae1979f-4549-4eef-8b1e-11769123b113 admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:53.378548 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae1979f-4549-4eef-8b1e-11769123b113 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:53.378996 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae1979f-4549-4eef-8b1e-11769123b113 admin admin] PATH_INFO: `/v3/projects` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:53.379836 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae1979f-4549-4eef-8b1e-11769123b113 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:53.381931 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae1979f-4549-4eef-8b1e-11769123b113 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:53.390403 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f86898d-4c09-42f1-b9ec-90ba496adfab admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:53.395594 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361d98a-a7e6-498e-a910-8fada8077b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:53.396482 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361d98a-a7e6-498e-a910-8fada8077b4d admin admin] REQUEST_METHOD: `PUT` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:53.396763 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361d98a-a7e6-498e-a910-8fada8077b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:53.397039 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361d98a-a7e6-498e-a910-8fada8077b4d admin admin] PATH_INFO: `/v3/projects/b00d263070eb4c0fb3e061e848cc3988/users/574059a5681a4b5fb94b96d225008207/roles/7185d0cfbcd44502b1613bcfe1b42f6f` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:53.413566 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 939/1886] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:28:53 2022] POST /identity/v3/projects => generated 385 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 01:28:53.414617 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae1979f-4549-4eef-8b1e-11769123b113 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:53.419447 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f361d98a-a7e6-498e-a910-8fada8077b4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b00d263070eb4c0fb3e061e848cc3988, user_id=574059a5681a4b5fb94b96d225008207, role_id=7185d0cfbcd44502b1613bcfe1b42f6f)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:53.421702 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f361d98a-a7e6-498e-a910-8fada8077b4d admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:53.436932 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 948/1887] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:28:53 2022] PUT /identity/v3/projects/b00d263070eb4c0fb3e061e848cc3988/users/574059a5681a4b5fb94b96d225008207/roles/7185d0cfbcd44502b1613bcfe1b42f6f => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:28:53.437829 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361d98a-a7e6-498e-a910-8fada8077b4d admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:53.472972 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae1979f-4549-4eef-8b1e-11769123b113 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:53.500499 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361d98a-a7e6-498e-a910-8fada8077b4d admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:53.505461 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30406b0-1831-47bd-8123-0c58b3744bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:53.506200 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30406b0-1831-47bd-8123-0c58b3744bb7 admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:53.506487 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30406b0-1831-47bd-8123-0c58b3744bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:53.506796 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30406b0-1831-47bd-8123-0c58b3744bb7 admin admin] PATH_INFO: `/v3/users` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:53.507486 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30406b0-1831-47bd-8123-0c58b3744bb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:53.510286 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30406b0-1831-47bd-8123-0c58b3744bb7 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:53.526961 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9fe214-fca9-459a-b88e-960a586b690b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45219f386f0147b6bd380efe4ab62812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:53.527710 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9fe214-fca9-459a-b88e-960a586b690b service cinder] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:53.528133 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9fe214-fca9-459a-b88e-960a586b690b service cinder] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:53.528414 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9fe214-fca9-459a-b88e-960a586b690b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:53.530309 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-fe9fe214-fca9-459a-b88e-960a586b690b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:53.539081 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 949/1888] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:28:53 2022] POST /identity/v3/users => generated 299 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:28:53.539081 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe8238a-48b2-457b-84c3-1efbc179f55b None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:53.539081 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe8238a-48b2-457b-84c3-1efbc179f55b None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:53.539081 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe8238a-48b2-457b-84c3-1efbc179f55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:53.557307 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-9fe8238a-48b2-457b-84c3-1efbc179f55b None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:53.558947 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-9fe8238a-48b2-457b-84c3-1efbc179f55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:53.575895 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 950/1889] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:53.575895 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe8238a-48b2-457b-84c3-1efbc179f55b None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:53.583754 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe8238a-48b2-457b-84c3-1efbc179f55b None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:53.588856 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3363b353-2171-4db3-908f-21bd979f2eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:53.589521 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363b353-2171-4db3-908f-21bd979f2eb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:53.589805 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363b353-2171-4db3-908f-21bd979f2eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:53.590083 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363b353-2171-4db3-908f-21bd979f2eb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:53.590846 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3363b353-2171-4db3-908f-21bd979f2eb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:53.592435 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3363b353-2171-4db3-908f-21bd979f2eb7 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:53.595900 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9fe214-fca9-459a-b88e-960a586b690b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:53.597340 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9fe214-fca9-459a-b88e-960a586b690b service cinder] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:53.606003 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 951/1890] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:28:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:28:53.606003 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3363b353-2171-4db3-908f-21bd979f2eb7 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:53.606003 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-3363b353-2171-4db3-908f-21bd979f2eb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:53.610280 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 940/1891] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:28:53 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:28:53.611118 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9fe214-fca9-459a-b88e-960a586b690b service cinder] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:53.624380 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9fe214-fca9-459a-b88e-960a586b690b service cinder] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:53.630204 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c559c8-f08c-41ff-bf22-23e69bf3814b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:53.631320 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c559c8-f08c-41ff-bf22-23e69bf3814b admin admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:53.631640 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c559c8-f08c-41ff-bf22-23e69bf3814b admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:53.632016 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c559c8-f08c-41ff-bf22-23e69bf3814b admin admin] PATH_INFO: `/v3/projects/bf473cada8d64e8c869fdbc62ee9a44c/users/dabc93992fdf4fd79ebcd7219e1cd517/roles/36909bbf31d04993bb2a9fe587b572dc` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:53.650982 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c559c8-f08c-41ff-bf22-23e69bf3814b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf473cada8d64e8c869fdbc62ee9a44c, user_id=dabc93992fdf4fd79ebcd7219e1cd517, role_id=36909bbf31d04993bb2a9fe587b572dc)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:53.653695 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c559c8-f08c-41ff-bf22-23e69bf3814b admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:53.671891 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 941/1892] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:28:53 2022] PUT /identity/v3/projects/bf473cada8d64e8c869fdbc62ee9a44c/users/dabc93992fdf4fd79ebcd7219e1cd517/roles/36909bbf31d04993bb2a9fe587b572dc => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:28:53.675713 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c559c8-f08c-41ff-bf22-23e69bf3814b admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:53.686412 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3363b353-2171-4db3-908f-21bd979f2eb7 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:53.746054 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c559c8-f08c-41ff-bf22-23e69bf3814b admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:53.748589 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10782773-8978-47c5-bc7b-0ff51be1d5b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:53.749383 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10782773-8978-47c5-bc7b-0ff51be1d5b8 service neutron] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:53.749572 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10782773-8978-47c5-bc7b-0ff51be1d5b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:53.749934 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10782773-8978-47c5-bc7b-0ff51be1d5b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:53.751279 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f51202-cfa3-40cb-9c61-c1699211469c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:53.751944 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f51202-cfa3-40cb-9c61-c1699211469c admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:53.752231 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f51202-cfa3-40cb-9c61-c1699211469c admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:53.752511 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f51202-cfa3-40cb-9c61-c1699211469c admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:53.756610 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f51202-cfa3-40cb-9c61-c1699211469c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:53.756610 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f51202-cfa3-40cb-9c61-c1699211469c admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:53.760979 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10782773-8978-47c5-bc7b-0ff51be1d5b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:53.762093 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10782773-8978-47c5-bc7b-0ff51be1d5b8 service neutron] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:53.766833 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 942/1893] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:28:53 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 01:28:53.770663 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f51202-cfa3-40cb-9c61-c1699211469c admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:53.775829 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 952/1894] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:28:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:28:53.781614 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f51202-cfa3-40cb-9c61-c1699211469c admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:53.791547 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d518cc-7217-44db-850e-15e1bc1a9110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:53.792478 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d518cc-7217-44db-850e-15e1bc1a9110 admin admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:53.792768 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d518cc-7217-44db-850e-15e1bc1a9110 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:53.793047 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d518cc-7217-44db-850e-15e1bc1a9110 admin admin] PATH_INFO: `/v3/projects/bf473cada8d64e8c869fdbc62ee9a44c/users/dabc93992fdf4fd79ebcd7219e1cd517/roles/36909bbf31d04993bb2a9fe587b572dc` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:53.795411 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d518cc-7217-44db-850e-15e1bc1a9110 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf473cada8d64e8c869fdbc62ee9a44c, user_id=dabc93992fdf4fd79ebcd7219e1cd517, role_id=36909bbf31d04993bb2a9fe587b572dc)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:53.798474 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d518cc-7217-44db-850e-15e1bc1a9110 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:53.818809 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 943/1895] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:28:53 2022] PUT /identity/v3/projects/bf473cada8d64e8c869fdbc62ee9a44c/users/dabc93992fdf4fd79ebcd7219e1cd517/roles/36909bbf31d04993bb2a9fe587b572dc => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:28:53.822961 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a53f3b-be5f-448a-a33d-96845c66d89a None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:53.823256 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a53f3b-be5f-448a-a33d-96845c66d89a None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:53.823537 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a53f3b-be5f-448a-a33d-96845c66d89a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:53.864093 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-78a53f3b-be5f-448a-a33d-96845c66d89a None None] MFA Rules not processed for user `dabc93992fdf4fd79ebcd7219e1cd517`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:53.865790 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-78a53f3b-be5f-448a-a33d-96845c66d89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:53.965914 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 953/1896] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:53 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:53.979149 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d518cc-7217-44db-850e-15e1bc1a9110 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:53.979918 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a53f3b-be5f-448a-a33d-96845c66d89a None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:54.046004 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d518cc-7217-44db-850e-15e1bc1a9110 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:54.049710 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4c0398-3569-4d37-86f6-172912cfd1cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45219f386f0147b6bd380efe4ab62812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:54.050371 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c0398-3569-4d37-86f6-172912cfd1cf service cinder] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:54.050645 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c0398-3569-4d37-86f6-172912cfd1cf service cinder] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:54.050955 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c0398-3569-4d37-86f6-172912cfd1cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:54.057310 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a53f3b-be5f-448a-a33d-96845c66d89a None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:54.061525 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4c0398-3569-4d37-86f6-172912cfd1cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:54.063041 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4c0398-3569-4d37-86f6-172912cfd1cf service cinder] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:54.063176 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2749904-e6e8-401a-a17f-1f306e396748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:54.064087 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2749904-e6e8-401a-a17f-1f306e396748 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:54.064948 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2749904-e6e8-401a-a17f-1f306e396748 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:54.065235 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2749904-e6e8-401a-a17f-1f306e396748 admin admin] PATH_INFO: `/v3/users/ce70fc19fdf1402da4370c4b979b7d7c` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:54.067252 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2749904-e6e8-401a-a17f-1f306e396748 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce70fc19fdf1402da4370c4b979b7d7c)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:54.069522 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2749904-e6e8-401a-a17f-1f306e396748 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:54.077417 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 944/1897] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:28:53 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:28:54.136128 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-f2749904-e6e8-401a-a17f-1f306e396748 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce70fc19fdf1402da4370c4b979b7d7c'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:54.155679 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-f2749904-e6e8-401a-a17f-1f306e396748 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce70fc19fdf1402da4370c4b979b7d7c'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:54.167348 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-f2749904-e6e8-401a-a17f-1f306e396748 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce70fc19fdf1402da4370c4b979b7d7c'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:54.169915 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-f2749904-e6e8-401a-a17f-1f306e396748 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce70fc19fdf1402da4370c4b979b7d7c'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:54.180129 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-f2749904-e6e8-401a-a17f-1f306e396748 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce70fc19fdf1402da4370c4b979b7d7c'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:54.187863 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 954/1898] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:28:53 2022] DELETE /identity/v3/users/ce70fc19fdf1402da4370c4b979b7d7c => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:28:54.192891 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8fb420-0a2c-4b0b-aad0-2c916f56aac4 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:54.193194 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8fb420-0a2c-4b0b-aad0-2c916f56aac4 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:54.193494 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8fb420-0a2c-4b0b-aad0-2c916f56aac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:54.223313 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-5e8fb420-0a2c-4b0b-aad0-2c916f56aac4 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:54.224552 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-5e8fb420-0a2c-4b0b-aad0-2c916f56aac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:54.330038 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 945/1899] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:54.346868 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2749904-e6e8-401a-a17f-1f306e396748 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:54.348821 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-f2749904-e6e8-401a-a17f-1f306e396748 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:54.420345 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2749904-e6e8-401a-a17f-1f306e396748 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:54.425087 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae7ab4-c148-42b2-bc4d-5a597e228a2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:54.425959 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae7ab4-c148-42b2-bc4d-5a597e228a2c service neutron] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:54.426245 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae7ab4-c148-42b2-bc4d-5a597e228a2c service neutron] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:54.426521 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae7ab4-c148-42b2-bc4d-5a597e228a2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:54.457824 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faae7ab4-c148-42b2-bc4d-5a597e228a2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:54.459303 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faae7ab4-c148-42b2-bc4d-5a597e228a2c service neutron] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:54.504964 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 955/1900] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:28:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:28:54.932042 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8fb420-0a2c-4b0b-aad0-2c916f56aac4 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:54.934502 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-5e8fb420-0a2c-4b0b-aad0-2c916f56aac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:55.050264 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8fb420-0a2c-4b0b-aad0-2c916f56aac4 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:55.061105 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0005c85-e27c-4033-96cd-2dcb64830bfc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45219f386f0147b6bd380efe4ab62812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:55.061928 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0005c85-e27c-4033-96cd-2dcb64830bfc service cinder] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:55.062207 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0005c85-e27c-4033-96cd-2dcb64830bfc service cinder] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:55.062456 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0005c85-e27c-4033-96cd-2dcb64830bfc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:55.076324 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-f0005c85-e27c-4033-96cd-2dcb64830bfc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:55.113124 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae7ab4-c148-42b2-bc4d-5a597e228a2c service neutron] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:55.114932 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-faae7ab4-c148-42b2-bc4d-5a597e228a2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:55.143078 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae7ab4-c148-42b2-bc4d-5a597e228a2c service neutron] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:55.169506 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfde246-d9a4-4d38-8fd0-efb8fae96f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:55.170396 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfde246-d9a4-4d38-8fd0-efb8fae96f7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:55.170673 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfde246-d9a4-4d38-8fd0-efb8fae96f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:55.170974 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfde246-d9a4-4d38-8fd0-efb8fae96f7c admin admin] PATH_INFO: `/v3/projects/755855ebad014a72bb1f56205a7a7a06` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:55.175200 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfde246-d9a4-4d38-8fd0-efb8fae96f7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=755855ebad014a72bb1f56205a7a7a06)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:55.178351 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfde246-d9a4-4d38-8fd0-efb8fae96f7c admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:55.249224 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0005c85-e27c-4033-96cd-2dcb64830bfc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:55.251568 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0005c85-e27c-4033-96cd-2dcb64830bfc service cinder] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:55.299393 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 946/1901] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:28:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:28:55.311823 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-8bfde246-d9a4-4d38-8fd0-efb8fae96f7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '755855ebad014a72bb1f56205a7a7a06', 'request_id': 'req-8bfde246-d9a4-4d38-8fd0-efb8fae96f7c'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:55.333832 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-8bfde246-d9a4-4d38-8fd0-efb8fae96f7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '755855ebad014a72bb1f56205a7a7a06', 'request_id': 'req-8bfde246-d9a4-4d38-8fd0-efb8fae96f7c'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:55.358369 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-8bfde246-d9a4-4d38-8fd0-efb8fae96f7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '755855ebad014a72bb1f56205a7a7a06', 'request_id': 'req-8bfde246-d9a4-4d38-8fd0-efb8fae96f7c'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:55.408405 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-8bfde246-d9a4-4d38-8fd0-efb8fae96f7c admin admin] The token cache is being invalidate because project 755855ebad014a72bb1f56205a7a7a06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:28:55.408710 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-8bfde246-d9a4-4d38-8fd0-efb8fae96f7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:55.416794 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-8bfde246-d9a4-4d38-8fd0-efb8fae96f7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:55.427694 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 956/1902] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:28:55 2022] DELETE /identity/v3/projects/755855ebad014a72bb1f56205a7a7a06 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:28:55.432579 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0005c85-e27c-4033-96cd-2dcb64830bfc service cinder] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:55.450046 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0005c85-e27c-4033-96cd-2dcb64830bfc service cinder] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:55.516337 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01380375-5773-4e59-9f98-3e79dabf9462 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:55.516742 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01380375-5773-4e59-9f98-3e79dabf9462 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:55.517103 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01380375-5773-4e59-9f98-3e79dabf9462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:55.569789 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-01380375-5773-4e59-9f98-3e79dabf9462 None None] MFA Rules not processed for user `574059a5681a4b5fb94b96d225008207`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:55.577978 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-01380375-5773-4e59-9f98-3e79dabf9462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:55.581368 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3374c96-27e7-4a7e-92ea-6a601b327035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:55.584405 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3374c96-27e7-4a7e-92ea-6a601b327035 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:55.584688 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3374c96-27e7-4a7e-92ea-6a601b327035 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:55.585233 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3374c96-27e7-4a7e-92ea-6a601b327035 admin admin] PATH_INFO: `/v3/users/6e7406a6fdcf47a48c8384e87ccc97d7` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:55.590258 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3374c96-27e7-4a7e-92ea-6a601b327035 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e7406a6fdcf47a48c8384e87ccc97d7)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:55.592248 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3374c96-27e7-4a7e-92ea-6a601b327035 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:55.714048 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-d3374c96-27e7-4a7e-92ea-6a601b327035 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e7406a6fdcf47a48c8384e87ccc97d7'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:55.731315 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-d3374c96-27e7-4a7e-92ea-6a601b327035 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e7406a6fdcf47a48c8384e87ccc97d7'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:55.733118 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-d3374c96-27e7-4a7e-92ea-6a601b327035 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e7406a6fdcf47a48c8384e87ccc97d7'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:55.757447 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-d3374c96-27e7-4a7e-92ea-6a601b327035 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e7406a6fdcf47a48c8384e87ccc97d7'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:55.796875 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-d3374c96-27e7-4a7e-92ea-6a601b327035 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e7406a6fdcf47a48c8384e87ccc97d7'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:55.800752 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 957/1903] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:55.802558 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01380375-5773-4e59-9f98-3e79dabf9462 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:55.805785 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-01380375-5773-4e59-9f98-3e79dabf9462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:55.811376 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 947/1904] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:28:55 2022] DELETE /identity/v3/users/6e7406a6fdcf47a48c8384e87ccc97d7 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:28:55.836450 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01380375-5773-4e59-9f98-3e79dabf9462 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:56.031579 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848182af-284f-4e27-b728-a2687777753b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:56.032540 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848182af-284f-4e27-b728-a2687777753b admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:56.032815 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848182af-284f-4e27-b728-a2687777753b admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:56.033090 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848182af-284f-4e27-b728-a2687777753b admin admin] PATH_INFO: `/v3/projects` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:56.033789 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848182af-284f-4e27-b728-a2687777753b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:56.035745 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848182af-284f-4e27-b728-a2687777753b admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:56.091980 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 958/1905] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:28:55 2022] POST /identity/v3/projects => generated 373 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:28:56.092822 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3374c96-27e7-4a7e-92ea-6a601b327035 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:56.111375 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3374c96-27e7-4a7e-92ea-6a601b327035 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:56.275927 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bfaa3c-70fb-4e18-b6dd-4aa0be868f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:56.276687 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bfaa3c-70fb-4e18-b6dd-4aa0be868f51 admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:56.277044 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bfaa3c-70fb-4e18-b6dd-4aa0be868f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:56.277396 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bfaa3c-70fb-4e18-b6dd-4aa0be868f51 admin admin] PATH_INFO: `/v3/users` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:56.278488 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bfaa3c-70fb-4e18-b6dd-4aa0be868f51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:56.280488 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bfaa3c-70fb-4e18-b6dd-4aa0be868f51 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:56.320436 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 948/1906] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:28:56 2022] POST /identity/v3/users => generated 293 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 01:28:56.325022 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848182af-284f-4e27-b728-a2687777753b admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:56.354631 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848182af-284f-4e27-b728-a2687777753b admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:56.364991 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff25423f-c753-47dc-893b-c54e659e2a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:56.366467 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff25423f-c753-47dc-893b-c54e659e2a10 admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:56.367074 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff25423f-c753-47dc-893b-c54e659e2a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:56.367522 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff25423f-c753-47dc-893b-c54e659e2a10 admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:56.369412 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff25423f-c753-47dc-893b-c54e659e2a10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:56.371926 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff25423f-c753-47dc-893b-c54e659e2a10 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:56.391165 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 959/1907] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:28:56 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:28:56.391946 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bfaa3c-70fb-4e18-b6dd-4aa0be868f51 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:56.404967 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bfaa3c-70fb-4e18-b6dd-4aa0be868f51 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:56.419551 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1f9c30-6c42-4266-952f-7a91c668c645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:56.420772 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1f9c30-6c42-4266-952f-7a91c668c645 admin admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:56.421175 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1f9c30-6c42-4266-952f-7a91c668c645 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:56.421518 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1f9c30-6c42-4266-952f-7a91c668c645 admin admin] PATH_INFO: `/v3/projects/236b655f2d6b4792980739e2293b0b66/users/917680493385420e815b5f0eb346c9ad/roles/36909bbf31d04993bb2a9fe587b572dc` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:56.452457 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1f9c30-6c42-4266-952f-7a91c668c645 admin admin] RBAC: Authorizing `identity:create_grant(project_id=236b655f2d6b4792980739e2293b0b66, user_id=917680493385420e815b5f0eb346c9ad, role_id=36909bbf31d04993bb2a9fe587b572dc)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:56.455353 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1f9c30-6c42-4266-952f-7a91c668c645 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:56.474770 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 949/1908] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:28:56 2022] PUT /identity/v3/projects/236b655f2d6b4792980739e2293b0b66/users/917680493385420e815b5f0eb346c9ad/roles/36909bbf31d04993bb2a9fe587b572dc => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:28:56.478017 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff25423f-c753-47dc-893b-c54e659e2a10 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:56.490533 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff25423f-c753-47dc-893b-c54e659e2a10 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:56.564805 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4d7717-9a5f-4342-bd16-2c09dd3df4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:56.566140 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d7717-9a5f-4342-bd16-2c09dd3df4e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:56.566512 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d7717-9a5f-4342-bd16-2c09dd3df4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:56.566889 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d7717-9a5f-4342-bd16-2c09dd3df4e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:56.567972 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4d7717-9a5f-4342-bd16-2c09dd3df4e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:56.572207 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4d7717-9a5f-4342-bd16-2c09dd3df4e7 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:56.595440 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1f9c30-6c42-4266-952f-7a91c668c645 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:56.597943 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 960/1909] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:28:56 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:28:56.610841 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1f9c30-6c42-4266-952f-7a91c668c645 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:56.617059 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b10f35-c4d1-4248-a96e-302a5b068c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:56.618663 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b10f35-c4d1-4248-a96e-302a5b068c28 admin admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:56.619053 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b10f35-c4d1-4248-a96e-302a5b068c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:56.619596 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b10f35-c4d1-4248-a96e-302a5b068c28 admin admin] PATH_INFO: `/v3/projects/236b655f2d6b4792980739e2293b0b66/users/917680493385420e815b5f0eb346c9ad/roles/36909bbf31d04993bb2a9fe587b572dc` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:56.622071 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b10f35-c4d1-4248-a96e-302a5b068c28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=236b655f2d6b4792980739e2293b0b66, user_id=917680493385420e815b5f0eb346c9ad, role_id=36909bbf31d04993bb2a9fe587b572dc)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:56.625104 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b10f35-c4d1-4248-a96e-302a5b068c28 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:56.641682 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 950/1910] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:28:56 2022] PUT /identity/v3/projects/236b655f2d6b4792980739e2293b0b66/users/917680493385420e815b5f0eb346c9ad/roles/36909bbf31d04993bb2a9fe587b572dc => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:28:57.035033 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4d7717-9a5f-4342-bd16-2c09dd3df4e7 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:57.037503 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-9c4d7717-9a5f-4342-bd16-2c09dd3df4e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:57.056483 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4d7717-9a5f-4342-bd16-2c09dd3df4e7 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:57.203081 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ae65a7-22e2-4a92-b574-c074db5e90b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:57.203982 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae65a7-22e2-4a92-b574-c074db5e90b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:57.204260 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae65a7-22e2-4a92-b574-c074db5e90b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:57.204543 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae65a7-22e2-4a92-b574-c074db5e90b9 admin admin] PATH_INFO: `/v3/projects/e231be7faf6d44ee9abc73d817ce1c5f` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:57.205776 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ae65a7-22e2-4a92-b574-c074db5e90b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e231be7faf6d44ee9abc73d817ce1c5f)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:57.208113 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ae65a7-22e2-4a92-b574-c074db5e90b9 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:57.294759 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-20ae65a7-22e2-4a92-b574-c074db5e90b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e231be7faf6d44ee9abc73d817ce1c5f', 'request_id': 'req-20ae65a7-22e2-4a92-b574-c074db5e90b9'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:57.304980 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-20ae65a7-22e2-4a92-b574-c074db5e90b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e231be7faf6d44ee9abc73d817ce1c5f', 'request_id': 'req-20ae65a7-22e2-4a92-b574-c074db5e90b9'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:57.314938 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-20ae65a7-22e2-4a92-b574-c074db5e90b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e231be7faf6d44ee9abc73d817ce1c5f', 'request_id': 'req-20ae65a7-22e2-4a92-b574-c074db5e90b9'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:57.328815 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-20ae65a7-22e2-4a92-b574-c074db5e90b9 admin admin] The token cache is being invalidate because project e231be7faf6d44ee9abc73d817ce1c5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:28:57.329427 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-20ae65a7-22e2-4a92-b574-c074db5e90b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:57.329976 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-20ae65a7-22e2-4a92-b574-c074db5e90b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:57.335043 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 961/1911] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:28:57 2022] DELETE /identity/v3/projects/e231be7faf6d44ee9abc73d817ce1c5f => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:28:57.343346 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58260a47-8356-43f7-ac07-151ebc1765d9 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:57.344243 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58260a47-8356-43f7-ac07-151ebc1765d9 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:57.344690 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58260a47-8356-43f7-ac07-151ebc1765d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:57.383356 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-58260a47-8356-43f7-ac07-151ebc1765d9 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:57.385527 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-58260a47-8356-43f7-ac07-151ebc1765d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:57.463728 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 951/1912] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:57.472796 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a653430b-c922-401f-aadf-e18dea0538e4 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:57.473049 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a653430b-c922-401f-aadf-e18dea0538e4 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:57.473251 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a653430b-c922-401f-aadf-e18dea0538e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:57.528567 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-a653430b-c922-401f-aadf-e18dea0538e4 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:57.529929 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-a653430b-c922-401f-aadf-e18dea0538e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:57.544641 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 962/1913] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:57.549220 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58260a47-8356-43f7-ac07-151ebc1765d9 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:57.559868 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58260a47-8356-43f7-ac07-151ebc1765d9 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:57.567097 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6159c615-0792-4242-a48e-59d497821321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:57.568257 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6159c615-0792-4242-a48e-59d497821321 admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:57.568672 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6159c615-0792-4242-a48e-59d497821321 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:57.569031 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6159c615-0792-4242-a48e-59d497821321 admin admin] PATH_INFO: `/v3/domains` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:57.569866 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6159c615-0792-4242-a48e-59d497821321 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:28:57.570247 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6159c615-0792-4242-a48e-59d497821321 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:57.572449 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6159c615-0792-4242-a48e-59d497821321 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:57.589924 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 952/1914] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Mar 30 01:28:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:28:57.596676 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a653430b-c922-401f-aadf-e18dea0538e4 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:57.619775 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a653430b-c922-401f-aadf-e18dea0538e4 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:57.634627 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44a4a04-881a-4fdf-938b-90cabcb4f815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:57.635272 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a4a04-881a-4fdf-938b-90cabcb4f815 admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:57.635551 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a4a04-881a-4fdf-938b-90cabcb4f815 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:57.635825 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a4a04-881a-4fdf-938b-90cabcb4f815 admin admin] PATH_INFO: `/v3/projects` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:57.636529 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44a4a04-881a-4fdf-938b-90cabcb4f815 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:57.638725 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44a4a04-881a-4fdf-938b-90cabcb4f815 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:57.688054 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 963/1915] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:28:57 2022] POST /identity/v3/projects => generated 375 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:28:57.688728 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6159c615-0792-4242-a48e-59d497821321 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:57.713723 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6159c615-0792-4242-a48e-59d497821321 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:57.724210 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44a4a04-881a-4fdf-938b-90cabcb4f815 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:57.726669 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-e44a4a04-881a-4fdf-938b-90cabcb4f815 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:57.848713 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f01488-6905-4b29-8529-ec1b73e78aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:57.850657 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f01488-6905-4b29-8529-ec1b73e78aa5 admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:57.850984 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f01488-6905-4b29-8529-ec1b73e78aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:57.852543 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f01488-6905-4b29-8529-ec1b73e78aa5 admin admin] PATH_INFO: `/v3/users` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:57.854777 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f01488-6905-4b29-8529-ec1b73e78aa5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:57.857968 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f01488-6905-4b29-8529-ec1b73e78aa5 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:57.864300 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44a4a04-881a-4fdf-938b-90cabcb4f815 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:57.870978 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc3c134-0ba4-4469-95a2-448f6d1ef13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:57.872118 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc3c134-0ba4-4469-95a2-448f6d1ef13b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:57.872400 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc3c134-0ba4-4469-95a2-448f6d1ef13b admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:57.872793 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc3c134-0ba4-4469-95a2-448f6d1ef13b admin admin] PATH_INFO: `/v3/users/c0c48a39c4874b258f04e2346e9ae888` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:57.875009 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc3c134-0ba4-4469-95a2-448f6d1ef13b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0c48a39c4874b258f04e2346e9ae888)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:57.877460 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc3c134-0ba4-4469-95a2-448f6d1ef13b admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:57.901488 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 953/1916] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:28:57 2022] POST /identity/v3/users => generated 288 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 01:28:57.903882 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f01488-6905-4b29-8529-ec1b73e78aa5 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:57.925604 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f01488-6905-4b29-8529-ec1b73e78aa5 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:57.934073 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f8342b-332b-4f1e-aedf-c0c749c70f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:57.935816 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f8342b-332b-4f1e-aedf-c0c749c70f6c admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:57.936528 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f8342b-332b-4f1e-aedf-c0c749c70f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:57.937289 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f8342b-332b-4f1e-aedf-c0c749c70f6c admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:57.938320 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f8342b-332b-4f1e-aedf-c0c749c70f6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:57.941165 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f8342b-332b-4f1e-aedf-c0c749c70f6c admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:57.965401 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 954/1917] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:28:57 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:28:57.969040 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f8342b-332b-4f1e-aedf-c0c749c70f6c admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:57.970589 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-0bc3c134-0ba4-4469-95a2-448f6d1ef13b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0c48a39c4874b258f04e2346e9ae888'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:57.983945 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f8342b-332b-4f1e-aedf-c0c749c70f6c admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:57.990095 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcec662-b0e2-41eb-9e51-9889a6aaaa19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:57.990955 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcec662-b0e2-41eb-9e51-9889a6aaaa19 admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:57.993005 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcec662-b0e2-41eb-9e51-9889a6aaaa19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:57.993429 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcec662-b0e2-41eb-9e51-9889a6aaaa19 admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:57.995247 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcec662-b0e2-41eb-9e51-9889a6aaaa19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:58.000238 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcec662-b0e2-41eb-9e51-9889a6aaaa19 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:58.017914 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-0bc3c134-0ba4-4469-95a2-448f6d1ef13b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0c48a39c4874b258f04e2346e9ae888'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:58.035737 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-0bc3c134-0ba4-4469-95a2-448f6d1ef13b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0c48a39c4874b258f04e2346e9ae888'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:58.036462 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-0bc3c134-0ba4-4469-95a2-448f6d1ef13b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0c48a39c4874b258f04e2346e9ae888'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:58.045720 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 955/1918] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:28:57 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:28:58.047941 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcec662-b0e2-41eb-9e51-9889a6aaaa19 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:58.057603 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-0bc3c134-0ba4-4469-95a2-448f6d1ef13b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0c48a39c4874b258f04e2346e9ae888'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:28:58.069208 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 964/1919] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:28:57 2022] DELETE /identity/v3/users/c0c48a39c4874b258f04e2346e9ae888 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:28:58.076871 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c22c64f-c23d-49a5-88c3-8f12dcedc404 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:58.077740 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c22c64f-c23d-49a5-88c3-8f12dcedc404 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:58.078220 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c22c64f-c23d-49a5-88c3-8f12dcedc404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:58.079505 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcec662-b0e2-41eb-9e51-9889a6aaaa19 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:58.110315 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-7c22c64f-c23d-49a5-88c3-8f12dcedc404 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:58.113150 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-7c22c64f-c23d-49a5-88c3-8f12dcedc404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:58.189326 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39df56f-32fb-4755-b945-4db6992aadf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:58.200136 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39df56f-32fb-4755-b945-4db6992aadf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:58.200481 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39df56f-32fb-4755-b945-4db6992aadf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:58.200764 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39df56f-32fb-4755-b945-4db6992aadf3 admin admin] PATH_INFO: `/v3/projects/dd5bdeba2bcd497eb6644b9b97257abf/users/9ccd0779c81d462cbbb0699def402bf5/roles/7185d0cfbcd44502b1613bcfe1b42f6f` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:58.229411 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39df56f-32fb-4755-b945-4db6992aadf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd5bdeba2bcd497eb6644b9b97257abf, user_id=9ccd0779c81d462cbbb0699def402bf5, role_id=7185d0cfbcd44502b1613bcfe1b42f6f)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:58.232775 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39df56f-32fb-4755-b945-4db6992aadf3 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:58.258271 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 956/1920] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:28:58 2022] PUT /identity/v3/projects/dd5bdeba2bcd497eb6644b9b97257abf/users/9ccd0779c81d462cbbb0699def402bf5/roles/7185d0cfbcd44502b1613bcfe1b42f6f => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:28:58.271245 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300055c-aee1-4dd4-bad7-1c9f16336cbd None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:58.271545 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300055c-aee1-4dd4-bad7-1c9f16336cbd None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:58.272384 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300055c-aee1-4dd4-bad7-1c9f16336cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:58.285712 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 965/1921] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:58.303412 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c22c64f-c23d-49a5-88c3-8f12dcedc404 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:58.305858 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-7c22c64f-c23d-49a5-88c3-8f12dcedc404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:58.326295 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-c300055c-aee1-4dd4-bad7-1c9f16336cbd None None] MFA Rules not processed for user `9ccd0779c81d462cbbb0699def402bf5`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:58.329306 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-c300055c-aee1-4dd4-bad7-1c9f16336cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:58.432364 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c22c64f-c23d-49a5-88c3-8f12dcedc404 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:58.433473 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 957/1922] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 01:28:58.434535 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c300055c-aee1-4dd4-bad7-1c9f16336cbd None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:58.442783 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-c300055c-aee1-4dd4-bad7-1c9f16336cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:58.584251 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c912b7-ac9a-4b55-a38e-23d36ff6cae1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:58.585036 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c912b7-ac9a-4b55-a38e-23d36ff6cae1 service neutron] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:58.585322 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c912b7-ac9a-4b55-a38e-23d36ff6cae1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:58.585604 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c912b7-ac9a-4b55-a38e-23d36ff6cae1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:58.637246 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c300055c-aee1-4dd4-bad7-1c9f16336cbd None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:58.650090 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed6b32-308c-481d-a34f-e0cfb4eba224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:58.655209 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed6b32-308c-481d-a34f-e0cfb4eba224 admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:58.655209 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed6b32-308c-481d-a34f-e0cfb4eba224 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:58.655209 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed6b32-308c-481d-a34f-e0cfb4eba224 admin admin] PATH_INFO: `/v3/projects` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:58.655209 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caed6b32-308c-481d-a34f-e0cfb4eba224 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:58.655209 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caed6b32-308c-481d-a34f-e0cfb4eba224 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:58.719615 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 958/1923] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:28:58 2022] POST /identity/v3/projects => generated 375 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:28:58.731059 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d6d05-2761-4d35-941e-430d4dd0aad1 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:58.731349 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d6d05-2761-4d35-941e-430d4dd0aad1 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:58.733259 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d6d05-2761-4d35-941e-430d4dd0aad1 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:58.738996 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 959/1924] 10.222.0.30 () {54 vars in 921 bytes} [Wed Mar 30 01:28:58 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:28:58.739900 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87d6d05-2761-4d35-941e-430d4dd0aad1 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:58.777556 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c912b7-ac9a-4b55-a38e-23d36ff6cae1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:58.783324 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c912b7-ac9a-4b55-a38e-23d36ff6cae1 service neutron] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:58.835935 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 966/1925] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:28:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:28:58.838491 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7264abc-5771-4a8d-a588-bd01f80b616a None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:58.838872 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7264abc-5771-4a8d-a588-bd01f80b616a None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:58.839079 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7264abc-5771-4a8d-a588-bd01f80b616a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:58.877057 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-c7264abc-5771-4a8d-a588-bd01f80b616a None None] MFA Rules not processed for user `140c6d1a20e94192bde06e72040f162d`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:58.879657 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-c7264abc-5771-4a8d-a588-bd01f80b616a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:58.898173 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87d6d05-2761-4d35-941e-430d4dd0aad1 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:58.904787 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc38f8e7-48e3-4a98-9197-5d03976d241d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:58.905756 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38f8e7-48e3-4a98-9197-5d03976d241d admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:58.906038 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38f8e7-48e3-4a98-9197-5d03976d241d admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:58.906312 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38f8e7-48e3-4a98-9197-5d03976d241d admin admin] PATH_INFO: `/v3/users` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:58.907437 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc38f8e7-48e3-4a98-9197-5d03976d241d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:58.909366 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc38f8e7-48e3-4a98-9197-5d03976d241d admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:58.940369 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 960/1926] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:28:58 2022] POST /identity/v3/users => generated 294 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:28:58.944679 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc38f8e7-48e3-4a98-9197-5d03976d241d admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:58.962968 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc38f8e7-48e3-4a98-9197-5d03976d241d admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:58.970238 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ae498-15a3-4702-9168-0dfa69d82bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:58.971152 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ae498-15a3-4702-9168-0dfa69d82bf5 admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:58.971641 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ae498-15a3-4702-9168-0dfa69d82bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:58.971995 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ae498-15a3-4702-9168-0dfa69d82bf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:58.973370 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401ae498-15a3-4702-9168-0dfa69d82bf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:58.975699 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401ae498-15a3-4702-9168-0dfa69d82bf5 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:58.990765 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 961/1927] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:28:58 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:28:58.995468 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ae498-15a3-4702-9168-0dfa69d82bf5 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:59.007420 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 967/1928] 10.222.0.30 () {58 vars in 1018 bytes} [Wed Mar 30 01:28:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:59.011120 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ae498-15a3-4702-9168-0dfa69d82bf5 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:59.019649 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaef3db-9e0c-400e-892f-21254e59d649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:59.020690 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaef3db-9e0c-400e-892f-21254e59d649 admin admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:59.021109 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaef3db-9e0c-400e-892f-21254e59d649 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:59.021458 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaef3db-9e0c-400e-892f-21254e59d649 admin admin] PATH_INFO: `/v3/projects/938ae0027dad40749c93d75a4204b9f8/users/7fe7953c2ea44c6ea387e16a6526d1f9/roles/36909bbf31d04993bb2a9fe587b572dc` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:59.034787 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7264abc-5771-4a8d-a588-bd01f80b616a None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:59.036611 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-c7264abc-5771-4a8d-a588-bd01f80b616a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:59.059153 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7264abc-5771-4a8d-a588-bd01f80b616a None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:59.063787 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaef3db-9e0c-400e-892f-21254e59d649 admin admin] RBAC: Authorizing `identity:create_grant(project_id=938ae0027dad40749c93d75a4204b9f8, user_id=7fe7953c2ea44c6ea387e16a6526d1f9, role_id=36909bbf31d04993bb2a9fe587b572dc)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:59.066362 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaef3db-9e0c-400e-892f-21254e59d649 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:59.073284 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a13a5f4-94af-4208-812b-7e884a1c050f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140c6d1a20e94192bde06e72040f162d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:59.074347 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a13a5f4-94af-4208-812b-7e884a1c050f service nova] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:59.074585 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a13a5f4-94af-4208-812b-7e884a1c050f service nova] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:59.074903 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a13a5f4-94af-4208-812b-7e884a1c050f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:59.088586 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 962/1929] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:28:58 2022] PUT /identity/v3/projects/938ae0027dad40749c93d75a4204b9f8/users/7fe7953c2ea44c6ea387e16a6526d1f9/roles/36909bbf31d04993bb2a9fe587b572dc => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:28:59.092322 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a13a5f4-94af-4208-812b-7e884a1c050f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:59.092484 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaef3db-9e0c-400e-892f-21254e59d649 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:59.095124 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a13a5f4-94af-4208-812b-7e884a1c050f service nova] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:59.123560 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 968/1930] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:28:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 30 01:28:59.220444 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaef3db-9e0c-400e-892f-21254e59d649 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:59.229317 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01532a38-89bd-4c1c-bac8-d28005c40593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:59.231149 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01532a38-89bd-4c1c-bac8-d28005c40593 admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:59.231703 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01532a38-89bd-4c1c-bac8-d28005c40593 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:59.232588 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01532a38-89bd-4c1c-bac8-d28005c40593 admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:59.234285 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01532a38-89bd-4c1c-bac8-d28005c40593 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:59.236519 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01532a38-89bd-4c1c-bac8-d28005c40593 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:59.262353 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 963/1931] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:28:59 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 01:28:59.263519 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a13a5f4-94af-4208-812b-7e884a1c050f service nova] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:59.287346 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a13a5f4-94af-4208-812b-7e884a1c050f service nova] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:59.299409 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35fb2ca-de67-4ede-8127-f0ac5a37f47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:59.301238 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35fb2ca-de67-4ede-8127-f0ac5a37f47e admin admin] REQUEST_METHOD: `PUT` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:59.301552 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35fb2ca-de67-4ede-8127-f0ac5a37f47e admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:59.301849 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35fb2ca-de67-4ede-8127-f0ac5a37f47e admin admin] PATH_INFO: `/v3/projects/938ae0027dad40749c93d75a4204b9f8/users/7fe7953c2ea44c6ea387e16a6526d1f9/roles/36909bbf31d04993bb2a9fe587b572dc` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:59.313163 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35fb2ca-de67-4ede-8127-f0ac5a37f47e admin admin] RBAC: Authorizing `identity:create_grant(project_id=938ae0027dad40749c93d75a4204b9f8, user_id=7fe7953c2ea44c6ea387e16a6526d1f9, role_id=36909bbf31d04993bb2a9fe587b572dc)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:59.315271 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d843ff-e9b3-45f0-b2d4-7da787ab25d1 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:59.315799 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d843ff-e9b3-45f0-b2d4-7da787ab25d1 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:59.316338 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d843ff-e9b3-45f0-b2d4-7da787ab25d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:59.317048 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35fb2ca-de67-4ede-8127-f0ac5a37f47e admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:59.350800 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 969/1932] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:28:59 2022] PUT /identity/v3/projects/938ae0027dad40749c93d75a4204b9f8/users/7fe7953c2ea44c6ea387e16a6526d1f9/roles/36909bbf31d04993bb2a9fe587b572dc => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:28:59.359885 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4c23e-79d1-47d6-890c-9ef10d6ca398 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:59.360179 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4c23e-79d1-47d6-890c-9ef10d6ca398 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:59.360468 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4c23e-79d1-47d6-890c-9ef10d6ca398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:59.377641 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-f4d843ff-e9b3-45f0-b2d4-7da787ab25d1 None None] MFA Rules not processed for user `917680493385420e815b5f0eb346c9ad`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:59.379932 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-f4d843ff-e9b3-45f0-b2d4-7da787ab25d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:59.463290 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-7df4c23e-79d1-47d6-890c-9ef10d6ca398 None None] MFA Rules not processed for user `7fe7953c2ea44c6ea387e16a6526d1f9`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:28:59.464543 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-7df4c23e-79d1-47d6-890c-9ef10d6ca398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:59.491881 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 964/1933] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:59 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:59.501291 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d843ff-e9b3-45f0-b2d4-7da787ab25d1 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:59.509885 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-f4d843ff-e9b3-45f0-b2d4-7da787ab25d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:59.703231 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d843ff-e9b3-45f0-b2d4-7da787ab25d1 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:59.712385 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 970/1934] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:28:59 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:28:59.714588 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a5a01d-c6c6-43b8-af7b-3dc6ca2ba04a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45219f386f0147b6bd380efe4ab62812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:59.715358 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5a01d-c6c6-43b8-af7b-3dc6ca2ba04a service cinder] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:59.715708 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5a01d-c6c6-43b8-af7b-3dc6ca2ba04a service cinder] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:59.716192 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5a01d-c6c6-43b8-af7b-3dc6ca2ba04a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:59.718107 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-03a5a01d-c6c6-43b8-af7b-3dc6ca2ba04a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:59.719396 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df4c23e-79d1-47d6-890c-9ef10d6ca398 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:28:59.720745 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-7df4c23e-79d1-47d6-890c-9ef10d6ca398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:28:59.740129 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df4c23e-79d1-47d6-890c-9ef10d6ca398 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:28:59.756354 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56906345-e79d-4560-baa1-0a1d3278fb5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45219f386f0147b6bd380efe4ab62812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:28:59.757589 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56906345-e79d-4560-baa1-0a1d3278fb5e service cinder] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:28:59.757870 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56906345-e79d-4560-baa1-0a1d3278fb5e service cinder] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:28:59.758204 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56906345-e79d-4560-baa1-0a1d3278fb5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:28:59.847549 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a5a01d-c6c6-43b8-af7b-3dc6ca2ba04a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:59.849207 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a5a01d-c6c6-43b8-af7b-3dc6ca2ba04a service cinder] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:59.863944 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 965/1935] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:28:59 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:28:59.864722 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56906345-e79d-4560-baa1-0a1d3278fb5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:28:59.866355 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56906345-e79d-4560-baa1-0a1d3278fb5e service cinder] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:28:59.883889 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 971/1936] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:28:59 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 30 01:29:00.044442 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a5a01d-c6c6-43b8-af7b-3dc6ca2ba04a service cinder] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:00.046332 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-03a5a01d-c6c6-43b8-af7b-3dc6ca2ba04a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:00.217198 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a5a01d-c6c6-43b8-af7b-3dc6ca2ba04a service cinder] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:00.228432 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261dbe2-b63b-425f-8d22-5511aea7ce42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:00.229447 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261dbe2-b63b-425f-8d22-5511aea7ce42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:00.229783 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261dbe2-b63b-425f-8d22-5511aea7ce42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:00.230067 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261dbe2-b63b-425f-8d22-5511aea7ce42 admin admin] PATH_INFO: `/v3/projects/fc15de24eee04f669e56ee8b4a0fe53b` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:00.233803 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1261dbe2-b63b-425f-8d22-5511aea7ce42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc15de24eee04f669e56ee8b4a0fe53b)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:00.235808 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1261dbe2-b63b-425f-8d22-5511aea7ce42 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:00.310453 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-1261dbe2-b63b-425f-8d22-5511aea7ce42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc15de24eee04f669e56ee8b4a0fe53b', 'request_id': 'req-1261dbe2-b63b-425f-8d22-5511aea7ce42'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:00.317600 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-1261dbe2-b63b-425f-8d22-5511aea7ce42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc15de24eee04f669e56ee8b4a0fe53b', 'request_id': 'req-1261dbe2-b63b-425f-8d22-5511aea7ce42'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:00.352582 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-1261dbe2-b63b-425f-8d22-5511aea7ce42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc15de24eee04f669e56ee8b4a0fe53b', 'request_id': 'req-1261dbe2-b63b-425f-8d22-5511aea7ce42'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:00.370805 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-1261dbe2-b63b-425f-8d22-5511aea7ce42 admin admin] The token cache is being invalidate because project fc15de24eee04f669e56ee8b4a0fe53b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:29:00.371457 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-1261dbe2-b63b-425f-8d22-5511aea7ce42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:00.372581 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-1261dbe2-b63b-425f-8d22-5511aea7ce42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:00.378356 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 966/1937] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:29:00 2022] DELETE /identity/v3/projects/fc15de24eee04f669e56ee8b4a0fe53b => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:29:00.379529 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56906345-e79d-4560-baa1-0a1d3278fb5e service cinder] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:00.396086 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56906345-e79d-4560-baa1-0a1d3278fb5e service cinder] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:00.526493 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b5db9f-85a6-4419-9621-3897f30e5712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:00.527527 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5db9f-85a6-4419-9621-3897f30e5712 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:00.528027 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5db9f-85a6-4419-9621-3897f30e5712 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:00.528312 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5db9f-85a6-4419-9621-3897f30e5712 admin admin] PATH_INFO: `/v3/users/3865f23b628941359db3ed7be1614ea5` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:00.529988 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b5db9f-85a6-4419-9621-3897f30e5712 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3865f23b628941359db3ed7be1614ea5)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:00.532638 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b5db9f-85a6-4419-9621-3897f30e5712 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:00.591571 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-35b5db9f-85a6-4419-9621-3897f30e5712 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3865f23b628941359db3ed7be1614ea5'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:00.605642 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-35b5db9f-85a6-4419-9621-3897f30e5712 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3865f23b628941359db3ed7be1614ea5'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:00.619667 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-35b5db9f-85a6-4419-9621-3897f30e5712 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3865f23b628941359db3ed7be1614ea5'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:00.620718 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-35b5db9f-85a6-4419-9621-3897f30e5712 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3865f23b628941359db3ed7be1614ea5'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:00.629681 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261dbe2-b63b-425f-8d22-5511aea7ce42 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:00.631224 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-1261dbe2-b63b-425f-8d22-5511aea7ce42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:00.645325 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-35b5db9f-85a6-4419-9621-3897f30e5712 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3865f23b628941359db3ed7be1614ea5'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:00.668725 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 972/1938] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:29:00 2022] DELETE /identity/v3/users/3865f23b628941359db3ed7be1614ea5 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:29:00.722210 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261dbe2-b63b-425f-8d22-5511aea7ce42 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:00.800603 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6b3d02-d0f1-4d4c-9c64-e166a66a26c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45219f386f0147b6bd380efe4ab62812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:00.801668 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6b3d02-d0f1-4d4c-9c64-e166a66a26c0 service cinder] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:00.802000 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6b3d02-d0f1-4d4c-9c64-e166a66a26c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:00.802318 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6b3d02-d0f1-4d4c-9c64-e166a66a26c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:00.804312 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-5c6b3d02-d0f1-4d4c-9c64-e166a66a26c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:00.886368 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6b3d02-d0f1-4d4c-9c64-e166a66a26c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:00.887994 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6b3d02-d0f1-4d4c-9c64-e166a66a26c0 service cinder] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:00.898205 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 967/1939] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:29:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:29:01.218204 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b5db9f-85a6-4419-9621-3897f30e5712 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:01.220482 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-35b5db9f-85a6-4419-9621-3897f30e5712 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:01.423310 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b5db9f-85a6-4419-9621-3897f30e5712 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:01.437213 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900f5299-39f6-4338-a1eb-c04bdae168bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:01.439338 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f5299-39f6-4338-a1eb-c04bdae168bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:01.440681 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f5299-39f6-4338-a1eb-c04bdae168bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:01.441469 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f5299-39f6-4338-a1eb-c04bdae168bb admin admin] PATH_INFO: `/v3/projects/a807066f6ef24293b5d3acafe9316209` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:01.449545 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900f5299-39f6-4338-a1eb-c04bdae168bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=a807066f6ef24293b5d3acafe9316209)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:01.456044 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900f5299-39f6-4338-a1eb-c04bdae168bb admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:01.571671 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-900f5299-39f6-4338-a1eb-c04bdae168bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a807066f6ef24293b5d3acafe9316209', 'request_id': 'req-900f5299-39f6-4338-a1eb-c04bdae168bb'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:01.594967 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-900f5299-39f6-4338-a1eb-c04bdae168bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a807066f6ef24293b5d3acafe9316209', 'request_id': 'req-900f5299-39f6-4338-a1eb-c04bdae168bb'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:01.600764 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6b3d02-d0f1-4d4c-9c64-e166a66a26c0 service cinder] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:01.602924 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-5c6b3d02-d0f1-4d4c-9c64-e166a66a26c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:01.608326 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-900f5299-39f6-4338-a1eb-c04bdae168bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a807066f6ef24293b5d3acafe9316209', 'request_id': 'req-900f5299-39f6-4338-a1eb-c04bdae168bb'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:01.617763 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6b3d02-d0f1-4d4c-9c64-e166a66a26c0 service cinder] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:01.638556 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-900f5299-39f6-4338-a1eb-c04bdae168bb admin admin] The token cache is being invalidate because project a807066f6ef24293b5d3acafe9316209 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:29:01.638901 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-900f5299-39f6-4338-a1eb-c04bdae168bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:01.641011 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-900f5299-39f6-4338-a1eb-c04bdae168bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:01.646104 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 973/1940] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:29:01 2022] DELETE /identity/v3/projects/a807066f6ef24293b5d3acafe9316209 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:29:01.652461 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b94bb9-a4e2-4885-9294-f50531823504 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:01.653100 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b94bb9-a4e2-4885-9294-f50531823504 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:01.653569 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b94bb9-a4e2-4885-9294-f50531823504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:01.684973 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d9c10-7b99-4a49-a0a2-3d6f01e7a117 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45219f386f0147b6bd380efe4ab62812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:01.686351 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d9c10-7b99-4a49-a0a2-3d6f01e7a117 service cinder] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:01.686915 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d9c10-7b99-4a49-a0a2-3d6f01e7a117 service cinder] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:01.687508 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d9c10-7b99-4a49-a0a2-3d6f01e7a117 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:01.689544 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-a25d9c10-7b99-4a49-a0a2-3d6f01e7a117 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:01.692072 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-b4b94bb9-a4e2-4885-9294-f50531823504 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:29:01.693262 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-b4b94bb9-a4e2-4885-9294-f50531823504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:01.797423 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 974/1941] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:29:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:29:01.804884 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0929f7-2e17-4675-943b-ba904cc21bce None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:01.806035 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0929f7-2e17-4675-943b-ba904cc21bce None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:01.806329 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0929f7-2e17-4675-943b-ba904cc21bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:01.828354 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25d9c10-7b99-4a49-a0a2-3d6f01e7a117 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:01.829905 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25d9c10-7b99-4a49-a0a2-3d6f01e7a117 service cinder] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:01.832219 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-6a0929f7-2e17-4675-943b-ba904cc21bce None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:29:01.833603 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-6a0929f7-2e17-4675-943b-ba904cc21bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:01.844434 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 968/1942] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:29:01 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 30 01:29:01.861979 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 975/1943] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:29:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 01:29:01.866324 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d9c10-7b99-4a49-a0a2-3d6f01e7a117 service cinder] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:01.885953 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d9c10-7b99-4a49-a0a2-3d6f01e7a117 service cinder] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:01.893267 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c021526-4220-4fb7-a9f9-79eaa553653f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:01.894003 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c021526-4220-4fb7-a9f9-79eaa553653f admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:01.894238 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c021526-4220-4fb7-a9f9-79eaa553653f admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:01.894512 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c021526-4220-4fb7-a9f9-79eaa553653f admin admin] PATH_INFO: `/v3/domains` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:01.895279 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c021526-4220-4fb7-a9f9-79eaa553653f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:29:01.895593 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c021526-4220-4fb7-a9f9-79eaa553653f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:01.897210 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c021526-4220-4fb7-a9f9-79eaa553653f admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:01.924519 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 969/1944] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Mar 30 01:29:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:29:01.927215 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0929f7-2e17-4675-943b-ba904cc21bce None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:01.940619 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0929f7-2e17-4675-943b-ba904cc21bce None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:01.949028 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba09690-828d-49ea-aef0-47ff9793cd34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:01.950594 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba09690-828d-49ea-aef0-47ff9793cd34 admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:01.951343 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba09690-828d-49ea-aef0-47ff9793cd34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:01.951685 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba09690-828d-49ea-aef0-47ff9793cd34 admin admin] PATH_INFO: `/v3/projects` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:01.953029 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba09690-828d-49ea-aef0-47ff9793cd34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:01.954380 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba09690-828d-49ea-aef0-47ff9793cd34 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:01.988770 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 976/1945] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:29:01 2022] POST /identity/v3/projects => generated 363 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:29:01.993538 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c021526-4220-4fb7-a9f9-79eaa553653f admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:02.007622 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c021526-4220-4fb7-a9f9-79eaa553653f admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:02.076779 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f9894c-ecb8-41d6-9bf0-c86118beb322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:02.078732 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f9894c-ecb8-41d6-9bf0-c86118beb322 admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:02.079062 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f9894c-ecb8-41d6-9bf0-c86118beb322 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:02.080440 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f9894c-ecb8-41d6-9bf0-c86118beb322 admin admin] PATH_INFO: `/v3/users` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:02.081870 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f9894c-ecb8-41d6-9bf0-c86118beb322 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:02.084728 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f9894c-ecb8-41d6-9bf0-c86118beb322 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:02.114747 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 970/1946] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:29:01 2022] POST /identity/v3/users => generated 282 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 01:29:02.116450 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba09690-828d-49ea-aef0-47ff9793cd34 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:02.130299 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba09690-828d-49ea-aef0-47ff9793cd34 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:02.138359 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aede408-bb15-47d3-ba7e-4152688ea308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:02.139156 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aede408-bb15-47d3-ba7e-4152688ea308 admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:02.139510 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aede408-bb15-47d3-ba7e-4152688ea308 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:02.140225 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aede408-bb15-47d3-ba7e-4152688ea308 admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:02.140553 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aede408-bb15-47d3-ba7e-4152688ea308 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:02.142206 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aede408-bb15-47d3-ba7e-4152688ea308 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:02.172345 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 977/1947] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:29:02 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:29:02.175845 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f9894c-ecb8-41d6-9bf0-c86118beb322 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:02.223915 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f9894c-ecb8-41d6-9bf0-c86118beb322 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:02.229903 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e32976-96b0-42c4-afac-26fcff778ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:02.230684 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e32976-96b0-42c4-afac-26fcff778ddc admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:02.231113 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e32976-96b0-42c4-afac-26fcff778ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:02.231493 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e32976-96b0-42c4-afac-26fcff778ddc admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:02.232373 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e32976-96b0-42c4-afac-26fcff778ddc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:02.234322 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e32976-96b0-42c4-afac-26fcff778ddc admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:02.248327 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 971/1948] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:29:02 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:29:02.252481 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aede408-bb15-47d3-ba7e-4152688ea308 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:02.265165 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aede408-bb15-47d3-ba7e-4152688ea308 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:02.283582 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a88df-5239-4a80-aa77-5f374b5cc36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:02.284917 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a88df-5239-4a80-aa77-5f374b5cc36f admin admin] REQUEST_METHOD: `PUT` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:02.285376 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a88df-5239-4a80-aa77-5f374b5cc36f admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:02.285796 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a88df-5239-4a80-aa77-5f374b5cc36f admin admin] PATH_INFO: `/v3/projects/5d923083c55140c784417817f3e670bf/users/093edade56e34f38a1aa31147fd668c5/roles/7185d0cfbcd44502b1613bcfe1b42f6f` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:02.315268 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86a88df-5239-4a80-aa77-5f374b5cc36f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d923083c55140c784417817f3e670bf, user_id=093edade56e34f38a1aa31147fd668c5, role_id=7185d0cfbcd44502b1613bcfe1b42f6f)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:02.319384 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86a88df-5239-4a80-aa77-5f374b5cc36f admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:02.357325 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 978/1949] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:29:02 2022] PUT /identity/v3/projects/5d923083c55140c784417817f3e670bf/users/093edade56e34f38a1aa31147fd668c5/roles/7185d0cfbcd44502b1613bcfe1b42f6f => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:29:02.370535 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2735bffc-aeb4-451e-bf4f-61010884eae3 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:02.370944 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2735bffc-aeb4-451e-bf4f-61010884eae3 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:02.371717 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2735bffc-aeb4-451e-bf4f-61010884eae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:02.412275 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-2735bffc-aeb4-451e-bf4f-61010884eae3 None None] MFA Rules not processed for user `093edade56e34f38a1aa31147fd668c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:29:02.413615 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-2735bffc-aeb4-451e-bf4f-61010884eae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:02.483376 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 972/1950] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:29:02 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:29:02.487648 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a88df-5239-4a80-aa77-5f374b5cc36f admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:02.547953 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a88df-5239-4a80-aa77-5f374b5cc36f admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:02.552735 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c47ba7-9c07-4850-a145-cac7e9e3be58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:02.553399 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c47ba7-9c07-4850-a145-cac7e9e3be58 admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:02.553688 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c47ba7-9c07-4850-a145-cac7e9e3be58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:02.553970 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c47ba7-9c07-4850-a145-cac7e9e3be58 admin admin] PATH_INFO: `/v3/projects` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:02.554666 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c47ba7-9c07-4850-a145-cac7e9e3be58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:02.556645 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c47ba7-9c07-4850-a145-cac7e9e3be58 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:02.583096 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 979/1951] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:29:02 2022] POST /identity/v3/projects => generated 363 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:29:02.587865 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2735bffc-aeb4-451e-bf4f-61010884eae3 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:02.598300 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2735bffc-aeb4-451e-bf4f-61010884eae3 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:02.654313 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef54c3a-97e1-4862-9557-1c689c7f4139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:02.655048 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef54c3a-97e1-4862-9557-1c689c7f4139 admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:02.655338 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef54c3a-97e1-4862-9557-1c689c7f4139 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:02.655606 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef54c3a-97e1-4862-9557-1c689c7f4139 admin admin] PATH_INFO: `/v3/users` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:02.656495 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef54c3a-97e1-4862-9557-1c689c7f4139 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:02.658741 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef54c3a-97e1-4862-9557-1c689c7f4139 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:02.683383 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 973/1952] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:29:02 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:29:02.684781 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c47ba7-9c07-4850-a145-cac7e9e3be58 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:02.695276 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c47ba7-9c07-4850-a145-cac7e9e3be58 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:02.700352 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c74a808-fa50-4cf9-b179-ed70885cca87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:02.701077 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c74a808-fa50-4cf9-b179-ed70885cca87 admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:02.701452 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c74a808-fa50-4cf9-b179-ed70885cca87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:02.701797 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c74a808-fa50-4cf9-b179-ed70885cca87 admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:02.702590 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c74a808-fa50-4cf9-b179-ed70885cca87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:02.704271 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c74a808-fa50-4cf9-b179-ed70885cca87 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:02.715534 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 980/1953] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:29:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:29:02.719981 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef54c3a-97e1-4862-9557-1c689c7f4139 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:02.730630 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef54c3a-97e1-4862-9557-1c689c7f4139 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:02.735434 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dd4f68-d21e-42a9-b5bf-448be40faf6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:02.736317 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd4f68-d21e-42a9-b5bf-448be40faf6a admin admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:02.736723 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd4f68-d21e-42a9-b5bf-448be40faf6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:02.737008 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd4f68-d21e-42a9-b5bf-448be40faf6a admin admin] PATH_INFO: `/v3/projects/7a70555c1a6640c897cd2c11a1cf5b2e/users/4f337f8831e9462f903b2e100d9336a6/roles/36909bbf31d04993bb2a9fe587b572dc` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:02.753004 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dd4f68-d21e-42a9-b5bf-448be40faf6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a70555c1a6640c897cd2c11a1cf5b2e, user_id=4f337f8831e9462f903b2e100d9336a6, role_id=36909bbf31d04993bb2a9fe587b572dc)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:02.756029 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dd4f68-d21e-42a9-b5bf-448be40faf6a admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:02.769715 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 974/1954] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:29:02 2022] PUT /identity/v3/projects/7a70555c1a6640c897cd2c11a1cf5b2e/users/4f337f8831e9462f903b2e100d9336a6/roles/36909bbf31d04993bb2a9fe587b572dc => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:29:02.773866 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c74a808-fa50-4cf9-b179-ed70885cca87 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:02.784785 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c74a808-fa50-4cf9-b179-ed70885cca87 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:02.847135 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdde7be-cbe7-49c5-8381-f433a5b8f6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:02.847854 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdde7be-cbe7-49c5-8381-f433a5b8f6ed admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:02.848156 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdde7be-cbe7-49c5-8381-f433a5b8f6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:02.848433 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdde7be-cbe7-49c5-8381-f433a5b8f6ed admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:02.849152 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdde7be-cbe7-49c5-8381-f433a5b8f6ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:02.850782 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdde7be-cbe7-49c5-8381-f433a5b8f6ed admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:02.860809 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 981/1955] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:29:02 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:29:02.865492 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dd4f68-d21e-42a9-b5bf-448be40faf6a admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:02.876664 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dd4f68-d21e-42a9-b5bf-448be40faf6a admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:02.881272 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6836aa0f-0101-49b7-b5c1-c7a4c08196ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:02.882146 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6836aa0f-0101-49b7-b5c1-c7a4c08196ac admin admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:02.882430 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6836aa0f-0101-49b7-b5c1-c7a4c08196ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:02.882721 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6836aa0f-0101-49b7-b5c1-c7a4c08196ac admin admin] PATH_INFO: `/v3/projects/7a70555c1a6640c897cd2c11a1cf5b2e/users/4f337f8831e9462f903b2e100d9336a6/roles/36909bbf31d04993bb2a9fe587b572dc` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:02.885699 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6836aa0f-0101-49b7-b5c1-c7a4c08196ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a70555c1a6640c897cd2c11a1cf5b2e, user_id=4f337f8831e9462f903b2e100d9336a6, role_id=36909bbf31d04993bb2a9fe587b572dc)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:02.888362 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6836aa0f-0101-49b7-b5c1-c7a4c08196ac admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:02.899769 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 975/1956] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:29:02 2022] PUT /identity/v3/projects/7a70555c1a6640c897cd2c11a1cf5b2e/users/4f337f8831e9462f903b2e100d9336a6/roles/36909bbf31d04993bb2a9fe587b572dc => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:29:02.911484 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d326e-8548-4e17-9cd2-5b8dfa762d44 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:02.911880 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d326e-8548-4e17-9cd2-5b8dfa762d44 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:02.912164 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d326e-8548-4e17-9cd2-5b8dfa762d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:02.940111 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-d09d326e-8548-4e17-9cd2-5b8dfa762d44 None None] MFA Rules not processed for user `4f337f8831e9462f903b2e100d9336a6`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:29:02.941329 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-d09d326e-8548-4e17-9cd2-5b8dfa762d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:03.062159 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 982/1957] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:29:02 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:29:03.082474 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6836aa0f-0101-49b7-b5c1-c7a4c08196ac admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:03.086119 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-6836aa0f-0101-49b7-b5c1-c7a4c08196ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:03.183527 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6836aa0f-0101-49b7-b5c1-c7a4c08196ac admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:03.188776 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d6958-08a4-4000-957e-0e53c05524e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45219f386f0147b6bd380efe4ab62812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:03.189555 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d6958-08a4-4000-957e-0e53c05524e4 service cinder] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:03.190074 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d6958-08a4-4000-957e-0e53c05524e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:03.190465 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d6958-08a4-4000-957e-0e53c05524e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:03.202512 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3d6958-08a4-4000-957e-0e53c05524e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:03.204579 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3d6958-08a4-4000-957e-0e53c05524e4 service cinder] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:03.223165 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 976/1958] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:29:03 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:29:03.583388 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09d326e-8548-4e17-9cd2-5b8dfa762d44 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:03.586749 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-d09d326e-8548-4e17-9cd2-5b8dfa762d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:03.732544 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09d326e-8548-4e17-9cd2-5b8dfa762d44 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:03.746826 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e23441-f4d4-4848-b113-dfc8330ae241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:03.747816 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e23441-f4d4-4848-b113-dfc8330ae241 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:03.748176 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e23441-f4d4-4848-b113-dfc8330ae241 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:03.748527 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e23441-f4d4-4848-b113-dfc8330ae241 admin admin] PATH_INFO: `/v3/users/2b9c53e51a9a41e99b1613a79de0849c` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:03.751436 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e23441-f4d4-4848-b113-dfc8330ae241 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b9c53e51a9a41e99b1613a79de0849c)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:03.753456 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e23441-f4d4-4848-b113-dfc8330ae241 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:03.859563 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-54e23441-f4d4-4848-b113-dfc8330ae241 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b9c53e51a9a41e99b1613a79de0849c'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:03.888122 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-54e23441-f4d4-4848-b113-dfc8330ae241 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b9c53e51a9a41e99b1613a79de0849c'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:03.895130 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d6958-08a4-4000-957e-0e53c05524e4 service cinder] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:03.898813 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-df3d6958-08a4-4000-957e-0e53c05524e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:03.901593 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-54e23441-f4d4-4848-b113-dfc8330ae241 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b9c53e51a9a41e99b1613a79de0849c'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:03.902840 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-54e23441-f4d4-4848-b113-dfc8330ae241 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b9c53e51a9a41e99b1613a79de0849c'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:03.915748 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d6958-08a4-4000-957e-0e53c05524e4 service cinder] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:03.917290 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-54e23441-f4d4-4848-b113-dfc8330ae241 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b9c53e51a9a41e99b1613a79de0849c'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:03.921655 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35217168-bea8-40b7-9716-22d0dff0d688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:03.922929 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35217168-bea8-40b7-9716-22d0dff0d688 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:03.923398 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35217168-bea8-40b7-9716-22d0dff0d688 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:03.923922 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35217168-bea8-40b7-9716-22d0dff0d688 admin admin] PATH_INFO: `/v3/users/9ccd0779c81d462cbbb0699def402bf5` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:03.924771 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 983/1959] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:29:03 2022] DELETE /identity/v3/users/2b9c53e51a9a41e99b1613a79de0849c => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:29:03.928787 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35217168-bea8-40b7-9716-22d0dff0d688 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ccd0779c81d462cbbb0699def402bf5)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:03.931355 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35217168-bea8-40b7-9716-22d0dff0d688 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:03.933869 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b00f03-3d9d-4672-9d20-da598ccd7089 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:03.934270 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b00f03-3d9d-4672-9d20-da598ccd7089 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:03.935101 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b00f03-3d9d-4672-9d20-da598ccd7089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:03.963245 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-28b00f03-3d9d-4672-9d20-da598ccd7089 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:29:03.964477 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-28b00f03-3d9d-4672-9d20-da598ccd7089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:04.048243 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-35217168-bea8-40b7-9716-22d0dff0d688 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ccd0779c81d462cbbb0699def402bf5'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:04.065413 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-35217168-bea8-40b7-9716-22d0dff0d688 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ccd0779c81d462cbbb0699def402bf5'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:04.066303 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-35217168-bea8-40b7-9716-22d0dff0d688 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ccd0779c81d462cbbb0699def402bf5'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:04.076419 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-35217168-bea8-40b7-9716-22d0dff0d688 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ccd0779c81d462cbbb0699def402bf5'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:04.092675 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-35217168-bea8-40b7-9716-22d0dff0d688 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ccd0779c81d462cbbb0699def402bf5'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:04.099781 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 984/1960] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:29:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:29:04.100969 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b00f03-3d9d-4672-9d20-da598ccd7089 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:04.101377 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 977/1961] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:29:03 2022] DELETE /identity/v3/users/9ccd0779c81d462cbbb0699def402bf5 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:29:04.107866 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-28b00f03-3d9d-4672-9d20-da598ccd7089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:04.111559 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab70353-da65-43c8-a832-67220b7a4b15 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:04.112242 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab70353-da65-43c8-a832-67220b7a4b15 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:04.112744 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab70353-da65-43c8-a832-67220b7a4b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:04.137648 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b00f03-3d9d-4672-9d20-da598ccd7089 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:04.139425 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-6ab70353-da65-43c8-a832-67220b7a4b15 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:29:04.141494 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-6ab70353-da65-43c8-a832-67220b7a4b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:04.330511 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100d1f11-4351-4dcf-acfb-fbe0e0100070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:04.331918 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d1f11-4351-4dcf-acfb-fbe0e0100070 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:04.332228 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d1f11-4351-4dcf-acfb-fbe0e0100070 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:04.332514 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d1f11-4351-4dcf-acfb-fbe0e0100070 admin admin] PATH_INFO: `/v3/users/093edade56e34f38a1aa31147fd668c5` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:04.334210 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100d1f11-4351-4dcf-acfb-fbe0e0100070 admin admin] RBAC: Authorizing `identity:delete_user(user_id=093edade56e34f38a1aa31147fd668c5)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:04.343656 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100d1f11-4351-4dcf-acfb-fbe0e0100070 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:04.345907 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 978/1962] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:29:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:29:04.346826 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab70353-da65-43c8-a832-67220b7a4b15 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:04.350824 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-6ab70353-da65-43c8-a832-67220b7a4b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:04.425922 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-100d1f11-4351-4dcf-acfb-fbe0e0100070 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '093edade56e34f38a1aa31147fd668c5'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:04.453982 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-100d1f11-4351-4dcf-acfb-fbe0e0100070 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '093edade56e34f38a1aa31147fd668c5'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:04.469110 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-100d1f11-4351-4dcf-acfb-fbe0e0100070 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '093edade56e34f38a1aa31147fd668c5'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:04.471265 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-100d1f11-4351-4dcf-acfb-fbe0e0100070 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '093edade56e34f38a1aa31147fd668c5'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:04.486930 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-100d1f11-4351-4dcf-acfb-fbe0e0100070 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '093edade56e34f38a1aa31147fd668c5'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:04.502985 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 985/1963] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:29:04 2022] DELETE /identity/v3/users/093edade56e34f38a1aa31147fd668c5 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:29:04.503485 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab70353-da65-43c8-a832-67220b7a4b15 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:04.504319 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100d1f11-4351-4dcf-acfb-fbe0e0100070 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:04.506179 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-100d1f11-4351-4dcf-acfb-fbe0e0100070 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:04.574450 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53f4966-f0ab-4eec-9366-9afe6c345399 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:04.575168 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f4966-f0ab-4eec-9366-9afe6c345399 service neutron] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:04.575455 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f4966-f0ab-4eec-9366-9afe6c345399 service neutron] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:04.575724 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f4966-f0ab-4eec-9366-9afe6c345399 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:04.577654 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-a53f4966-f0ab-4eec-9366-9afe6c345399 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:04.601169 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100d1f11-4351-4dcf-acfb-fbe0e0100070 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:04.605691 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea75ef1-fc59-40f2-b5e6-2a32866806b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:04.606549 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea75ef1-fc59-40f2-b5e6-2a32866806b2 service neutron] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:04.607007 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea75ef1-fc59-40f2-b5e6-2a32866806b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:04.607428 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea75ef1-fc59-40f2-b5e6-2a32866806b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:04.610385 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-aea75ef1-fc59-40f2-b5e6-2a32866806b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:04.662536 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53f4966-f0ab-4eec-9366-9afe6c345399 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:04.664270 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53f4966-f0ab-4eec-9366-9afe6c345399 service neutron] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:04.681485 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 979/1964] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:29:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:29:04.683070 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c39bcb-436e-4268-92be-f9e13d9885c6 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:04.683360 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c39bcb-436e-4268-92be-f9e13d9885c6 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:04.683639 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c39bcb-436e-4268-92be-f9e13d9885c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:04.712900 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-78c39bcb-436e-4268-92be-f9e13d9885c6 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:29:04.722817 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-78c39bcb-436e-4268-92be-f9e13d9885c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:04.731973 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea75ef1-fc59-40f2-b5e6-2a32866806b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:04.732948 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 980/1965] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:29:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:29:04.733504 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea75ef1-fc59-40f2-b5e6-2a32866806b2 service neutron] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:04.745499 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c39bcb-436e-4268-92be-f9e13d9885c6 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:04.745625 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 986/1966] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:29:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:29:04.747266 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-78c39bcb-436e-4268-92be-f9e13d9885c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:04.759889 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c39bcb-436e-4268-92be-f9e13d9885c6 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:04.769968 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eb3e51-0e67-45ae-9323-7b3229390216 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:04.770918 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb3e51-0e67-45ae-9323-7b3229390216 service neutron] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:04.771278 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb3e51-0e67-45ae-9323-7b3229390216 service neutron] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:04.771656 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb3e51-0e67-45ae-9323-7b3229390216 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:04.797051 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eb3e51-0e67-45ae-9323-7b3229390216 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:04.799059 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eb3e51-0e67-45ae-9323-7b3229390216 service neutron] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:04.826381 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 981/1967] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:29:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 30 01:29:05.355922 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea75ef1-fc59-40f2-b5e6-2a32866806b2 service neutron] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:05.357933 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-aea75ef1-fc59-40f2-b5e6-2a32866806b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:05.368558 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eb3e51-0e67-45ae-9323-7b3229390216 service neutron] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:05.370614 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-20eb3e51-0e67-45ae-9323-7b3229390216 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:05.389994 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea75ef1-fc59-40f2-b5e6-2a32866806b2 service neutron] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:05.393843 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eb3e51-0e67-45ae-9323-7b3229390216 service neutron] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:05.400106 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9712cbb-86b8-4241-a103-47fad5b9e289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:05.400996 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9712cbb-86b8-4241-a103-47fad5b9e289 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:05.401480 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9712cbb-86b8-4241-a103-47fad5b9e289 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:05.401872 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9712cbb-86b8-4241-a103-47fad5b9e289 admin admin] PATH_INFO: `/v3/projects/dd5bdeba2bcd497eb6644b9b97257abf` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:05.403797 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8d938a-840a-4ec3-8f15-b7076a045534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:05.403914 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9712cbb-86b8-4241-a103-47fad5b9e289 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd5bdeba2bcd497eb6644b9b97257abf)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:05.405206 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d938a-840a-4ec3-8f15-b7076a045534 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:05.405499 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d938a-840a-4ec3-8f15-b7076a045534 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:05.405774 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9712cbb-86b8-4241-a103-47fad5b9e289 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:05.405897 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d938a-840a-4ec3-8f15-b7076a045534 admin admin] PATH_INFO: `/v3/projects/f116c84766be4935821f54f373eda267` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:05.409483 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8d938a-840a-4ec3-8f15-b7076a045534 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f116c84766be4935821f54f373eda267)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:05.413044 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8d938a-840a-4ec3-8f15-b7076a045534 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:05.478184 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-e9712cbb-86b8-4241-a103-47fad5b9e289 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd5bdeba2bcd497eb6644b9b97257abf', 'request_id': 'req-e9712cbb-86b8-4241-a103-47fad5b9e289'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:05.478851 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-cd8d938a-840a-4ec3-8f15-b7076a045534 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f116c84766be4935821f54f373eda267', 'request_id': 'req-cd8d938a-840a-4ec3-8f15-b7076a045534'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:05.487292 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-e9712cbb-86b8-4241-a103-47fad5b9e289 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd5bdeba2bcd497eb6644b9b97257abf', 'request_id': 'req-e9712cbb-86b8-4241-a103-47fad5b9e289'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:05.491282 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-cd8d938a-840a-4ec3-8f15-b7076a045534 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f116c84766be4935821f54f373eda267', 'request_id': 'req-cd8d938a-840a-4ec3-8f15-b7076a045534'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:05.498489 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-e9712cbb-86b8-4241-a103-47fad5b9e289 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd5bdeba2bcd497eb6644b9b97257abf', 'request_id': 'req-e9712cbb-86b8-4241-a103-47fad5b9e289'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:05.499055 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-cd8d938a-840a-4ec3-8f15-b7076a045534 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f116c84766be4935821f54f373eda267', 'request_id': 'req-cd8d938a-840a-4ec3-8f15-b7076a045534'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:05.514197 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-cd8d938a-840a-4ec3-8f15-b7076a045534 admin admin] The token cache is being invalidate because project f116c84766be4935821f54f373eda267 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:29:05.514498 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-cd8d938a-840a-4ec3-8f15-b7076a045534 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:05.515543 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-cd8d938a-840a-4ec3-8f15-b7076a045534 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:05.517492 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 987/1968] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:29:05 2022] DELETE /identity/v3/projects/f116c84766be4935821f54f373eda267 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:29:05.518332 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8d938a-840a-4ec3-8f15-b7076a045534 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:05.519363 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-e9712cbb-86b8-4241-a103-47fad5b9e289 admin admin] The token cache is being invalidate because project dd5bdeba2bcd497eb6644b9b97257abf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:29:05.519919 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-e9712cbb-86b8-4241-a103-47fad5b9e289 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:05.520072 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-cd8d938a-840a-4ec3-8f15-b7076a045534 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:05.522799 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-e9712cbb-86b8-4241-a103-47fad5b9e289 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:05.525744 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 982/1969] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:29:05 2022] DELETE /identity/v3/projects/dd5bdeba2bcd497eb6644b9b97257abf => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:29:05.526896 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9712cbb-86b8-4241-a103-47fad5b9e289 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:05.528647 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-e9712cbb-86b8-4241-a103-47fad5b9e289 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:05.616605 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8d938a-840a-4ec3-8f15-b7076a045534 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:05.623853 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec258748-174a-4525-9b03-30c68255a61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:05.624451 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec258748-174a-4525-9b03-30c68255a61b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:05.624902 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec258748-174a-4525-9b03-30c68255a61b admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:05.625092 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec258748-174a-4525-9b03-30c68255a61b admin admin] PATH_INFO: `/v3/projects/5d923083c55140c784417817f3e670bf` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:05.626523 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec258748-174a-4525-9b03-30c68255a61b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d923083c55140c784417817f3e670bf)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:05.628978 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9712cbb-86b8-4241-a103-47fad5b9e289 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:05.629196 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec258748-174a-4525-9b03-30c68255a61b admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:05.635805 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51222c87-c4e8-4c02-ba3f-cd61b1c2d049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:05.636685 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51222c87-c4e8-4c02-ba3f-cd61b1c2d049 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:05.636973 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51222c87-c4e8-4c02-ba3f-cd61b1c2d049 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:05.637249 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51222c87-c4e8-4c02-ba3f-cd61b1c2d049 admin admin] PATH_INFO: `/v3/users/ff5264e889644e26b18a648995e48264` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:05.638495 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51222c87-c4e8-4c02-ba3f-cd61b1c2d049 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff5264e889644e26b18a648995e48264)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:05.640481 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51222c87-c4e8-4c02-ba3f-cd61b1c2d049 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:05.695235 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-ec258748-174a-4525-9b03-30c68255a61b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d923083c55140c784417817f3e670bf', 'request_id': 'req-ec258748-174a-4525-9b03-30c68255a61b'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:05.703919 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-ec258748-174a-4525-9b03-30c68255a61b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d923083c55140c784417817f3e670bf', 'request_id': 'req-ec258748-174a-4525-9b03-30c68255a61b'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:05.705786 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-51222c87-c4e8-4c02-ba3f-cd61b1c2d049 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff5264e889644e26b18a648995e48264'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:05.710618 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-ec258748-174a-4525-9b03-30c68255a61b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d923083c55140c784417817f3e670bf', 'request_id': 'req-ec258748-174a-4525-9b03-30c68255a61b'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:05.715343 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-51222c87-c4e8-4c02-ba3f-cd61b1c2d049 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff5264e889644e26b18a648995e48264'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:05.716375 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-51222c87-c4e8-4c02-ba3f-cd61b1c2d049 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff5264e889644e26b18a648995e48264'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:05.726400 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-51222c87-c4e8-4c02-ba3f-cd61b1c2d049 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff5264e889644e26b18a648995e48264'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:05.732052 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-ec258748-174a-4525-9b03-30c68255a61b admin admin] The token cache is being invalidate because project 5d923083c55140c784417817f3e670bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:29:05.732356 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-ec258748-174a-4525-9b03-30c68255a61b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:05.735445 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-ec258748-174a-4525-9b03-30c68255a61b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:05.741370 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 988/1970] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:29:05 2022] DELETE /identity/v3/projects/5d923083c55140c784417817f3e670bf => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:29:05.743447 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec258748-174a-4525-9b03-30c68255a61b admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:05.746047 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-ec258748-174a-4525-9b03-30c68255a61b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:05.746539 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-51222c87-c4e8-4c02-ba3f-cd61b1c2d049 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff5264e889644e26b18a648995e48264'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:05.753578 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 983/1971] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:29:05 2022] DELETE /identity/v3/users/ff5264e889644e26b18a648995e48264 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:29:05.754526 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51222c87-c4e8-4c02-ba3f-cd61b1c2d049 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:05.756135 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-51222c87-c4e8-4c02-ba3f-cd61b1c2d049 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:05.859252 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec258748-174a-4525-9b03-30c68255a61b admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:05.882329 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51222c87-c4e8-4c02-ba3f-cd61b1c2d049 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:05.882633 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c6eb7a-f5eb-482b-8951-9c3b34942e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:05.883784 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6eb7a-f5eb-482b-8951-9c3b34942e12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:05.886012 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6eb7a-f5eb-482b-8951-9c3b34942e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:05.886445 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6eb7a-f5eb-482b-8951-9c3b34942e12 admin admin] PATH_INFO: `/v3/users/7fe7953c2ea44c6ea387e16a6526d1f9` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:05.891510 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c6eb7a-f5eb-482b-8951-9c3b34942e12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fe7953c2ea44c6ea387e16a6526d1f9)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:05.893967 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c6eb7a-f5eb-482b-8951-9c3b34942e12 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:05.894081 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0a7620-1ce8-419f-aa7c-ab42dfab95f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:05.894959 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0a7620-1ce8-419f-aa7c-ab42dfab95f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:05.895244 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0a7620-1ce8-419f-aa7c-ab42dfab95f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:05.895663 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0a7620-1ce8-419f-aa7c-ab42dfab95f8 admin admin] PATH_INFO: `/v3/users/4f337f8831e9462f903b2e100d9336a6` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:05.896905 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0a7620-1ce8-419f-aa7c-ab42dfab95f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f337f8831e9462f903b2e100d9336a6)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:05.899607 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0a7620-1ce8-419f-aa7c-ab42dfab95f8 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:05.987951 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-cf0a7620-1ce8-419f-aa7c-ab42dfab95f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f337f8831e9462f903b2e100d9336a6'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:05.998672 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-cf0a7620-1ce8-419f-aa7c-ab42dfab95f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f337f8831e9462f903b2e100d9336a6'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:05.999866 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-cf0a7620-1ce8-419f-aa7c-ab42dfab95f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f337f8831e9462f903b2e100d9336a6'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:06.007446 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-a7c6eb7a-f5eb-482b-8951-9c3b34942e12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fe7953c2ea44c6ea387e16a6526d1f9'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:06.009870 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-cf0a7620-1ce8-419f-aa7c-ab42dfab95f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f337f8831e9462f903b2e100d9336a6'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:06.024962 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-cf0a7620-1ce8-419f-aa7c-ab42dfab95f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f337f8831e9462f903b2e100d9336a6'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:06.042885 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-a7c6eb7a-f5eb-482b-8951-9c3b34942e12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fe7953c2ea44c6ea387e16a6526d1f9'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:06.048002 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 984/1972] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:29:05 2022] DELETE /identity/v3/users/4f337f8831e9462f903b2e100d9336a6 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:29:06.052761 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-a7c6eb7a-f5eb-482b-8951-9c3b34942e12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fe7953c2ea44c6ea387e16a6526d1f9'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:06.053451 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-a7c6eb7a-f5eb-482b-8951-9c3b34942e12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fe7953c2ea44c6ea387e16a6526d1f9'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:06.061815 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-a7c6eb7a-f5eb-482b-8951-9c3b34942e12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fe7953c2ea44c6ea387e16a6526d1f9'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:06.073169 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 989/1973] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:29:05 2022] DELETE /identity/v3/users/7fe7953c2ea44c6ea387e16a6526d1f9 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:29:06.327627 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0a7620-1ce8-419f-aa7c-ab42dfab95f8 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:06.330134 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-cf0a7620-1ce8-419f-aa7c-ab42dfab95f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:06.478233 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0a7620-1ce8-419f-aa7c-ab42dfab95f8 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:06.579189 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb80864-b754-4f4e-bf39-b6adfe6736d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:06.581953 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb80864-b754-4f4e-bf39-b6adfe6736d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:06.582925 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb80864-b754-4f4e-bf39-b6adfe6736d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:06.583453 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb80864-b754-4f4e-bf39-b6adfe6736d5 admin admin] PATH_INFO: `/v3/projects/827d6fe8cf0d4b24aa42d44ee2697ba1` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:06.586052 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb80864-b754-4f4e-bf39-b6adfe6736d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=827d6fe8cf0d4b24aa42d44ee2697ba1)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:06.589766 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb80864-b754-4f4e-bf39-b6adfe6736d5 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:06.667843 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-9fb80864-b754-4f4e-bf39-b6adfe6736d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '827d6fe8cf0d4b24aa42d44ee2697ba1', 'request_id': 'req-9fb80864-b754-4f4e-bf39-b6adfe6736d5'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:06.676702 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-9fb80864-b754-4f4e-bf39-b6adfe6736d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '827d6fe8cf0d4b24aa42d44ee2697ba1', 'request_id': 'req-9fb80864-b754-4f4e-bf39-b6adfe6736d5'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:06.705249 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-9fb80864-b754-4f4e-bf39-b6adfe6736d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '827d6fe8cf0d4b24aa42d44ee2697ba1', 'request_id': 'req-9fb80864-b754-4f4e-bf39-b6adfe6736d5'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:06.727247 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-9fb80864-b754-4f4e-bf39-b6adfe6736d5 admin admin] The token cache is being invalidate because project 827d6fe8cf0d4b24aa42d44ee2697ba1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:29:06.727789 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-9fb80864-b754-4f4e-bf39-b6adfe6736d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:06.739240 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-9fb80864-b754-4f4e-bf39-b6adfe6736d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:06.741041 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 985/1974] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:29:06 2022] DELETE /identity/v3/projects/827d6fe8cf0d4b24aa42d44ee2697ba1 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:29:06.745039 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c6eb7a-f5eb-482b-8951-9c3b34942e12 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:06.748800 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-a7c6eb7a-f5eb-482b-8951-9c3b34942e12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:06.768754 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c6eb7a-f5eb-482b-8951-9c3b34942e12 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:06.879015 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea13afb7-c25d-4cd0-8513-0d0dc7d4c7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:06.880636 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13afb7-c25d-4cd0-8513-0d0dc7d4c7ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:06.881164 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13afb7-c25d-4cd0-8513-0d0dc7d4c7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:06.881582 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13afb7-c25d-4cd0-8513-0d0dc7d4c7ac admin admin] PATH_INFO: `/v3/users/dabc93992fdf4fd79ebcd7219e1cd517` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:06.885162 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea13afb7-c25d-4cd0-8513-0d0dc7d4c7ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=dabc93992fdf4fd79ebcd7219e1cd517)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:06.887215 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea13afb7-c25d-4cd0-8513-0d0dc7d4c7ac admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:07.007691 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb80864-b754-4f4e-bf39-b6adfe6736d5 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:07.010385 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-9fb80864-b754-4f4e-bf39-b6adfe6736d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:07.019187 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-ea13afb7-c25d-4cd0-8513-0d0dc7d4c7ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dabc93992fdf4fd79ebcd7219e1cd517'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:07.034153 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb80864-b754-4f4e-bf39-b6adfe6736d5 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:07.049980 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cc2340-73ff-44ec-94de-c3671a4689a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:07.051744 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-ea13afb7-c25d-4cd0-8513-0d0dc7d4c7ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dabc93992fdf4fd79ebcd7219e1cd517'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:07.065081 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc2340-73ff-44ec-94de-c3671a4689a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:07.066526 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc2340-73ff-44ec-94de-c3671a4689a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:07.066526 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc2340-73ff-44ec-94de-c3671a4689a5 admin admin] PATH_INFO: `/v3/projects/7a70555c1a6640c897cd2c11a1cf5b2e` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:07.068352 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cc2340-73ff-44ec-94de-c3671a4689a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a70555c1a6640c897cd2c11a1cf5b2e)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:07.070522 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-ea13afb7-c25d-4cd0-8513-0d0dc7d4c7ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dabc93992fdf4fd79ebcd7219e1cd517'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:07.071698 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cc2340-73ff-44ec-94de-c3671a4689a5 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:07.072287 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-ea13afb7-c25d-4cd0-8513-0d0dc7d4c7ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dabc93992fdf4fd79ebcd7219e1cd517'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:07.091002 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-ea13afb7-c25d-4cd0-8513-0d0dc7d4c7ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dabc93992fdf4fd79ebcd7219e1cd517'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:07.099114 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 990/1975] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:29:06 2022] DELETE /identity/v3/users/dabc93992fdf4fd79ebcd7219e1cd517 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:29:07.100538 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea13afb7-c25d-4cd0-8513-0d0dc7d4c7ac admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:07.102743 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-ea13afb7-c25d-4cd0-8513-0d0dc7d4c7ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:07.169890 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-54cc2340-73ff-44ec-94de-c3671a4689a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a70555c1a6640c897cd2c11a1cf5b2e', 'request_id': 'req-54cc2340-73ff-44ec-94de-c3671a4689a5'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:07.175730 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-54cc2340-73ff-44ec-94de-c3671a4689a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a70555c1a6640c897cd2c11a1cf5b2e', 'request_id': 'req-54cc2340-73ff-44ec-94de-c3671a4689a5'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:07.189136 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-54cc2340-73ff-44ec-94de-c3671a4689a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a70555c1a6640c897cd2c11a1cf5b2e', 'request_id': 'req-54cc2340-73ff-44ec-94de-c3671a4689a5'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:07.203671 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-54cc2340-73ff-44ec-94de-c3671a4689a5 admin admin] The token cache is being invalidate because project 7a70555c1a6640c897cd2c11a1cf5b2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:29:07.204034 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-54cc2340-73ff-44ec-94de-c3671a4689a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:07.204748 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-54cc2340-73ff-44ec-94de-c3671a4689a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:07.206653 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 986/1976] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:29:07 2022] DELETE /identity/v3/projects/7a70555c1a6640c897cd2c11a1cf5b2e => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:29:07.212306 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ebc0e5-1e4b-412e-81f3-124774d781f8 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:07.212845 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ebc0e5-1e4b-412e-81f3-124774d781f8 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:07.213045 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ebc0e5-1e4b-412e-81f3-124774d781f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:07.219931 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea13afb7-c25d-4cd0-8513-0d0dc7d4c7ac admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:07.245910 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-12ebc0e5-1e4b-412e-81f3-124774d781f8 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:29:07.247177 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-12ebc0e5-1e4b-412e-81f3-124774d781f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:07.332255 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 987/1977] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:29:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 01:29:07.334453 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c766ca-764c-4b68-853b-51157c74c42b None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:07.334793 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c766ca-764c-4b68-853b-51157c74c42b None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:07.335060 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c766ca-764c-4b68-853b-51157c74c42b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:07.336425 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d76a1c-4701-4379-aa5c-72b5daa9a779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:07.339183 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d76a1c-4701-4379-aa5c-72b5daa9a779 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:07.339747 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d76a1c-4701-4379-aa5c-72b5daa9a779 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:07.340168 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d76a1c-4701-4379-aa5c-72b5daa9a779 admin admin] PATH_INFO: `/v3/projects/938ae0027dad40749c93d75a4204b9f8` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:07.342546 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d76a1c-4701-4379-aa5c-72b5daa9a779 admin admin] RBAC: Authorizing `identity:delete_project(project_id=938ae0027dad40749c93d75a4204b9f8)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:07.347047 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d76a1c-4701-4379-aa5c-72b5daa9a779 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:07.354944 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-58c766ca-764c-4b68-853b-51157c74c42b None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:29:07.356924 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-58c766ca-764c-4b68-853b-51157c74c42b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:07.378589 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 988/1978] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:29:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:29:07.379477 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c766ca-764c-4b68-853b-51157c74c42b None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:07.390410 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c766ca-764c-4b68-853b-51157c74c42b None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:07.397051 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c992c09-93c5-4c80-9e3e-5e655ca76d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:07.397897 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c992c09-93c5-4c80-9e3e-5e655ca76d06 admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:07.398183 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c992c09-93c5-4c80-9e3e-5e655ca76d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:07.399181 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c992c09-93c5-4c80-9e3e-5e655ca76d06 admin admin] PATH_INFO: `/v3/domains` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:07.400017 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c992c09-93c5-4c80-9e3e-5e655ca76d06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:29:07.400556 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c992c09-93c5-4c80-9e3e-5e655ca76d06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:07.402545 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c992c09-93c5-4c80-9e3e-5e655ca76d06 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:07.421752 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 989/1979] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Mar 30 01:29:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:29:07.423326 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c992c09-93c5-4c80-9e3e-5e655ca76d06 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:07.423444 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-e8d76a1c-4701-4379-aa5c-72b5daa9a779 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '938ae0027dad40749c93d75a4204b9f8', 'request_id': 'req-e8d76a1c-4701-4379-aa5c-72b5daa9a779'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:07.432980 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-e8d76a1c-4701-4379-aa5c-72b5daa9a779 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '938ae0027dad40749c93d75a4204b9f8', 'request_id': 'req-e8d76a1c-4701-4379-aa5c-72b5daa9a779'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:07.435413 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c992c09-93c5-4c80-9e3e-5e655ca76d06 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:07.440279 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-e8d76a1c-4701-4379-aa5c-72b5daa9a779 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '938ae0027dad40749c93d75a4204b9f8', 'request_id': 'req-e8d76a1c-4701-4379-aa5c-72b5daa9a779'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:07.452727 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-e8d76a1c-4701-4379-aa5c-72b5daa9a779 admin admin] The token cache is being invalidate because project 938ae0027dad40749c93d75a4204b9f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:29:07.453026 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-e8d76a1c-4701-4379-aa5c-72b5daa9a779 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:07.454058 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-e8d76a1c-4701-4379-aa5c-72b5daa9a779 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:07.455907 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 991/1980] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:29:07 2022] DELETE /identity/v3/projects/938ae0027dad40749c93d75a4204b9f8 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:29:07.460547 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4218619-10bb-4521-8ae9-9aea9e08a96b None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:07.460906 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4218619-10bb-4521-8ae9-9aea9e08a96b None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:07.462058 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4218619-10bb-4521-8ae9-9aea9e08a96b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:07.487529 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-b4218619-10bb-4521-8ae9-9aea9e08a96b None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:29:07.489362 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-b4218619-10bb-4521-8ae9-9aea9e08a96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:07.504302 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9f84e9-74be-4854-b2e2-22b8956f4448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:07.505077 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f84e9-74be-4854-b2e2-22b8956f4448 admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:07.505428 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f84e9-74be-4854-b2e2-22b8956f4448 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:07.505894 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f84e9-74be-4854-b2e2-22b8956f4448 admin admin] PATH_INFO: `/v3/projects` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:07.506933 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9f84e9-74be-4854-b2e2-22b8956f4448 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:07.509439 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9f84e9-74be-4854-b2e2-22b8956f4448 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:07.544921 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 990/1981] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:29:07 2022] POST /identity/v3/projects => generated 391 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:29:07.549354 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9f84e9-74be-4854-b2e2-22b8956f4448 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:07.551489 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-1f9f84e9-74be-4854-b2e2-22b8956f4448 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:07.578058 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 992/1982] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:29:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 01:29:07.580177 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e8fd6-23be-4f9e-af8e-12f1364268f6 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:07.580750 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e8fd6-23be-4f9e-af8e-12f1364268f6 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:07.581133 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e8fd6-23be-4f9e-af8e-12f1364268f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:07.605351 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-f89e8fd6-23be-4f9e-af8e-12f1364268f6 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:29:07.606876 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-f89e8fd6-23be-4f9e-af8e-12f1364268f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:07.643846 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9f84e9-74be-4854-b2e2-22b8956f4448 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:07.654750 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760c8a3-ef78-4a2d-b445-f4e1ed80ec7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:07.654750 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760c8a3-ef78-4a2d-b445-f4e1ed80ec7b admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:07.654750 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760c8a3-ef78-4a2d-b445-f4e1ed80ec7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:07.654750 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760c8a3-ef78-4a2d-b445-f4e1ed80ec7b admin admin] PATH_INFO: `/v3/users` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:07.655230 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f760c8a3-ef78-4a2d-b445-f4e1ed80ec7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:07.655340 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f760c8a3-ef78-4a2d-b445-f4e1ed80ec7b admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:07.679224 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 991/1983] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:29:07 2022] POST /identity/v3/users => generated 296 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 01:29:07.684957 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760c8a3-ef78-4a2d-b445-f4e1ed80ec7b admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:07.687413 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 993/1984] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:29:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:29:07.691943 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89e8fd6-23be-4f9e-af8e-12f1364268f6 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:07.694727 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760c8a3-ef78-4a2d-b445-f4e1ed80ec7b admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:07.700247 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593ec61f-7525-4dc0-8a60-aa8948ed9f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:07.700916 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ec61f-7525-4dc0-8a60-aa8948ed9f6d admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:07.701203 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ec61f-7525-4dc0-8a60-aa8948ed9f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:07.701482 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ec61f-7525-4dc0-8a60-aa8948ed9f6d admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:07.702211 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593ec61f-7525-4dc0-8a60-aa8948ed9f6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:07.703846 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593ec61f-7525-4dc0-8a60-aa8948ed9f6d admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:07.704003 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89e8fd6-23be-4f9e-af8e-12f1364268f6 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:07.709428 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae64ac-5c39-4f24-8fec-915848d97988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:07.710089 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae64ac-5c39-4f24-8fec-915848d97988 admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:07.710376 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae64ac-5c39-4f24-8fec-915848d97988 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:07.710812 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae64ac-5c39-4f24-8fec-915848d97988 admin admin] PATH_INFO: `/v3/domains` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:07.711752 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ae64ac-5c39-4f24-8fec-915848d97988 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:29:07.712168 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ae64ac-5c39-4f24-8fec-915848d97988 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:07.714178 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ae64ac-5c39-4f24-8fec-915848d97988 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:07.717818 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 992/1985] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:29:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 01:29:07.718730 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593ec61f-7525-4dc0-8a60-aa8948ed9f6d admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:07.730341 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 994/1986] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Mar 30 01:29:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:29:07.730542 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593ec61f-7525-4dc0-8a60-aa8948ed9f6d admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:07.731384 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae64ac-5c39-4f24-8fec-915848d97988 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:07.733829 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717be3dc-0981-44f9-b99f-04ad6e178656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:07.734566 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717be3dc-0981-44f9-b99f-04ad6e178656 admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:07.734942 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717be3dc-0981-44f9-b99f-04ad6e178656 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:07.735299 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717be3dc-0981-44f9-b99f-04ad6e178656 admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:07.736104 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717be3dc-0981-44f9-b99f-04ad6e178656 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:07.737781 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717be3dc-0981-44f9-b99f-04ad6e178656 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:07.741356 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae64ac-5c39-4f24-8fec-915848d97988 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:07.748304 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bf0d71-f725-4091-9aec-4187571fc7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:07.749014 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf0d71-f725-4091-9aec-4187571fc7fd admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:07.749303 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf0d71-f725-4091-9aec-4187571fc7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:07.749640 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf0d71-f725-4091-9aec-4187571fc7fd admin admin] PATH_INFO: `/v3/projects` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:07.750148 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 993/1987] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:29:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 01:29:07.751363 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bf0d71-f725-4091-9aec-4187571fc7fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:07.753334 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bf0d71-f725-4091-9aec-4187571fc7fd admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:07.754045 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717be3dc-0981-44f9-b99f-04ad6e178656 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:07.764424 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717be3dc-0981-44f9-b99f-04ad6e178656 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:07.770017 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbab8d2-9c28-491e-8f5d-bcfbb13708aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:07.771572 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbab8d2-9c28-491e-8f5d-bcfbb13708aa admin admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:07.771978 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbab8d2-9c28-491e-8f5d-bcfbb13708aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:07.772305 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbab8d2-9c28-491e-8f5d-bcfbb13708aa admin admin] PATH_INFO: `/v3/projects/552ae4701c2b4d78a65a4a819ac59d42/users/18e7568af1c446cc9495b5951cf1de30/roles/7185d0cfbcd44502b1613bcfe1b42f6f` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:07.781722 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 995/1988] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:29:07 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:29:07.786044 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bf0d71-f725-4091-9aec-4187571fc7fd admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:07.790450 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbab8d2-9c28-491e-8f5d-bcfbb13708aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=552ae4701c2b4d78a65a4a819ac59d42, user_id=18e7568af1c446cc9495b5951cf1de30, role_id=7185d0cfbcd44502b1613bcfe1b42f6f)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:07.794249 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbab8d2-9c28-491e-8f5d-bcfbb13708aa admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:07.810230 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 994/1989] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:29:07 2022] PUT /identity/v3/projects/552ae4701c2b4d78a65a4a819ac59d42/users/18e7568af1c446cc9495b5951cf1de30/roles/7185d0cfbcd44502b1613bcfe1b42f6f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:29:07.822020 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa2a6a-f31a-4d29-925e-2aa57dcb4650 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:07.822404 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa2a6a-f31a-4d29-925e-2aa57dcb4650 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:07.822686 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa2a6a-f31a-4d29-925e-2aa57dcb4650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:07.852500 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-a6fa2a6a-f31a-4d29-925e-2aa57dcb4650 None None] MFA Rules not processed for user `18e7568af1c446cc9495b5951cf1de30`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:29:07.854139 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-a6fa2a6a-f31a-4d29-925e-2aa57dcb4650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:07.858131 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bf0d71-f725-4091-9aec-4187571fc7fd admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:07.923402 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b07e23-6fd0-4278-80cf-2df412647523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:07.924183 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b07e23-6fd0-4278-80cf-2df412647523 admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:07.924573 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b07e23-6fd0-4278-80cf-2df412647523 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:07.924952 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b07e23-6fd0-4278-80cf-2df412647523 admin admin] PATH_INFO: `/v3/users` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:07.925751 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b07e23-6fd0-4278-80cf-2df412647523 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:07.927886 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b07e23-6fd0-4278-80cf-2df412647523 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:07.936667 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 995/1990] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:29:07 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:29:07.941956 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa2a6a-f31a-4d29-925e-2aa57dcb4650 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:07.955505 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa2a6a-f31a-4d29-925e-2aa57dcb4650 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:07.960107 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 996/1991] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:29:07 2022] POST /identity/v3/users => generated 289 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 01:29:07.963516 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc7e91e-315b-4fad-ad8e-46fdf00ed14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:07.963516 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc7e91e-315b-4fad-ad8e-46fdf00ed14b admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:07.963516 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc7e91e-315b-4fad-ad8e-46fdf00ed14b admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:07.963516 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc7e91e-315b-4fad-ad8e-46fdf00ed14b admin admin] PATH_INFO: `/v3/projects` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:07.964178 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc7e91e-315b-4fad-ad8e-46fdf00ed14b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:07.965782 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b07e23-6fd0-4278-80cf-2df412647523 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:07.966548 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc7e91e-315b-4fad-ad8e-46fdf00ed14b admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:07.968868 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-74b07e23-6fd0-4278-80cf-2df412647523 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:07.993887 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b07e23-6fd0-4278-80cf-2df412647523 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:08.022061 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a76bdcb-429c-4ae4-bf5c-1ca50d81866e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:08.023036 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a76bdcb-429c-4ae4-bf5c-1ca50d81866e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:08.023395 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a76bdcb-429c-4ae4-bf5c-1ca50d81866e admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:08.023706 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a76bdcb-429c-4ae4-bf5c-1ca50d81866e admin admin] PATH_INFO: `/v3/projects/bf473cada8d64e8c869fdbc62ee9a44c` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:08.025083 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a76bdcb-429c-4ae4-bf5c-1ca50d81866e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf473cada8d64e8c869fdbc62ee9a44c)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:08.027103 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a76bdcb-429c-4ae4-bf5c-1ca50d81866e admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:08.041802 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 996/1992] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:29:07 2022] POST /identity/v3/projects => generated 393 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:29:08.043747 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc7e91e-315b-4fad-ad8e-46fdf00ed14b admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:08.111156 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-2a76bdcb-429c-4ae4-bf5c-1ca50d81866e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf473cada8d64e8c869fdbc62ee9a44c', 'request_id': 'req-2a76bdcb-429c-4ae4-bf5c-1ca50d81866e'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:08.125178 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-2a76bdcb-429c-4ae4-bf5c-1ca50d81866e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf473cada8d64e8c869fdbc62ee9a44c', 'request_id': 'req-2a76bdcb-429c-4ae4-bf5c-1ca50d81866e'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:08.135237 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-2a76bdcb-429c-4ae4-bf5c-1ca50d81866e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf473cada8d64e8c869fdbc62ee9a44c', 'request_id': 'req-2a76bdcb-429c-4ae4-bf5c-1ca50d81866e'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:08.148104 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc7e91e-315b-4fad-ad8e-46fdf00ed14b admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:08.158122 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-2a76bdcb-429c-4ae4-bf5c-1ca50d81866e admin admin] The token cache is being invalidate because project bf473cada8d64e8c869fdbc62ee9a44c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:29:08.158757 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-2a76bdcb-429c-4ae4-bf5c-1ca50d81866e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:08.159541 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-2a76bdcb-429c-4ae4-bf5c-1ca50d81866e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:08.172959 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 997/1993] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:29:07 2022] DELETE /identity/v3/projects/bf473cada8d64e8c869fdbc62ee9a44c => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:29:08.172959 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a76bdcb-429c-4ae4-bf5c-1ca50d81866e admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:08.175754 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-2a76bdcb-429c-4ae4-bf5c-1ca50d81866e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:08.233132 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa3bc9-01b7-4392-bdb7-33c331de8a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:08.233925 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa3bc9-01b7-4392-bdb7-33c331de8a7e admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:08.234285 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa3bc9-01b7-4392-bdb7-33c331de8a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:08.234883 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa3bc9-01b7-4392-bdb7-33c331de8a7e admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:08.235444 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fa3bc9-01b7-4392-bdb7-33c331de8a7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:08.237299 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fa3bc9-01b7-4392-bdb7-33c331de8a7e admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:08.250908 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 997/1994] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:29:08.250908 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef75c432-545e-4046-9a51-2a9819860c09 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:08.250908 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef75c432-545e-4046-9a51-2a9819860c09 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:08.250908 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef75c432-545e-4046-9a51-2a9819860c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:08.298631 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-ef75c432-545e-4046-9a51-2a9819860c09 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:29:08.300098 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-ef75c432-545e-4046-9a51-2a9819860c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:08.309355 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a76bdcb-429c-4ae4-bf5c-1ca50d81866e admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:08.324204 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 998/1995] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:29:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:29:08.324204 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef75c432-545e-4046-9a51-2a9819860c09 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:08.324490 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c30b732-8242-42aa-9fda-381085f19e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:08.324490 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c30b732-8242-42aa-9fda-381085f19e2c admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:08.324490 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c30b732-8242-42aa-9fda-381085f19e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:08.324490 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c30b732-8242-42aa-9fda-381085f19e2c admin admin] PATH_INFO: `/v3/users` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:08.324857 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c30b732-8242-42aa-9fda-381085f19e2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:08.324939 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-ef75c432-545e-4046-9a51-2a9819860c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:08.325022 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c30b732-8242-42aa-9fda-381085f19e2c admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:08.335973 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef75c432-545e-4046-9a51-2a9819860c09 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:08.345265 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49627d7c-fb40-4d68-a32b-117facb42d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:08.348820 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49627d7c-fb40-4d68-a32b-117facb42d5d admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:08.349359 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49627d7c-fb40-4d68-a32b-117facb42d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:08.350318 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49627d7c-fb40-4d68-a32b-117facb42d5d admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:08.351639 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49627d7c-fb40-4d68-a32b-117facb42d5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:08.353919 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 998/1996] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:29:08 2022] POST /identity/v3/users => generated 303 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:29:08.355773 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49627d7c-fb40-4d68-a32b-117facb42d5d admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:08.359037 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0306b8a-943e-4363-9a9f-d9db5e6bd805 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:08.359037 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0306b8a-943e-4363-9a9f-d9db5e6bd805 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:08.360175 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0306b8a-943e-4363-9a9f-d9db5e6bd805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:08.369804 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 999/1997] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:29:08.370825 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49627d7c-fb40-4d68-a32b-117facb42d5d admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:08.384544 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49627d7c-fb40-4d68-a32b-117facb42d5d admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:08.390407 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-b0306b8a-943e-4363-9a9f-d9db5e6bd805 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:29:08.391887 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-b0306b8a-943e-4363-9a9f-d9db5e6bd805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:08.392099 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c1c027-d8b7-4daf-bb36-9fd96978fc6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:08.393445 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c1c027-d8b7-4daf-bb36-9fd96978fc6d admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:08.393878 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c1c027-d8b7-4daf-bb36-9fd96978fc6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:08.394331 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c1c027-d8b7-4daf-bb36-9fd96978fc6d admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:08.395350 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c1c027-d8b7-4daf-bb36-9fd96978fc6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:08.397197 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c1c027-d8b7-4daf-bb36-9fd96978fc6d admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:08.402134 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 999/1998] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:29:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:29:08.403137 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0306b8a-943e-4363-9a9f-d9db5e6bd805 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:08.409858 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1000/1999] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:29:08.411221 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c1c027-d8b7-4daf-bb36-9fd96978fc6d admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:08.418759 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0306b8a-943e-4363-9a9f-d9db5e6bd805 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:08.423796 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d5478f-da5d-420b-b7e1-7974f77ed511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:08.424140 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c1c027-d8b7-4daf-bb36-9fd96978fc6d admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:08.424901 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d5478f-da5d-420b-b7e1-7974f77ed511 admin admin] REQUEST_METHOD: `PUT` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:08.425525 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d5478f-da5d-420b-b7e1-7974f77ed511 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:08.425933 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d5478f-da5d-420b-b7e1-7974f77ed511 admin admin] PATH_INFO: `/v3/projects/0b9e7844e3fb4dd68e7480f9b8e0ee60/users/c09c2fb3f24e464b9730bf410652cef6/roles/7185d0cfbcd44502b1613bcfe1b42f6f` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:08.429694 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc79f1eb-d868-47c9-a023-d05257ab08ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:08.430605 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79f1eb-d868-47c9-a023-d05257ab08ab admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:08.431064 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79f1eb-d868-47c9-a023-d05257ab08ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:08.431489 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79f1eb-d868-47c9-a023-d05257ab08ab admin admin] PATH_INFO: `/v3/domains` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:08.432429 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc79f1eb-d868-47c9-a023-d05257ab08ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:29:08.432924 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc79f1eb-d868-47c9-a023-d05257ab08ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:08.434777 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc79f1eb-d868-47c9-a023-d05257ab08ab admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:08.448304 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1001/2000] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Mar 30 01:29:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:29:08.449542 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc79f1eb-d868-47c9-a023-d05257ab08ab admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:08.453197 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d5478f-da5d-420b-b7e1-7974f77ed511 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b9e7844e3fb4dd68e7480f9b8e0ee60, user_id=c09c2fb3f24e464b9730bf410652cef6, role_id=7185d0cfbcd44502b1613bcfe1b42f6f)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:08.456608 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d5478f-da5d-420b-b7e1-7974f77ed511 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:08.462651 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc79f1eb-d868-47c9-a023-d05257ab08ab admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:08.468752 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a0ef7e-b9ca-4e18-9006-2392dcd2ebb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:08.469447 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a0ef7e-b9ca-4e18-9006-2392dcd2ebb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:08.469682 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a0ef7e-b9ca-4e18-9006-2392dcd2ebb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:08.469993 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a0ef7e-b9ca-4e18-9006-2392dcd2ebb8 admin admin] PATH_INFO: `/v3/projects/1ef5f2b953db41bdaf75dfda63e1f7a0/users/835d883547d947b1a68cb2c4d8ae4911/roles/36909bbf31d04993bb2a9fe587b572dc` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:08.472829 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1000/2001] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:29:08 2022] PUT /identity/v3/projects/0b9e7844e3fb4dd68e7480f9b8e0ee60/users/c09c2fb3f24e464b9730bf410652cef6/roles/7185d0cfbcd44502b1613bcfe1b42f6f => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:29:08.473828 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d5478f-da5d-420b-b7e1-7974f77ed511 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:08.489736 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a0ef7e-b9ca-4e18-9006-2392dcd2ebb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ef5f2b953db41bdaf75dfda63e1f7a0, user_id=835d883547d947b1a68cb2c4d8ae4911, role_id=36909bbf31d04993bb2a9fe587b572dc)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:08.493727 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a0ef7e-b9ca-4e18-9006-2392dcd2ebb8 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:08.512025 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1002/2002] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:29:08 2022] PUT /identity/v3/projects/1ef5f2b953db41bdaf75dfda63e1f7a0/users/835d883547d947b1a68cb2c4d8ae4911/roles/36909bbf31d04993bb2a9fe587b572dc => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:29:08.513325 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fcbcbc-4e7f-4c60-b93f-837548efdbe9 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:08.513621 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fcbcbc-4e7f-4c60-b93f-837548efdbe9 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:08.513898 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fcbcbc-4e7f-4c60-b93f-837548efdbe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:08.547973 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-46fcbcbc-4e7f-4c60-b93f-837548efdbe9 None None] MFA Rules not processed for user `c09c2fb3f24e464b9730bf410652cef6`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:29:08.549448 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-46fcbcbc-4e7f-4c60-b93f-837548efdbe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:08.550476 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d5478f-da5d-420b-b7e1-7974f77ed511 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:08.658064 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf73f7d-54b7-469d-a640-70b7387adaef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:08.663289 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf73f7d-54b7-469d-a640-70b7387adaef admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:08.663912 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf73f7d-54b7-469d-a640-70b7387adaef admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:08.664928 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf73f7d-54b7-469d-a640-70b7387adaef admin admin] PATH_INFO: `/v3/projects` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:08.665647 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf73f7d-54b7-469d-a640-70b7387adaef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:08.667637 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf73f7d-54b7-469d-a640-70b7387adaef admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:08.710721 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1003/2004] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:29:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:29:08.712420 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fcbcbc-4e7f-4c60-b93f-837548efdbe9 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:08.713900 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1001/2004] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:29:08 2022] POST /identity/v3/projects => generated 401 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:29:08.714841 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf73f7d-54b7-469d-a640-70b7387adaef admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:08.734124 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fcbcbc-4e7f-4c60-b93f-837548efdbe9 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:08.780833 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf73f7d-54b7-469d-a640-70b7387adaef admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:08.787467 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e61520b-0fa9-4e73-be06-c55a95fafbf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:08.788248 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61520b-0fa9-4e73-be06-c55a95fafbf4 admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:08.788537 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61520b-0fa9-4e73-be06-c55a95fafbf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:08.788811 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61520b-0fa9-4e73-be06-c55a95fafbf4 admin admin] PATH_INFO: `/v3/users` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:08.789611 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e61520b-0fa9-4e73-be06-c55a95fafbf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:08.791787 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e61520b-0fa9-4e73-be06-c55a95fafbf4 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:08.818542 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1002/2005] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:29:08 2022] POST /identity/v3/users => generated 301 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:29:08.822515 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e61520b-0fa9-4e73-be06-c55a95fafbf4 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:08.825122 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-5e61520b-0fa9-4e73-be06-c55a95fafbf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:08.876212 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9486ef-bd4b-41a0-960b-49378d86bfeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:08.877557 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9486ef-bd4b-41a0-960b-49378d86bfeb admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:08.878030 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9486ef-bd4b-41a0-960b-49378d86bfeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:08.878447 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9486ef-bd4b-41a0-960b-49378d86bfeb admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:08.879935 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9486ef-bd4b-41a0-960b-49378d86bfeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:08.882616 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9486ef-bd4b-41a0-960b-49378d86bfeb admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:08.897227 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e61520b-0fa9-4e73-be06-c55a95fafbf4 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:08.898473 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1004/2006] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:29:08.899794 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9486ef-bd4b-41a0-960b-49378d86bfeb admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:08.903964 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0405adb6-2753-47f0-8f86-628694746da0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45219f386f0147b6bd380efe4ab62812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:08.904950 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0405adb6-2753-47f0-8f86-628694746da0 service cinder] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:08.905403 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0405adb6-2753-47f0-8f86-628694746da0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:08.905827 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0405adb6-2753-47f0-8f86-628694746da0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:08.915028 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9486ef-bd4b-41a0-960b-49378d86bfeb admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:08.921863 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e05c3e-29ca-4f23-a0f4-3aade7707151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:08.922652 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e05c3e-29ca-4f23-a0f4-3aade7707151 admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:08.923066 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e05c3e-29ca-4f23-a0f4-3aade7707151 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:08.923436 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e05c3e-29ca-4f23-a0f4-3aade7707151 admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:08.924274 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e05c3e-29ca-4f23-a0f4-3aade7707151 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:08.927127 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e05c3e-29ca-4f23-a0f4-3aade7707151 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:08.944004 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1005/2007] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:29:08.944004 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e05c3e-29ca-4f23-a0f4-3aade7707151 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:08.959985 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e05c3e-29ca-4f23-a0f4-3aade7707151 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:08.967428 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc556639-c8e0-4f32-a5b8-663f76a3a2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:08.968614 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc556639-c8e0-4f32-a5b8-663f76a3a2f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:08.968899 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc556639-c8e0-4f32-a5b8-663f76a3a2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:08.969181 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc556639-c8e0-4f32-a5b8-663f76a3a2f8 admin admin] PATH_INFO: `/v3/projects/1ef5f2b953db41bdaf75dfda63e1f7a0/users/835d883547d947b1a68cb2c4d8ae4911/roles/36909bbf31d04993bb2a9fe587b572dc` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:08.971301 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc556639-c8e0-4f32-a5b8-663f76a3a2f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ef5f2b953db41bdaf75dfda63e1f7a0, user_id=835d883547d947b1a68cb2c4d8ae4911, role_id=36909bbf31d04993bb2a9fe587b572dc)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:08.974398 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc556639-c8e0-4f32-a5b8-663f76a3a2f8 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:08.980208 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0405adb6-2753-47f0-8f86-628694746da0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:08.982603 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0405adb6-2753-47f0-8f86-628694746da0 service cinder] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:08.990037 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1006/2008] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:29:08 2022] PUT /identity/v3/projects/1ef5f2b953db41bdaf75dfda63e1f7a0/users/835d883547d947b1a68cb2c4d8ae4911/roles/36909bbf31d04993bb2a9fe587b572dc => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:29:08.991111 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc556639-c8e0-4f32-a5b8-663f76a3a2f8 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:08.998827 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1003/2009] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:29:08 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:29:09.000541 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2360af-5917-4fee-8754-92c1a440c3ea None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:09.000981 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2360af-5917-4fee-8754-92c1a440c3ea None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:09.001404 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2360af-5917-4fee-8754-92c1a440c3ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:09.045316 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-2c2360af-5917-4fee-8754-92c1a440c3ea None None] MFA Rules not processed for user `835d883547d947b1a68cb2c4d8ae4911`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:29:09.045316 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-2c2360af-5917-4fee-8754-92c1a440c3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:09.084805 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc556639-c8e0-4f32-a5b8-663f76a3a2f8 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:09.090385 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27838069-08f3-4326-bb5f-ee1d1175c341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:09.091411 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27838069-08f3-4326-bb5f-ee1d1175c341 admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:09.091411 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27838069-08f3-4326-bb5f-ee1d1175c341 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:09.091668 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27838069-08f3-4326-bb5f-ee1d1175c341 admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:09.092763 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27838069-08f3-4326-bb5f-ee1d1175c341 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:09.094162 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27838069-08f3-4326-bb5f-ee1d1175c341 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:09.111908 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1007/2010] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:29:09.116717 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27838069-08f3-4326-bb5f-ee1d1175c341 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:09.132545 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27838069-08f3-4326-bb5f-ee1d1175c341 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:09.138854 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faeacff-0ef3-4b24-986e-8835f1522cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:09.140059 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faeacff-0ef3-4b24-986e-8835f1522cd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:09.140519 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faeacff-0ef3-4b24-986e-8835f1522cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:09.141635 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faeacff-0ef3-4b24-986e-8835f1522cd8 admin admin] PATH_INFO: `/v3/projects/22e7a715477e429aa6677d116ad23511/users/ad981236a20e4f6997235fdc3a1f3089/roles/7185d0cfbcd44502b1613bcfe1b42f6f` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:09.143572 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1004/2011] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:29:08 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 01:29:09.157566 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2360af-5917-4fee-8754-92c1a440c3ea None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:09.160148 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-2c2360af-5917-4fee-8754-92c1a440c3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:09.178243 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faeacff-0ef3-4b24-986e-8835f1522cd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22e7a715477e429aa6677d116ad23511, user_id=ad981236a20e4f6997235fdc3a1f3089, role_id=7185d0cfbcd44502b1613bcfe1b42f6f)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:09.183415 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faeacff-0ef3-4b24-986e-8835f1522cd8 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:09.210154 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1008/2012] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:29:09 2022] PUT /identity/v3/projects/22e7a715477e429aa6677d116ad23511/users/ad981236a20e4f6997235fdc3a1f3089/roles/7185d0cfbcd44502b1613bcfe1b42f6f => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:29:09.221429 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6cc83-166c-411c-8488-ef0d79e315a0 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:09.221938 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6cc83-166c-411c-8488-ef0d79e315a0 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:09.222667 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6cc83-166c-411c-8488-ef0d79e315a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:09.251930 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2360af-5917-4fee-8754-92c1a440c3ea None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:09.265725 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-b4c6cc83-166c-411c-8488-ef0d79e315a0 None None] MFA Rules not processed for user `ad981236a20e4f6997235fdc3a1f3089`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:29:09.269044 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-b4c6cc83-166c-411c-8488-ef0d79e315a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:09.342975 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37305824-a32f-4f92-a43a-022c269cee2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45219f386f0147b6bd380efe4ab62812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:09.344669 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37305824-a32f-4f92-a43a-022c269cee2d service cinder] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:09.344960 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37305824-a32f-4f92-a43a-022c269cee2d service cinder] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:09.345289 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37305824-a32f-4f92-a43a-022c269cee2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:09.376917 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1009/2013] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:29:09 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 01:29:09.379430 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c6cc83-166c-411c-8488-ef0d79e315a0 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:09.477427 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37305824-a32f-4f92-a43a-022c269cee2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:09.479725 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37305824-a32f-4f92-a43a-022c269cee2d service cinder] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:09.481599 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c6cc83-166c-411c-8488-ef0d79e315a0 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:09.486967 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a5048-01d1-40bc-a562-c2b2907dfe86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:09.487790 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a5048-01d1-40bc-a562-c2b2907dfe86 admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:09.488087 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a5048-01d1-40bc-a562-c2b2907dfe86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:09.488372 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a5048-01d1-40bc-a562-c2b2907dfe86 admin admin] PATH_INFO: `/v3/projects` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:09.489078 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533a5048-01d1-40bc-a562-c2b2907dfe86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:09.492747 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533a5048-01d1-40bc-a562-c2b2907dfe86 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:09.515213 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1005/2014] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:29:09 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:29:09.531042 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37305824-a32f-4f92-a43a-022c269cee2d service cinder] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:09.533080 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1010/2015] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:29:09 2022] POST /identity/v3/projects => generated 399 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:29:09.543668 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37305824-a32f-4f92-a43a-022c269cee2d service cinder] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:09.652108 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a5048-01d1-40bc-a562-c2b2907dfe86 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:09.670931 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd703e67-cf82-4931-a863-aaf03834402c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:09.671887 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd703e67-cf82-4931-a863-aaf03834402c admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:09.671997 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd703e67-cf82-4931-a863-aaf03834402c admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:09.672262 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd703e67-cf82-4931-a863-aaf03834402c admin admin] PATH_INFO: `/v3/users` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:09.673839 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd703e67-cf82-4931-a863-aaf03834402c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:09.676420 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd703e67-cf82-4931-a863-aaf03834402c admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:09.706146 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1006/2016] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:29:09 2022] POST /identity/v3/users => generated 306 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:29:09.710138 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd703e67-cf82-4931-a863-aaf03834402c admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:09.726530 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd703e67-cf82-4931-a863-aaf03834402c admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:09.731495 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8f54ba-242d-4614-b050-3809bb32b342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:09.732393 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f54ba-242d-4614-b050-3809bb32b342 admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:09.733177 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f54ba-242d-4614-b050-3809bb32b342 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:09.733177 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f54ba-242d-4614-b050-3809bb32b342 admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:09.734039 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8f54ba-242d-4614-b050-3809bb32b342 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:09.736057 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8f54ba-242d-4614-b050-3809bb32b342 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:09.750183 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1007/2017] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:29:09.751604 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8f54ba-242d-4614-b050-3809bb32b342 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:09.762746 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a5048-01d1-40bc-a562-c2b2907dfe86 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:09.762746 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750379f6-0a7c-4791-ad8f-a292a6161e9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45219f386f0147b6bd380efe4ab62812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:09.762746 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750379f6-0a7c-4791-ad8f-a292a6161e9a service cinder] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:09.763181 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750379f6-0a7c-4791-ad8f-a292a6161e9a service cinder] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:09.763252 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750379f6-0a7c-4791-ad8f-a292a6161e9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:09.763320 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8f54ba-242d-4614-b050-3809bb32b342 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:09.770273 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6fa338-e879-4a04-8468-fe134f3a5d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:09.771341 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6fa338-e879-4a04-8468-fe134f3a5d4c admin admin] REQUEST_METHOD: `PUT` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:09.771713 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6fa338-e879-4a04-8468-fe134f3a5d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:09.772091 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6fa338-e879-4a04-8468-fe134f3a5d4c admin admin] PATH_INFO: `/v3/projects/631debe232d244cd92df68c609a7f5c8/users/b9b82409aa2945e0b110d4dfd4db3f79/roles/36909bbf31d04993bb2a9fe587b572dc` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:09.781440 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-750379f6-0a7c-4791-ad8f-a292a6161e9a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:09.803480 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6fa338-e879-4a04-8468-fe134f3a5d4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=631debe232d244cd92df68c609a7f5c8, user_id=b9b82409aa2945e0b110d4dfd4db3f79, role_id=36909bbf31d04993bb2a9fe587b572dc)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:09.806529 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6fa338-e879-4a04-8468-fe134f3a5d4c admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:09.832934 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1008/2018] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:29:09 2022] PUT /identity/v3/projects/631debe232d244cd92df68c609a7f5c8/users/b9b82409aa2945e0b110d4dfd4db3f79/roles/36909bbf31d04993bb2a9fe587b572dc => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:29:09.837022 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6fa338-e879-4a04-8468-fe134f3a5d4c admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:09.865662 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750379f6-0a7c-4791-ad8f-a292a6161e9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:09.868637 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750379f6-0a7c-4791-ad8f-a292a6161e9a service cinder] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:09.885228 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1011/2019] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:29:09 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 30 01:29:09.965566 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6fa338-e879-4a04-8468-fe134f3a5d4c admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:09.976340 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ba15b8-c6c4-40ac-b26f-e05775587bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:09.979363 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba15b8-c6c4-40ac-b26f-e05775587bf4 admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:09.979772 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba15b8-c6c4-40ac-b26f-e05775587bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:09.980149 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba15b8-c6c4-40ac-b26f-e05775587bf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:09.981125 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ba15b8-c6c4-40ac-b26f-e05775587bf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:09.983572 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ba15b8-c6c4-40ac-b26f-e05775587bf4 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:09.996488 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1009/2020] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 01:29:10.000650 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750379f6-0a7c-4791-ad8f-a292a6161e9a service cinder] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:10.032685 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750379f6-0a7c-4791-ad8f-a292a6161e9a service cinder] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:10.047578 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba64dd48-b50f-4e52-b1d1-41c6f3adca73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:10.048879 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba64dd48-b50f-4e52-b1d1-41c6f3adca73 admin admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:10.050037 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba64dd48-b50f-4e52-b1d1-41c6f3adca73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:10.052306 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba64dd48-b50f-4e52-b1d1-41c6f3adca73 admin admin] PATH_INFO: `/v3/projects/631debe232d244cd92df68c609a7f5c8/users/b9b82409aa2945e0b110d4dfd4db3f79/roles/36909bbf31d04993bb2a9fe587b572dc` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:10.058332 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba64dd48-b50f-4e52-b1d1-41c6f3adca73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=631debe232d244cd92df68c609a7f5c8, user_id=b9b82409aa2945e0b110d4dfd4db3f79, role_id=36909bbf31d04993bb2a9fe587b572dc)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:10.061772 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba64dd48-b50f-4e52-b1d1-41c6f3adca73 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:10.108455 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1012/2021] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:29:09 2022] PUT /identity/v3/projects/631debe232d244cd92df68c609a7f5c8/users/b9b82409aa2945e0b110d4dfd4db3f79/roles/36909bbf31d04993bb2a9fe587b572dc => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:29:10.110335 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a2313-70dc-4d4c-b379-5b75e0c91b12 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:10.113645 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a2313-70dc-4d4c-b379-5b75e0c91b12 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:10.114118 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a2313-70dc-4d4c-b379-5b75e0c91b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:10.183729 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-ab0a2313-70dc-4d4c-b379-5b75e0c91b12 None None] MFA Rules not processed for user `b9b82409aa2945e0b110d4dfd4db3f79`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:29:10.185082 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-ab0a2313-70dc-4d4c-b379-5b75e0c91b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:10.292883 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1010/2022] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:29:10 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 01:29:10.305836 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba64dd48-b50f-4e52-b1d1-41c6f3adca73 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:10.374853 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba64dd48-b50f-4e52-b1d1-41c6f3adca73 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:10.378541 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683c8cc2-449f-466c-b764-4fa06ef896a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45219f386f0147b6bd380efe4ab62812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:10.379237 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683c8cc2-449f-466c-b764-4fa06ef896a4 service cinder] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:10.379523 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683c8cc2-449f-466c-b764-4fa06ef896a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:10.379801 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683c8cc2-449f-466c-b764-4fa06ef896a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:10.391085 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683c8cc2-449f-466c-b764-4fa06ef896a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:10.392541 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683c8cc2-449f-466c-b764-4fa06ef896a4 service cinder] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:10.403956 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1013/2023] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:29:10 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:29:10.487898 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0a2313-70dc-4d4c-b379-5b75e0c91b12 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:10.498207 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0a2313-70dc-4d4c-b379-5b75e0c91b12 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:10.501790 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c4232-a570-4fa1-94fa-4b989705c67c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45219f386f0147b6bd380efe4ab62812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:10.502439 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c4232-a570-4fa1-94fa-4b989705c67c service cinder] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:10.502745 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c4232-a570-4fa1-94fa-4b989705c67c service cinder] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:10.503015 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c4232-a570-4fa1-94fa-4b989705c67c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:10.579468 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858c4232-a570-4fa1-94fa-4b989705c67c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:10.581723 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858c4232-a570-4fa1-94fa-4b989705c67c service cinder] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:10.595632 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1011/2024] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:29:10 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:29:15.436855 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683c8cc2-449f-466c-b764-4fa06ef896a4 service cinder] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:15.502099 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683c8cc2-449f-466c-b764-4fa06ef896a4 service cinder] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:15.507089 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b98bf60-9741-4bc3-b58e-daf24a744dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:15.508318 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b98bf60-9741-4bc3-b58e-daf24a744dee admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:15.508685 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b98bf60-9741-4bc3-b58e-daf24a744dee admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:15.508965 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b98bf60-9741-4bc3-b58e-daf24a744dee admin admin] PATH_INFO: `/v3/users/18e7568af1c446cc9495b5951cf1de30` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:15.510177 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b98bf60-9741-4bc3-b58e-daf24a744dee admin admin] RBAC: Authorizing `identity:delete_user(user_id=18e7568af1c446cc9495b5951cf1de30)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:15.512103 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b98bf60-9741-4bc3-b58e-daf24a744dee admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:15.560831 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-4b98bf60-9741-4bc3-b58e-daf24a744dee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18e7568af1c446cc9495b5951cf1de30'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:15.569540 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-4b98bf60-9741-4bc3-b58e-daf24a744dee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18e7568af1c446cc9495b5951cf1de30'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:15.570161 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-4b98bf60-9741-4bc3-b58e-daf24a744dee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18e7568af1c446cc9495b5951cf1de30'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:15.577444 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-4b98bf60-9741-4bc3-b58e-daf24a744dee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18e7568af1c446cc9495b5951cf1de30'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:15.590579 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-4b98bf60-9741-4bc3-b58e-daf24a744dee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18e7568af1c446cc9495b5951cf1de30'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:15.596856 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1014/2025] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:29:15 2022] DELETE /identity/v3/users/18e7568af1c446cc9495b5951cf1de30 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:29:15.601884 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b877f50-b8a7-4273-a2e6-a2475cb7588d None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:15.602869 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b877f50-b8a7-4273-a2e6-a2475cb7588d None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:15.602869 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b877f50-b8a7-4273-a2e6-a2475cb7588d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:15.620987 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-7b877f50-b8a7-4273-a2e6-a2475cb7588d None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:29:15.622548 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-7b877f50-b8a7-4273-a2e6-a2475cb7588d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:15.690282 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1012/2026] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:29:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:29:15.701812 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b98bf60-9741-4bc3-b58e-daf24a744dee admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:15.704109 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-4b98bf60-9741-4bc3-b58e-daf24a744dee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:15.765772 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b98bf60-9741-4bc3-b58e-daf24a744dee admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:15.770350 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631f9743-8783-4d2e-932f-1b19a5d9610e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:15.771048 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f9743-8783-4d2e-932f-1b19a5d9610e service neutron] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:15.771331 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f9743-8783-4d2e-932f-1b19a5d9610e service neutron] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:15.771605 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f9743-8783-4d2e-932f-1b19a5d9610e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:15.781207 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631f9743-8783-4d2e-932f-1b19a5d9610e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:15.782933 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631f9743-8783-4d2e-932f-1b19a5d9610e service neutron] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:15.792763 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1015/2027] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:29:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 30 01:29:16.276257 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b877f50-b8a7-4273-a2e6-a2475cb7588d None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:16.277730 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-7b877f50-b8a7-4273-a2e6-a2475cb7588d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:16.290261 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b877f50-b8a7-4273-a2e6-a2475cb7588d None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:16.295331 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace115ad-a841-49cc-a521-fd84200530f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:16.296233 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace115ad-a841-49cc-a521-fd84200530f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:16.296509 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace115ad-a841-49cc-a521-fd84200530f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:16.296778 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace115ad-a841-49cc-a521-fd84200530f3 admin admin] PATH_INFO: `/v3/projects/552ae4701c2b4d78a65a4a819ac59d42` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:16.297969 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace115ad-a841-49cc-a521-fd84200530f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=552ae4701c2b4d78a65a4a819ac59d42)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:16.299929 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace115ad-a841-49cc-a521-fd84200530f3 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:16.347280 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-ace115ad-a841-49cc-a521-fd84200530f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '552ae4701c2b4d78a65a4a819ac59d42', 'request_id': 'req-ace115ad-a841-49cc-a521-fd84200530f3'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:16.355922 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-ace115ad-a841-49cc-a521-fd84200530f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '552ae4701c2b4d78a65a4a819ac59d42', 'request_id': 'req-ace115ad-a841-49cc-a521-fd84200530f3'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:16.361913 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-ace115ad-a841-49cc-a521-fd84200530f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '552ae4701c2b4d78a65a4a819ac59d42', 'request_id': 'req-ace115ad-a841-49cc-a521-fd84200530f3'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:16.373572 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-ace115ad-a841-49cc-a521-fd84200530f3 admin admin] The token cache is being invalidate because project 552ae4701c2b4d78a65a4a819ac59d42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:29:16.373883 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-ace115ad-a841-49cc-a521-fd84200530f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:16.374505 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-ace115ad-a841-49cc-a521-fd84200530f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:16.376240 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1013/2028] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:29:16 2022] DELETE /identity/v3/projects/552ae4701c2b4d78a65a4a819ac59d42 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:29:16.380272 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631f9743-8783-4d2e-932f-1b19a5d9610e service neutron] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:16.390376 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631f9743-8783-4d2e-932f-1b19a5d9610e service neutron] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:16.447159 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c961b7b3-4872-4603-8a2f-a13024f88ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:16.448083 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c961b7b3-4872-4603-8a2f-a13024f88ea6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:16.448363 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c961b7b3-4872-4603-8a2f-a13024f88ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:16.448643 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c961b7b3-4872-4603-8a2f-a13024f88ea6 admin admin] PATH_INFO: `/v3/users/835d883547d947b1a68cb2c4d8ae4911` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:16.449845 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c961b7b3-4872-4603-8a2f-a13024f88ea6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=835d883547d947b1a68cb2c4d8ae4911)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:16.451791 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c961b7b3-4872-4603-8a2f-a13024f88ea6 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:16.501164 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-c961b7b3-4872-4603-8a2f-a13024f88ea6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '835d883547d947b1a68cb2c4d8ae4911'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:16.509643 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-c961b7b3-4872-4603-8a2f-a13024f88ea6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '835d883547d947b1a68cb2c4d8ae4911'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:16.510315 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-c961b7b3-4872-4603-8a2f-a13024f88ea6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '835d883547d947b1a68cb2c4d8ae4911'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:16.517356 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-c961b7b3-4872-4603-8a2f-a13024f88ea6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '835d883547d947b1a68cb2c4d8ae4911'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:16.530929 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-c961b7b3-4872-4603-8a2f-a13024f88ea6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '835d883547d947b1a68cb2c4d8ae4911'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:16.537418 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1016/2029] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:29:16 2022] DELETE /identity/v3/users/835d883547d947b1a68cb2c4d8ae4911 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:29:16.831212 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace115ad-a841-49cc-a521-fd84200530f3 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:16.832653 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-ace115ad-a841-49cc-a521-fd84200530f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:16.846541 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace115ad-a841-49cc-a521-fd84200530f3 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:16.912258 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62e6f2d-0064-4cef-8dd5-d6b71e03f992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:16.913120 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e6f2d-0064-4cef-8dd5-d6b71e03f992 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:16.913401 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e6f2d-0064-4cef-8dd5-d6b71e03f992 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:16.913676 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e6f2d-0064-4cef-8dd5-d6b71e03f992 admin admin] PATH_INFO: `/v3/projects/1ef5f2b953db41bdaf75dfda63e1f7a0` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:16.915635 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62e6f2d-0064-4cef-8dd5-d6b71e03f992 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ef5f2b953db41bdaf75dfda63e1f7a0)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:16.917547 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62e6f2d-0064-4cef-8dd5-d6b71e03f992 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:16.963686 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-a62e6f2d-0064-4cef-8dd5-d6b71e03f992 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ef5f2b953db41bdaf75dfda63e1f7a0', 'request_id': 'req-a62e6f2d-0064-4cef-8dd5-d6b71e03f992'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:16.970980 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-a62e6f2d-0064-4cef-8dd5-d6b71e03f992 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ef5f2b953db41bdaf75dfda63e1f7a0', 'request_id': 'req-a62e6f2d-0064-4cef-8dd5-d6b71e03f992'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:16.976442 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-a62e6f2d-0064-4cef-8dd5-d6b71e03f992 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ef5f2b953db41bdaf75dfda63e1f7a0', 'request_id': 'req-a62e6f2d-0064-4cef-8dd5-d6b71e03f992'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:16.988091 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-a62e6f2d-0064-4cef-8dd5-d6b71e03f992 admin admin] The token cache is being invalidate because project 1ef5f2b953db41bdaf75dfda63e1f7a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:29:16.988380 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-a62e6f2d-0064-4cef-8dd5-d6b71e03f992 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:16.989018 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-a62e6f2d-0064-4cef-8dd5-d6b71e03f992 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:16.990566 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1014/2030] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:29:16 2022] DELETE /identity/v3/projects/1ef5f2b953db41bdaf75dfda63e1f7a0 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:29:16.996054 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8b516-e959-4599-9f97-f5bca7e56bfb None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:16.996348 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8b516-e959-4599-9f97-f5bca7e56bfb None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:16.996629 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8b516-e959-4599-9f97-f5bca7e56bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:17.014820 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-58c8b516-e959-4599-9f97-f5bca7e56bfb None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:29:17.016043 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-58c8b516-e959-4599-9f97-f5bca7e56bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:17.077092 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1017/2031] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:29:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:29:17.085737 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988326b-95e9-427d-907d-bc33ee92b190 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:17.086739 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988326b-95e9-427d-907d-bc33ee92b190 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:17.086967 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988326b-95e9-427d-907d-bc33ee92b190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:17.105763 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-f988326b-95e9-427d-907d-bc33ee92b190 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:29:17.106958 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-f988326b-95e9-427d-907d-bc33ee92b190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:17.114938 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1015/2032] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:29:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:29:17.118994 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c8b516-e959-4599-9f97-f5bca7e56bfb None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:17.128615 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c8b516-e959-4599-9f97-f5bca7e56bfb None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:17.133341 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4245c23-0db5-4e07-ae8e-b76ad023a032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:17.133999 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4245c23-0db5-4e07-ae8e-b76ad023a032 admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:17.134283 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4245c23-0db5-4e07-ae8e-b76ad023a032 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:17.134561 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4245c23-0db5-4e07-ae8e-b76ad023a032 admin admin] PATH_INFO: `/v3/domains` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:17.135319 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4245c23-0db5-4e07-ae8e-b76ad023a032 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:29:17.135634 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4245c23-0db5-4e07-ae8e-b76ad023a032 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:17.137269 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4245c23-0db5-4e07-ae8e-b76ad023a032 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:17.148889 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1018/2033] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Mar 30 01:29:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:29:17.152978 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f988326b-95e9-427d-907d-bc33ee92b190 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:17.162128 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f988326b-95e9-427d-907d-bc33ee92b190 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:17.167398 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3612dc5-26a2-4093-aa9f-dfc56cc7155b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:17.168037 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3612dc5-26a2-4093-aa9f-dfc56cc7155b admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:17.168317 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3612dc5-26a2-4093-aa9f-dfc56cc7155b admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:17.168611 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3612dc5-26a2-4093-aa9f-dfc56cc7155b admin admin] PATH_INFO: `/v3/projects` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:17.169295 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3612dc5-26a2-4093-aa9f-dfc56cc7155b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:17.171211 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3612dc5-26a2-4093-aa9f-dfc56cc7155b admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:17.200099 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1016/2034] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:29:17 2022] POST /identity/v3/projects => generated 409 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 01:29:17.203261 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4245c23-0db5-4e07-ae8e-b76ad023a032 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:17.215457 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4245c23-0db5-4e07-ae8e-b76ad023a032 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:17.274405 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b773e1b0-56d5-4751-8f07-7920be5e175c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:17.275115 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b773e1b0-56d5-4751-8f07-7920be5e175c admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:17.275402 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b773e1b0-56d5-4751-8f07-7920be5e175c admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:17.275678 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b773e1b0-56d5-4751-8f07-7920be5e175c admin admin] PATH_INFO: `/v3/users` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:17.276375 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b773e1b0-56d5-4751-8f07-7920be5e175c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:17.278818 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b773e1b0-56d5-4751-8f07-7920be5e175c admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:17.298171 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1019/2035] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:29:17 2022] POST /identity/v3/users => generated 305 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 01:29:17.302433 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3612dc5-26a2-4093-aa9f-dfc56cc7155b admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:17.312587 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3612dc5-26a2-4093-aa9f-dfc56cc7155b admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:17.317079 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eececf-0458-48d0-a6dc-fc0b9205f930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:17.317727 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eececf-0458-48d0-a6dc-fc0b9205f930 admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:17.318007 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eececf-0458-48d0-a6dc-fc0b9205f930 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:17.318277 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eececf-0458-48d0-a6dc-fc0b9205f930 admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:17.319021 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eececf-0458-48d0-a6dc-fc0b9205f930 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:17.321224 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eececf-0458-48d0-a6dc-fc0b9205f930 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:17.331337 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1017/2036] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:29:17.335269 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b773e1b0-56d5-4751-8f07-7920be5e175c admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:17.345650 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b773e1b0-56d5-4751-8f07-7920be5e175c admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:17.350427 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e49e0da-4d08-403e-8332-158ff7236c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:17.351126 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49e0da-4d08-403e-8332-158ff7236c4a admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:17.351571 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49e0da-4d08-403e-8332-158ff7236c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:17.351883 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49e0da-4d08-403e-8332-158ff7236c4a admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:17.352747 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e49e0da-4d08-403e-8332-158ff7236c4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:17.354343 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e49e0da-4d08-403e-8332-158ff7236c4a admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:17.364420 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1020/2037] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:29:17.368603 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eececf-0458-48d0-a6dc-fc0b9205f930 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:17.378562 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eececf-0458-48d0-a6dc-fc0b9205f930 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:17.384050 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d1c53-f20f-4438-8680-5ea63f588082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:17.384967 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d1c53-f20f-4438-8680-5ea63f588082 admin admin] REQUEST_METHOD: `PUT` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:17.385318 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d1c53-f20f-4438-8680-5ea63f588082 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:17.385571 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d1c53-f20f-4438-8680-5ea63f588082 admin admin] PATH_INFO: `/v3/projects/20c575a55f0e424e9c6b537473ec181f/users/698cb8225be54209a2f9bdccc51f0189/roles/7185d0cfbcd44502b1613bcfe1b42f6f` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:17.403385 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4d1c53-f20f-4438-8680-5ea63f588082 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20c575a55f0e424e9c6b537473ec181f, user_id=698cb8225be54209a2f9bdccc51f0189, role_id=7185d0cfbcd44502b1613bcfe1b42f6f)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:17.406484 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4d1c53-f20f-4438-8680-5ea63f588082 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:17.423069 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1018/2038] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:29:17 2022] PUT /identity/v3/projects/20c575a55f0e424e9c6b537473ec181f/users/698cb8225be54209a2f9bdccc51f0189/roles/7185d0cfbcd44502b1613bcfe1b42f6f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:29:17.433323 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d017d3-c286-481d-96bd-4e87a0ee3766 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:17.433707 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d017d3-c286-481d-96bd-4e87a0ee3766 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:17.434059 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d017d3-c286-481d-96bd-4e87a0ee3766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:17.462309 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-f8d017d3-c286-481d-96bd-4e87a0ee3766 None None] MFA Rules not processed for user `698cb8225be54209a2f9bdccc51f0189`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:29:17.463575 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-f8d017d3-c286-481d-96bd-4e87a0ee3766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:17.536387 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1021/2039] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:29:17 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:29:17.540941 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d1c53-f20f-4438-8680-5ea63f588082 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:17.610845 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d1c53-f20f-4438-8680-5ea63f588082 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:17.615585 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c87b0-5d72-4b1e-9713-77ee81c2633f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:17.616169 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c87b0-5d72-4b1e-9713-77ee81c2633f admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:17.616450 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c87b0-5d72-4b1e-9713-77ee81c2633f admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:17.616725 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c87b0-5d72-4b1e-9713-77ee81c2633f admin admin] PATH_INFO: `/v3/projects` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:17.617657 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509c87b0-5d72-4b1e-9713-77ee81c2633f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:17.619600 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509c87b0-5d72-4b1e-9713-77ee81c2633f admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:17.644034 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1019/2040] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:29:17 2022] POST /identity/v3/projects => generated 407 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:29:17.647926 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d017d3-c286-481d-96bd-4e87a0ee3766 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:17.659259 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d017d3-c286-481d-96bd-4e87a0ee3766 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:17.714159 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b456983-5724-4d5a-8769-dee08f32ee65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:17.715120 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b456983-5724-4d5a-8769-dee08f32ee65 admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:17.716029 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b456983-5724-4d5a-8769-dee08f32ee65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:17.716029 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b456983-5724-4d5a-8769-dee08f32ee65 admin admin] PATH_INFO: `/v3/users` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:17.716470 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b456983-5724-4d5a-8769-dee08f32ee65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:17.718457 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b456983-5724-4d5a-8769-dee08f32ee65 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:17.748239 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1022/2041] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:29:17 2022] POST /identity/v3/users => generated 310 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:29:17.753120 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c87b0-5d72-4b1e-9713-77ee81c2633f admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:17.764649 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c87b0-5d72-4b1e-9713-77ee81c2633f admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:17.769373 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36928a5-2336-4a04-a4c6-c13353ff7591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:17.770045 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36928a5-2336-4a04-a4c6-c13353ff7591 admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:17.770329 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36928a5-2336-4a04-a4c6-c13353ff7591 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:17.770600 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36928a5-2336-4a04-a4c6-c13353ff7591 admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:17.771378 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36928a5-2336-4a04-a4c6-c13353ff7591 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:17.772931 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36928a5-2336-4a04-a4c6-c13353ff7591 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:17.784515 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1020/2042] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:29:17.788680 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b456983-5724-4d5a-8769-dee08f32ee65 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:17.798292 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b456983-5724-4d5a-8769-dee08f32ee65 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:17.804042 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47130f5-70c5-458a-afbf-36f3243a5195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:17.805773 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47130f5-70c5-458a-afbf-36f3243a5195 admin admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:17.806191 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47130f5-70c5-458a-afbf-36f3243a5195 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:17.806569 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47130f5-70c5-458a-afbf-36f3243a5195 admin admin] PATH_INFO: `/v3/projects/2fa1b5590d0547909a2f61342fea27a0/users/9ff13e25d0884d098144a8a0ba087049/roles/36909bbf31d04993bb2a9fe587b572dc` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:17.822643 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47130f5-70c5-458a-afbf-36f3243a5195 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fa1b5590d0547909a2f61342fea27a0, user_id=9ff13e25d0884d098144a8a0ba087049, role_id=36909bbf31d04993bb2a9fe587b572dc)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:17.825325 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47130f5-70c5-458a-afbf-36f3243a5195 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:17.838504 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1023/2043] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:29:17 2022] PUT /identity/v3/projects/2fa1b5590d0547909a2f61342fea27a0/users/9ff13e25d0884d098144a8a0ba087049/roles/36909bbf31d04993bb2a9fe587b572dc => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:29:17.842397 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36928a5-2336-4a04-a4c6-c13353ff7591 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:17.852195 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36928a5-2336-4a04-a4c6-c13353ff7591 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:17.908135 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e570c3a4-d8ac-4add-8fdd-ed68cfa3d742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:17.908838 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570c3a4-d8ac-4add-8fdd-ed68cfa3d742 admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:17.909126 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570c3a4-d8ac-4add-8fdd-ed68cfa3d742 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:17.909403 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570c3a4-d8ac-4add-8fdd-ed68cfa3d742 admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:17.910131 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e570c3a4-d8ac-4add-8fdd-ed68cfa3d742 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:17.911758 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e570c3a4-d8ac-4add-8fdd-ed68cfa3d742 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:17.921784 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1021/2044] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:29:17.925929 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47130f5-70c5-458a-afbf-36f3243a5195 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:17.937109 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47130f5-70c5-458a-afbf-36f3243a5195 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:17.941709 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9746f4fb-434d-4e4f-a44f-aafa8e3d4e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:17.942586 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746f4fb-434d-4e4f-a44f-aafa8e3d4e4d admin admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:17.942896 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746f4fb-434d-4e4f-a44f-aafa8e3d4e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:17.943174 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746f4fb-434d-4e4f-a44f-aafa8e3d4e4d admin admin] PATH_INFO: `/v3/projects/2fa1b5590d0547909a2f61342fea27a0/users/9ff13e25d0884d098144a8a0ba087049/roles/36909bbf31d04993bb2a9fe587b572dc` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:17.945309 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9746f4fb-434d-4e4f-a44f-aafa8e3d4e4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fa1b5590d0547909a2f61342fea27a0, user_id=9ff13e25d0884d098144a8a0ba087049, role_id=36909bbf31d04993bb2a9fe587b572dc)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:17.948398 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9746f4fb-434d-4e4f-a44f-aafa8e3d4e4d admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:17.958988 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1024/2045] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:29:17 2022] PUT /identity/v3/projects/2fa1b5590d0547909a2f61342fea27a0/users/9ff13e25d0884d098144a8a0ba087049/roles/36909bbf31d04993bb2a9fe587b572dc => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:29:17.968974 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c3ec7-59ec-4484-9323-9f09e34f0c3d None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:17.969249 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c3ec7-59ec-4484-9323-9f09e34f0c3d None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:17.969533 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c3ec7-59ec-4484-9323-9f09e34f0c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:18.002592 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-0a4c3ec7-59ec-4484-9323-9f09e34f0c3d None None] MFA Rules not processed for user `9ff13e25d0884d098144a8a0ba087049`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:29:18.003907 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-0a4c3ec7-59ec-4484-9323-9f09e34f0c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:18.078140 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1022/2046] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:29:17 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 01:29:18.089532 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9746f4fb-434d-4e4f-a44f-aafa8e3d4e4d admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:18.091490 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-9746f4fb-434d-4e4f-a44f-aafa8e3d4e4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:18.148708 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9746f4fb-434d-4e4f-a44f-aafa8e3d4e4d admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:18.152401 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e37649-db1c-4c2c-a236-d96342912782 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45219f386f0147b6bd380efe4ab62812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:18.153041 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e37649-db1c-4c2c-a236-d96342912782 service cinder] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:18.153326 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e37649-db1c-4c2c-a236-d96342912782 service cinder] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:18.153605 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e37649-db1c-4c2c-a236-d96342912782 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:18.163140 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e37649-db1c-4c2c-a236-d96342912782 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:18.165108 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e37649-db1c-4c2c-a236-d96342912782 service cinder] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:18.174304 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1025/2047] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:29:18 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:29:18.325880 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4c3ec7-59ec-4484-9323-9f09e34f0c3d None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:18.335449 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4c3ec7-59ec-4484-9323-9f09e34f0c3d None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:18.339847 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624bc74b-95ea-4a42-ad39-35d0de387700 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45219f386f0147b6bd380efe4ab62812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:18.340515 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624bc74b-95ea-4a42-ad39-35d0de387700 service cinder] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:18.340797 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624bc74b-95ea-4a42-ad39-35d0de387700 service cinder] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:18.341073 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624bc74b-95ea-4a42-ad39-35d0de387700 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:18.397150 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624bc74b-95ea-4a42-ad39-35d0de387700 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:18.399444 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624bc74b-95ea-4a42-ad39-35d0de387700 service cinder] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:18.408539 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1023/2048] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:29:18 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:29:19.979975 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e37649-db1c-4c2c-a236-d96342912782 service cinder] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:19.981379 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-02e37649-db1c-4c2c-a236-d96342912782 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:20.046915 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e37649-db1c-4c2c-a236-d96342912782 service cinder] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:20.052162 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ef9698-065b-49c4-a53a-0bf3abf41bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:20.053070 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef9698-065b-49c4-a53a-0bf3abf41bc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:20.053349 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef9698-065b-49c4-a53a-0bf3abf41bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:20.053623 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef9698-065b-49c4-a53a-0bf3abf41bc7 admin admin] PATH_INFO: `/v3/users/ad981236a20e4f6997235fdc3a1f3089` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:20.054851 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ef9698-065b-49c4-a53a-0bf3abf41bc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad981236a20e4f6997235fdc3a1f3089)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:20.056962 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ef9698-065b-49c4-a53a-0bf3abf41bc7 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:20.103832 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-19ef9698-065b-49c4-a53a-0bf3abf41bc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad981236a20e4f6997235fdc3a1f3089'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:20.110954 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-19ef9698-065b-49c4-a53a-0bf3abf41bc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad981236a20e4f6997235fdc3a1f3089'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:20.111582 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-19ef9698-065b-49c4-a53a-0bf3abf41bc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad981236a20e4f6997235fdc3a1f3089'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:20.118664 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-19ef9698-065b-49c4-a53a-0bf3abf41bc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad981236a20e4f6997235fdc3a1f3089'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:20.129916 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-19ef9698-065b-49c4-a53a-0bf3abf41bc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad981236a20e4f6997235fdc3a1f3089'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:20.136352 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1026/2049] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:29:19 2022] DELETE /identity/v3/users/ad981236a20e4f6997235fdc3a1f3089 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:29:20.140781 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a6698-34c2-4ed9-aced-acb31b838f36 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:20.141315 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a6698-34c2-4ed9-aced-acb31b838f36 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:20.141315 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a6698-34c2-4ed9-aced-acb31b838f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:20.159438 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-b55a6698-34c2-4ed9-aced-acb31b838f36 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:29:20.160671 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-b55a6698-34c2-4ed9-aced-acb31b838f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:20.218643 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1024/2050] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:29:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:29:20.228320 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ef9698-065b-49c4-a53a-0bf3abf41bc7 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:20.230307 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-19ef9698-065b-49c4-a53a-0bf3abf41bc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:20.288228 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ef9698-065b-49c4-a53a-0bf3abf41bc7 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:20.292919 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a1a58c-4ff1-466e-af0a-e09f0f19b8c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:20.293276 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1a58c-4ff1-466e-af0a-e09f0f19b8c9 service neutron] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:20.293562 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1a58c-4ff1-466e-af0a-e09f0f19b8c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:20.293844 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1a58c-4ff1-466e-af0a-e09f0f19b8c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:20.303288 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a1a58c-4ff1-466e-af0a-e09f0f19b8c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:20.304720 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a1a58c-4ff1-466e-af0a-e09f0f19b8c9 service neutron] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:20.314412 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1027/2051] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:29:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:29:20.604185 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55a6698-34c2-4ed9-aced-acb31b838f36 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:20.605826 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-b55a6698-34c2-4ed9-aced-acb31b838f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:20.635248 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55a6698-34c2-4ed9-aced-acb31b838f36 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:20.642004 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e3e30b-4331-4f03-ac36-15669784f79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:20.643501 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e3e30b-4331-4f03-ac36-15669784f79a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:20.643788 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e3e30b-4331-4f03-ac36-15669784f79a admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:20.644069 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e3e30b-4331-4f03-ac36-15669784f79a admin admin] PATH_INFO: `/v3/projects/22e7a715477e429aa6677d116ad23511` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:20.645268 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e3e30b-4331-4f03-ac36-15669784f79a admin admin] RBAC: Authorizing `identity:delete_project(project_id=22e7a715477e429aa6677d116ad23511)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:20.647225 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e3e30b-4331-4f03-ac36-15669784f79a admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:20.696433 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-d8e3e30b-4331-4f03-ac36-15669784f79a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22e7a715477e429aa6677d116ad23511', 'request_id': 'req-d8e3e30b-4331-4f03-ac36-15669784f79a'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:20.705562 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-d8e3e30b-4331-4f03-ac36-15669784f79a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22e7a715477e429aa6677d116ad23511', 'request_id': 'req-d8e3e30b-4331-4f03-ac36-15669784f79a'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:20.711277 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-d8e3e30b-4331-4f03-ac36-15669784f79a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22e7a715477e429aa6677d116ad23511', 'request_id': 'req-d8e3e30b-4331-4f03-ac36-15669784f79a'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:20.723047 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-d8e3e30b-4331-4f03-ac36-15669784f79a admin admin] The token cache is being invalidate because project 22e7a715477e429aa6677d116ad23511 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:29:20.723336 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-d8e3e30b-4331-4f03-ac36-15669784f79a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:20.724015 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-d8e3e30b-4331-4f03-ac36-15669784f79a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:20.725764 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1025/2052] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:29:20 2022] DELETE /identity/v3/projects/22e7a715477e429aa6677d116ad23511 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:29:20.729677 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a1a58c-4ff1-466e-af0a-e09f0f19b8c9 service neutron] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:20.739200 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a1a58c-4ff1-466e-af0a-e09f0f19b8c9 service neutron] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:20.796940 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f40544-a3d0-4c69-9ff1-a54de129b2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:20.797813 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f40544-a3d0-4c69-9ff1-a54de129b2a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:20.798093 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f40544-a3d0-4c69-9ff1-a54de129b2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:20.798364 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f40544-a3d0-4c69-9ff1-a54de129b2a2 admin admin] PATH_INFO: `/v3/users/b9b82409aa2945e0b110d4dfd4db3f79` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:20.799597 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f40544-a3d0-4c69-9ff1-a54de129b2a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9b82409aa2945e0b110d4dfd4db3f79)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:20.801498 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f40544-a3d0-4c69-9ff1-a54de129b2a2 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:20.852089 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-62f40544-a3d0-4c69-9ff1-a54de129b2a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9b82409aa2945e0b110d4dfd4db3f79'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:20.860530 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-62f40544-a3d0-4c69-9ff1-a54de129b2a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9b82409aa2945e0b110d4dfd4db3f79'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:20.861638 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-62f40544-a3d0-4c69-9ff1-a54de129b2a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9b82409aa2945e0b110d4dfd4db3f79'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:20.868553 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-62f40544-a3d0-4c69-9ff1-a54de129b2a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9b82409aa2945e0b110d4dfd4db3f79'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:20.879901 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-62f40544-a3d0-4c69-9ff1-a54de129b2a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9b82409aa2945e0b110d4dfd4db3f79'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:20.887393 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1028/2053] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:29:20 2022] DELETE /identity/v3/users/b9b82409aa2945e0b110d4dfd4db3f79 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:29:21.172035 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e3e30b-4331-4f03-ac36-15669784f79a admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:21.173973 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-d8e3e30b-4331-4f03-ac36-15669784f79a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:21.203134 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e3e30b-4331-4f03-ac36-15669784f79a admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:21.261259 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a575f62-cf02-4b6d-82ad-5311a95dae1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:21.262130 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a575f62-cf02-4b6d-82ad-5311a95dae1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:21.262415 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a575f62-cf02-4b6d-82ad-5311a95dae1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:21.262690 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a575f62-cf02-4b6d-82ad-5311a95dae1e admin admin] PATH_INFO: `/v3/projects/631debe232d244cd92df68c609a7f5c8` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:21.263915 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a575f62-cf02-4b6d-82ad-5311a95dae1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=631debe232d244cd92df68c609a7f5c8)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:21.265811 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a575f62-cf02-4b6d-82ad-5311a95dae1e admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:21.313813 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-6a575f62-cf02-4b6d-82ad-5311a95dae1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '631debe232d244cd92df68c609a7f5c8', 'request_id': 'req-6a575f62-cf02-4b6d-82ad-5311a95dae1e'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:21.321567 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-6a575f62-cf02-4b6d-82ad-5311a95dae1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '631debe232d244cd92df68c609a7f5c8', 'request_id': 'req-6a575f62-cf02-4b6d-82ad-5311a95dae1e'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:21.327626 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-6a575f62-cf02-4b6d-82ad-5311a95dae1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '631debe232d244cd92df68c609a7f5c8', 'request_id': 'req-6a575f62-cf02-4b6d-82ad-5311a95dae1e'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:21.339314 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-6a575f62-cf02-4b6d-82ad-5311a95dae1e admin admin] The token cache is being invalidate because project 631debe232d244cd92df68c609a7f5c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:29:21.339631 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-6a575f62-cf02-4b6d-82ad-5311a95dae1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:21.340271 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-6a575f62-cf02-4b6d-82ad-5311a95dae1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:21.341844 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1026/2054] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:29:21 2022] DELETE /identity/v3/projects/631debe232d244cd92df68c609a7f5c8 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:29:21.346839 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4234d0af-5a8b-4082-b39a-841da4ee97db None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:21.347327 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4234d0af-5a8b-4082-b39a-841da4ee97db None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:21.347415 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4234d0af-5a8b-4082-b39a-841da4ee97db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:21.366283 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-4234d0af-5a8b-4082-b39a-841da4ee97db None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:29:21.367539 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-4234d0af-5a8b-4082-b39a-841da4ee97db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:21.429702 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1029/2055] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:29:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:29:21.438799 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b279bd59-da8b-49fe-81dc-39edfe378387 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:21.439122 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b279bd59-da8b-49fe-81dc-39edfe378387 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:21.439354 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b279bd59-da8b-49fe-81dc-39edfe378387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:21.458988 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-b279bd59-da8b-49fe-81dc-39edfe378387 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:29:21.460236 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-b279bd59-da8b-49fe-81dc-39edfe378387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:21.468954 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1027/2056] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:29:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:29:21.473339 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4234d0af-5a8b-4082-b39a-841da4ee97db None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:21.483679 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4234d0af-5a8b-4082-b39a-841da4ee97db None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:21.492540 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d32a516-ef98-489e-aab7-812291b3676e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:21.493350 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32a516-ef98-489e-aab7-812291b3676e admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:21.493639 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32a516-ef98-489e-aab7-812291b3676e admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:21.493916 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32a516-ef98-489e-aab7-812291b3676e admin admin] PATH_INFO: `/v3/domains` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:21.494650 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d32a516-ef98-489e-aab7-812291b3676e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:29:21.495078 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d32a516-ef98-489e-aab7-812291b3676e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:21.496913 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d32a516-ef98-489e-aab7-812291b3676e admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:21.509488 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1030/2057] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Mar 30 01:29:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:29:21.514481 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b279bd59-da8b-49fe-81dc-39edfe378387 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:21.528586 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b279bd59-da8b-49fe-81dc-39edfe378387 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:21.529409 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff087997-5dca-4249-be9c-35c1c7292a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:21.530014 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff087997-5dca-4249-be9c-35c1c7292a24 admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:21.530301 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff087997-5dca-4249-be9c-35c1c7292a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:21.530575 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff087997-5dca-4249-be9c-35c1c7292a24 admin admin] PATH_INFO: `/v3/projects` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:21.531313 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff087997-5dca-4249-be9c-35c1c7292a24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:21.533478 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff087997-5dca-4249-be9c-35c1c7292a24 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:21.559279 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1028/2058] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:29:21 2022] POST /identity/v3/projects => generated 367 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 01:29:21.563335 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d32a516-ef98-489e-aab7-812291b3676e admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:21.574086 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d32a516-ef98-489e-aab7-812291b3676e admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:21.632028 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7aad7-7429-4698-9730-56816cfcf694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:21.632707 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7aad7-7429-4698-9730-56816cfcf694 admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:21.632987 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7aad7-7429-4698-9730-56816cfcf694 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:21.633262 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7aad7-7429-4698-9730-56816cfcf694 admin admin] PATH_INFO: `/v3/users` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:21.633951 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d7aad7-7429-4698-9730-56816cfcf694 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:21.636500 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d7aad7-7429-4698-9730-56816cfcf694 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:21.669889 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff087997-5dca-4249-be9c-35c1c7292a24 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:21.670123 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1031/2059] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:29:21 2022] POST /identity/v3/users => generated 284 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:29:21.682162 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff087997-5dca-4249-be9c-35c1c7292a24 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:21.687531 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6385f90-e3b7-40ab-b5f6-b006010375d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:21.688327 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6385f90-e3b7-40ab-b5f6-b006010375d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:21.688713 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6385f90-e3b7-40ab-b5f6-b006010375d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:21.689317 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6385f90-e3b7-40ab-b5f6-b006010375d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:21.689890 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6385f90-e3b7-40ab-b5f6-b006010375d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:21.691598 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6385f90-e3b7-40ab-b5f6-b006010375d9 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:21.705300 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1029/2060] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:29:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 01:29:21.706516 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7aad7-7429-4698-9730-56816cfcf694 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:21.717356 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7aad7-7429-4698-9730-56816cfcf694 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:21.722593 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd91c701-7acc-4ebf-9a0e-0d4f241fe26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:21.726565 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd91c701-7acc-4ebf-9a0e-0d4f241fe26a admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:21.726565 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd91c701-7acc-4ebf-9a0e-0d4f241fe26a admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:21.726565 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd91c701-7acc-4ebf-9a0e-0d4f241fe26a admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:21.726565 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd91c701-7acc-4ebf-9a0e-0d4f241fe26a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:21.727108 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd91c701-7acc-4ebf-9a0e-0d4f241fe26a admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:21.738169 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1032/2061] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:29:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:29:21.742269 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6385f90-e3b7-40ab-b5f6-b006010375d9 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:21.752771 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6385f90-e3b7-40ab-b5f6-b006010375d9 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:21.757443 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c30d7df-5bca-46bb-bba9-9afaca74805e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:21.758342 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30d7df-5bca-46bb-bba9-9afaca74805e admin admin] REQUEST_METHOD: `PUT` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:21.758920 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30d7df-5bca-46bb-bba9-9afaca74805e admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:21.760751 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30d7df-5bca-46bb-bba9-9afaca74805e admin admin] PATH_INFO: `/v3/projects/87d2e84a1b614ef3aaa4f2b201a14d75/users/255dcd0cc9374699b1c518ec0aa615c4/roles/7185d0cfbcd44502b1613bcfe1b42f6f` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:21.775085 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c30d7df-5bca-46bb-bba9-9afaca74805e admin admin] RBAC: Authorizing `identity:create_grant(project_id=87d2e84a1b614ef3aaa4f2b201a14d75, user_id=255dcd0cc9374699b1c518ec0aa615c4, role_id=7185d0cfbcd44502b1613bcfe1b42f6f)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:21.778413 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c30d7df-5bca-46bb-bba9-9afaca74805e admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:21.797585 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1030/2062] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:29:21 2022] PUT /identity/v3/projects/87d2e84a1b614ef3aaa4f2b201a14d75/users/255dcd0cc9374699b1c518ec0aa615c4/roles/7185d0cfbcd44502b1613bcfe1b42f6f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:29:21.808185 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f18fb-8b01-4da8-9d28-aea72488fe1c None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:21.808467 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f18fb-8b01-4da8-9d28-aea72488fe1c None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:21.808743 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f18fb-8b01-4da8-9d28-aea72488fe1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:21.835524 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-289f18fb-8b01-4da8-9d28-aea72488fe1c None None] MFA Rules not processed for user `255dcd0cc9374699b1c518ec0aa615c4`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:29:21.836739 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-289f18fb-8b01-4da8-9d28-aea72488fe1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:21.901619 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1033/2063] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:29:21 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:29:21.906103 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c30d7df-5bca-46bb-bba9-9afaca74805e admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:21.947340 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289f18fb-8b01-4da8-9d28-aea72488fe1c None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:21.948940 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-289f18fb-8b01-4da8-9d28-aea72488fe1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:21.971333 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c30d7df-5bca-46bb-bba9-9afaca74805e admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:21.976063 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebf3fbe-0eae-4c8d-8f11-e7a1300b0e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:21.976656 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf3fbe-0eae-4c8d-8f11-e7a1300b0e11 admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:21.976934 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf3fbe-0eae-4c8d-8f11-e7a1300b0e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:21.977206 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf3fbe-0eae-4c8d-8f11-e7a1300b0e11 admin admin] PATH_INFO: `/v3/projects` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:21.977888 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebf3fbe-0eae-4c8d-8f11-e7a1300b0e11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:21.979907 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebf3fbe-0eae-4c8d-8f11-e7a1300b0e11 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:22.017556 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1031/2064] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:29:21 2022] POST /identity/v3/projects => generated 367 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:29:22.018496 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebf3fbe-0eae-4c8d-8f11-e7a1300b0e11 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:22.019914 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289f18fb-8b01-4da8-9d28-aea72488fe1c None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:22.074811 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74d6ac4-30c5-4968-b379-5089dbd5aac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:22.075695 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74d6ac4-30c5-4968-b379-5089dbd5aac7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:22.075979 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74d6ac4-30c5-4968-b379-5089dbd5aac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:22.076264 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74d6ac4-30c5-4968-b379-5089dbd5aac7 admin admin] PATH_INFO: `/v3/users/574059a5681a4b5fb94b96d225008207` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:22.077470 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74d6ac4-30c5-4968-b379-5089dbd5aac7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=574059a5681a4b5fb94b96d225008207)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:22.079478 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74d6ac4-30c5-4968-b379-5089dbd5aac7 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:22.081048 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebf3fbe-0eae-4c8d-8f11-e7a1300b0e11 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:22.086124 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1374fb5c-2952-4402-8d75-9a4955bf5067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:22.086949 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1374fb5c-2952-4402-8d75-9a4955bf5067 admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:22.087230 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1374fb5c-2952-4402-8d75-9a4955bf5067 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:22.087529 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1374fb5c-2952-4402-8d75-9a4955bf5067 admin admin] PATH_INFO: `/v3/users` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:22.088246 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1374fb5c-2952-4402-8d75-9a4955bf5067 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:22.090169 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1374fb5c-2952-4402-8d75-9a4955bf5067 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:22.112128 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1032/2065] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:29:22 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 01:29:22.116072 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1374fb5c-2952-4402-8d75-9a4955bf5067 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:22.126779 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1374fb5c-2952-4402-8d75-9a4955bf5067 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:22.128697 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-a74d6ac4-30c5-4968-b379-5089dbd5aac7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '574059a5681a4b5fb94b96d225008207'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:22.131673 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6728a27f-3e8f-4edf-a6eb-0fb3c3dde9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:22.132421 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728a27f-3e8f-4edf-a6eb-0fb3c3dde9fe admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:22.132772 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728a27f-3e8f-4edf-a6eb-0fb3c3dde9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:22.133099 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728a27f-3e8f-4edf-a6eb-0fb3c3dde9fe admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:22.134033 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6728a27f-3e8f-4edf-a6eb-0fb3c3dde9fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:22.136417 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-a74d6ac4-30c5-4968-b379-5089dbd5aac7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '574059a5681a4b5fb94b96d225008207'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:22.136534 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6728a27f-3e8f-4edf-a6eb-0fb3c3dde9fe admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:22.137058 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-a74d6ac4-30c5-4968-b379-5089dbd5aac7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '574059a5681a4b5fb94b96d225008207'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:22.143731 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-a74d6ac4-30c5-4968-b379-5089dbd5aac7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '574059a5681a4b5fb94b96d225008207'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:22.146366 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1033/2066] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:29:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 01:29:22.151465 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6728a27f-3e8f-4edf-a6eb-0fb3c3dde9fe admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:22.153125 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-6728a27f-3e8f-4edf-a6eb-0fb3c3dde9fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:22.155897 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-a74d6ac4-30c5-4968-b379-5089dbd5aac7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '574059a5681a4b5fb94b96d225008207'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:22.162055 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1034/2067] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:29:21 2022] DELETE /identity/v3/users/574059a5681a4b5fb94b96d225008207 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:29:22.165664 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6728a27f-3e8f-4edf-a6eb-0fb3c3dde9fe admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:22.222576 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1927d4-1385-4a13-8b68-bb560aaaf322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:22.223321 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1927d4-1385-4a13-8b68-bb560aaaf322 admin admin] REQUEST_METHOD: `PUT` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:22.223446 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1927d4-1385-4a13-8b68-bb560aaaf322 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:22.223716 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1927d4-1385-4a13-8b68-bb560aaaf322 admin admin] PATH_INFO: `/v3/projects/d76020e785494b67bd170b166f1a37a4/users/b37df174612049b883cf67141b8f583a/roles/36909bbf31d04993bb2a9fe587b572dc` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:22.239703 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1927d4-1385-4a13-8b68-bb560aaaf322 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d76020e785494b67bd170b166f1a37a4, user_id=b37df174612049b883cf67141b8f583a, role_id=36909bbf31d04993bb2a9fe587b572dc)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:22.243449 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1927d4-1385-4a13-8b68-bb560aaaf322 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:22.257732 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1034/2068] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:29:22 2022] PUT /identity/v3/projects/d76020e785494b67bd170b166f1a37a4/users/b37df174612049b883cf67141b8f583a/roles/36909bbf31d04993bb2a9fe587b572dc => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:29:22.262264 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74d6ac4-30c5-4968-b379-5089dbd5aac7 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:22.272585 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74d6ac4-30c5-4968-b379-5089dbd5aac7 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:22.329952 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595d6f8c-dd3e-46d1-8d3f-cffa5e5cc014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:22.330629 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d6f8c-dd3e-46d1-8d3f-cffa5e5cc014 admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:22.330945 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d6f8c-dd3e-46d1-8d3f-cffa5e5cc014 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:22.331353 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d6f8c-dd3e-46d1-8d3f-cffa5e5cc014 admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:22.332102 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595d6f8c-dd3e-46d1-8d3f-cffa5e5cc014 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:22.333734 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595d6f8c-dd3e-46d1-8d3f-cffa5e5cc014 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:22.347302 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1035/2069] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:29:22 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 01:29:22.348617 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1927d4-1385-4a13-8b68-bb560aaaf322 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:22.359155 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1927d4-1385-4a13-8b68-bb560aaaf322 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:22.363963 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906942e3-ba5b-4499-8e19-ea42f622266d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:22.364867 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906942e3-ba5b-4499-8e19-ea42f622266d admin admin] REQUEST_METHOD: `PUT` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:22.365153 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906942e3-ba5b-4499-8e19-ea42f622266d admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:22.365464 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906942e3-ba5b-4499-8e19-ea42f622266d admin admin] PATH_INFO: `/v3/projects/d76020e785494b67bd170b166f1a37a4/users/b37df174612049b883cf67141b8f583a/roles/36909bbf31d04993bb2a9fe587b572dc` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:22.367472 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906942e3-ba5b-4499-8e19-ea42f622266d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d76020e785494b67bd170b166f1a37a4, user_id=b37df174612049b883cf67141b8f583a, role_id=36909bbf31d04993bb2a9fe587b572dc)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:22.370789 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906942e3-ba5b-4499-8e19-ea42f622266d admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:22.381524 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1035/2070] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:29:22 2022] PUT /identity/v3/projects/d76020e785494b67bd170b166f1a37a4/users/b37df174612049b883cf67141b8f583a/roles/36909bbf31d04993bb2a9fe587b572dc => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:29:22.393392 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2572c5-a94d-49c2-ad6e-e937edd7eb76 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:22.393835 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2572c5-a94d-49c2-ad6e-e937edd7eb76 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:22.394116 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2572c5-a94d-49c2-ad6e-e937edd7eb76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:22.423117 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906942e3-ba5b-4499-8e19-ea42f622266d admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:22.423117 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-906942e3-ba5b-4499-8e19-ea42f622266d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:22.424717 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-8a2572c5-a94d-49c2-ad6e-e937edd7eb76 None None] MFA Rules not processed for user `b37df174612049b883cf67141b8f583a`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:29:22.426003 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-8a2572c5-a94d-49c2-ad6e-e937edd7eb76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:22.494816 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1036/2071] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:29:22 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:29:22.499967 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906942e3-ba5b-4499-8e19-ea42f622266d admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:22.504966 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c05306-4d53-4640-8ed6-978bfbc37585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:22.505823 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c05306-4d53-4640-8ed6-978bfbc37585 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:22.506104 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c05306-4d53-4640-8ed6-978bfbc37585 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:22.506217 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2572c5-a94d-49c2-ad6e-e937edd7eb76 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:22.506377 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c05306-4d53-4640-8ed6-978bfbc37585 admin admin] PATH_INFO: `/v3/projects/b00d263070eb4c0fb3e061e848cc3988` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:22.507563 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-8a2572c5-a94d-49c2-ad6e-e937edd7eb76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:22.507667 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c05306-4d53-4640-8ed6-978bfbc37585 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b00d263070eb4c0fb3e061e848cc3988)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:22.509521 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c05306-4d53-4640-8ed6-978bfbc37585 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:22.559660 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-b5c05306-4d53-4640-8ed6-978bfbc37585 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b00d263070eb4c0fb3e061e848cc3988', 'request_id': 'req-b5c05306-4d53-4640-8ed6-978bfbc37585'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:22.571676 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2572c5-a94d-49c2-ad6e-e937edd7eb76 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:22.573361 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-b5c05306-4d53-4640-8ed6-978bfbc37585 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b00d263070eb4c0fb3e061e848cc3988', 'request_id': 'req-b5c05306-4d53-4640-8ed6-978bfbc37585'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:22.580270 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-b5c05306-4d53-4640-8ed6-978bfbc37585 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b00d263070eb4c0fb3e061e848cc3988', 'request_id': 'req-b5c05306-4d53-4640-8ed6-978bfbc37585'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:22.591565 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-b5c05306-4d53-4640-8ed6-978bfbc37585 admin admin] The token cache is being invalidate because project b00d263070eb4c0fb3e061e848cc3988 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:29:22.591853 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-b5c05306-4d53-4640-8ed6-978bfbc37585 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:22.592505 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-b5c05306-4d53-4640-8ed6-978bfbc37585 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:22.594036 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1036/2072] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:29:22 2022] DELETE /identity/v3/projects/b00d263070eb4c0fb3e061e848cc3988 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:29:22.597807 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c05306-4d53-4640-8ed6-978bfbc37585 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:22.599282 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-b5c05306-4d53-4640-8ed6-978bfbc37585 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:22.622930 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b81cabf-fbb7-4a23-ac24-b5b836234010 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45219f386f0147b6bd380efe4ab62812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:22.623582 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b81cabf-fbb7-4a23-ac24-b5b836234010 service cinder] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:22.623866 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b81cabf-fbb7-4a23-ac24-b5b836234010 service cinder] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:22.624143 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b81cabf-fbb7-4a23-ac24-b5b836234010 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:22.626018 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-3b81cabf-fbb7-4a23-ac24-b5b836234010 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:22.662687 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c05306-4d53-4640-8ed6-978bfbc37585 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:22.667833 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f5d45e-8cf8-4c28-a622-68659fc96d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:22.668696 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f5d45e-8cf8-4c28-a622-68659fc96d1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:22.668982 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f5d45e-8cf8-4c28-a622-68659fc96d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:22.669428 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f5d45e-8cf8-4c28-a622-68659fc96d1c admin admin] PATH_INFO: `/v3/users/917680493385420e815b5f0eb346c9ad` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:22.670642 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f5d45e-8cf8-4c28-a622-68659fc96d1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=917680493385420e815b5f0eb346c9ad)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:22.672599 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f5d45e-8cf8-4c28-a622-68659fc96d1c admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:22.691027 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b81cabf-fbb7-4a23-ac24-b5b836234010 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:22.692627 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b81cabf-fbb7-4a23-ac24-b5b836234010 service cinder] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:22.702928 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1037/2073] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:29:22 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 30 01:29:22.720402 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-b0f5d45e-8cf8-4c28-a622-68659fc96d1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '917680493385420e815b5f0eb346c9ad'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:22.733395 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-b0f5d45e-8cf8-4c28-a622-68659fc96d1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '917680493385420e815b5f0eb346c9ad'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:22.741490 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-b0f5d45e-8cf8-4c28-a622-68659fc96d1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '917680493385420e815b5f0eb346c9ad'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:22.742273 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-b0f5d45e-8cf8-4c28-a622-68659fc96d1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '917680493385420e815b5f0eb346c9ad'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:22.749960 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-b0f5d45e-8cf8-4c28-a622-68659fc96d1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '917680493385420e815b5f0eb346c9ad'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:22.755992 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1037/2074] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:29:22 2022] DELETE /identity/v3/users/917680493385420e815b5f0eb346c9ad => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:29:22.786423 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b81cabf-fbb7-4a23-ac24-b5b836234010 service cinder] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:22.787885 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-3b81cabf-fbb7-4a23-ac24-b5b836234010 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:22.798994 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b81cabf-fbb7-4a23-ac24-b5b836234010 service cinder] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:22.850965 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9eacd6-fcfd-4e43-b868-4145e319ed45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45219f386f0147b6bd380efe4ab62812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:22.851625 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9eacd6-fcfd-4e43-b868-4145e319ed45 service cinder] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:22.851907 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9eacd6-fcfd-4e43-b868-4145e319ed45 service cinder] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:22.852391 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9eacd6-fcfd-4e43-b868-4145e319ed45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:22.854936 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-ec9eacd6-fcfd-4e43-b868-4145e319ed45 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:22.914180 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9eacd6-fcfd-4e43-b868-4145e319ed45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:22.915682 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9eacd6-fcfd-4e43-b868-4145e319ed45 service cinder] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:22.925333 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1038/2075] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:29:22 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:29:22.982803 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f5d45e-8cf8-4c28-a622-68659fc96d1c admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:22.985260 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-b0f5d45e-8cf8-4c28-a622-68659fc96d1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:23.061564 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f5d45e-8cf8-4c28-a622-68659fc96d1c admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:23.066353 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe09631-0590-4821-8c16-e584abe4fb65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:23.067955 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe09631-0590-4821-8c16-e584abe4fb65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:23.068453 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe09631-0590-4821-8c16-e584abe4fb65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:23.068805 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe09631-0590-4821-8c16-e584abe4fb65 admin admin] PATH_INFO: `/v3/projects/236b655f2d6b4792980739e2293b0b66` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:23.070053 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe09631-0590-4821-8c16-e584abe4fb65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=236b655f2d6b4792980739e2293b0b66)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:23.074119 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe09631-0590-4821-8c16-e584abe4fb65 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:23.129381 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-3fe09631-0590-4821-8c16-e584abe4fb65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '236b655f2d6b4792980739e2293b0b66', 'request_id': 'req-3fe09631-0590-4821-8c16-e584abe4fb65'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:23.137387 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-3fe09631-0590-4821-8c16-e584abe4fb65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '236b655f2d6b4792980739e2293b0b66', 'request_id': 'req-3fe09631-0590-4821-8c16-e584abe4fb65'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:23.143230 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-3fe09631-0590-4821-8c16-e584abe4fb65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '236b655f2d6b4792980739e2293b0b66', 'request_id': 'req-3fe09631-0590-4821-8c16-e584abe4fb65'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:23.157514 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-3fe09631-0590-4821-8c16-e584abe4fb65 admin admin] The token cache is being invalidate because project 236b655f2d6b4792980739e2293b0b66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:29:23.157961 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-3fe09631-0590-4821-8c16-e584abe4fb65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:23.158789 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-3fe09631-0590-4821-8c16-e584abe4fb65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:23.160597 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1038/2076] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:29:22 2022] DELETE /identity/v3/projects/236b655f2d6b4792980739e2293b0b66 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:29:23.165631 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842cd68-4942-4822-9eb3-ceed0f47cf92 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:23.166015 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842cd68-4942-4822-9eb3-ceed0f47cf92 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:23.166472 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842cd68-4942-4822-9eb3-ceed0f47cf92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:23.188215 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-e842cd68-4942-4822-9eb3-ceed0f47cf92 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:29:23.189899 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-e842cd68-4942-4822-9eb3-ceed0f47cf92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:23.278891 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1039/2077] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:29:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:29:23.287095 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d721f-05aa-412f-b23c-9e63c1bdbbfb None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:23.287598 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d721f-05aa-412f-b23c-9e63c1bdbbfb None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:23.287677 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d721f-05aa-412f-b23c-9e63c1bdbbfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:23.309500 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-b69d721f-05aa-412f-b23c-9e63c1bdbbfb None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:29:23.310946 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-b69d721f-05aa-412f-b23c-9e63c1bdbbfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:23.318792 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1039/2078] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:29:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 01:29:23.323353 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e842cd68-4942-4822-9eb3-ceed0f47cf92 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:23.333618 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e842cd68-4942-4822-9eb3-ceed0f47cf92 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:23.339161 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71cbf79-d5a4-4105-bb26-73b572839682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:23.339820 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71cbf79-d5a4-4105-bb26-73b572839682 admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:23.340106 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71cbf79-d5a4-4105-bb26-73b572839682 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:23.340387 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71cbf79-d5a4-4105-bb26-73b572839682 admin admin] PATH_INFO: `/v3/domains` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:23.341112 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71cbf79-d5a4-4105-bb26-73b572839682 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:29:23.341420 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71cbf79-d5a4-4105-bb26-73b572839682 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:23.343669 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71cbf79-d5a4-4105-bb26-73b572839682 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:23.356274 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1040/2079] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Mar 30 01:29:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:29:23.361178 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69d721f-05aa-412f-b23c-9e63c1bdbbfb None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:23.370647 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69d721f-05aa-412f-b23c-9e63c1bdbbfb None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:23.376634 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eab596-fb7c-4fa5-a04d-4c223f9fb485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:23.377380 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eab596-fb7c-4fa5-a04d-4c223f9fb485 admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:23.377667 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eab596-fb7c-4fa5-a04d-4c223f9fb485 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:23.377940 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eab596-fb7c-4fa5-a04d-4c223f9fb485 admin admin] PATH_INFO: `/v3/projects` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:23.378627 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eab596-fb7c-4fa5-a04d-4c223f9fb485 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:23.380588 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eab596-fb7c-4fa5-a04d-4c223f9fb485 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:23.410737 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1040/2080] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:29:23 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 01:29:23.412248 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71cbf79-d5a4-4105-bb26-73b572839682 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:23.422507 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71cbf79-d5a4-4105-bb26-73b572839682 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:23.487689 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6d1e3c-10f5-4e63-bc8b-3fab80f46a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:23.488400 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d1e3c-10f5-4e63-bc8b-3fab80f46a18 admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:23.488680 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d1e3c-10f5-4e63-bc8b-3fab80f46a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:23.488952 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d1e3c-10f5-4e63-bc8b-3fab80f46a18 admin admin] PATH_INFO: `/v3/users` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:23.489658 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6d1e3c-10f5-4e63-bc8b-3fab80f46a18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:23.491776 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6d1e3c-10f5-4e63-bc8b-3fab80f46a18 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:23.515580 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1041/2081] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:29:23 2022] POST /identity/v3/users => generated 288 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:29:23.519565 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eab596-fb7c-4fa5-a04d-4c223f9fb485 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:23.531770 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eab596-fb7c-4fa5-a04d-4c223f9fb485 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:23.539013 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7813ccf0-400c-40eb-a19e-71db13c7804c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:23.540551 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7813ccf0-400c-40eb-a19e-71db13c7804c admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:23.540899 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7813ccf0-400c-40eb-a19e-71db13c7804c admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:23.541245 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7813ccf0-400c-40eb-a19e-71db13c7804c admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:23.541988 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7813ccf0-400c-40eb-a19e-71db13c7804c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:23.543977 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7813ccf0-400c-40eb-a19e-71db13c7804c admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:23.558742 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1041/2082] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:29:23 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:29:23.561350 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6d1e3c-10f5-4e63-bc8b-3fab80f46a18 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:23.574311 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6d1e3c-10f5-4e63-bc8b-3fab80f46a18 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:23.580534 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d612bd76-7c24-41b8-b566-9394a9bdb364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:23.581168 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612bd76-7c24-41b8-b566-9394a9bdb364 admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:23.581451 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612bd76-7c24-41b8-b566-9394a9bdb364 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:23.582063 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612bd76-7c24-41b8-b566-9394a9bdb364 admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:23.583102 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d612bd76-7c24-41b8-b566-9394a9bdb364 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:23.584705 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d612bd76-7c24-41b8-b566-9394a9bdb364 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:23.608275 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1042/2083] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:29:23 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:29:23.612201 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7813ccf0-400c-40eb-a19e-71db13c7804c admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:23.624182 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7813ccf0-400c-40eb-a19e-71db13c7804c admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:23.629049 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e1623-5780-43cf-a60f-29e2f3af7262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:23.629975 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e1623-5780-43cf-a60f-29e2f3af7262 admin admin] REQUEST_METHOD: `PUT` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:23.630261 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e1623-5780-43cf-a60f-29e2f3af7262 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:23.630530 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e1623-5780-43cf-a60f-29e2f3af7262 admin admin] PATH_INFO: `/v3/projects/53a1b9f40b964fe9a0ac930a8a328d53/users/ae04b1a8847045f0ac2a5238853eb14e/roles/7185d0cfbcd44502b1613bcfe1b42f6f` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:23.650280 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519e1623-5780-43cf-a60f-29e2f3af7262 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53a1b9f40b964fe9a0ac930a8a328d53, user_id=ae04b1a8847045f0ac2a5238853eb14e, role_id=7185d0cfbcd44502b1613bcfe1b42f6f)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:23.654433 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519e1623-5780-43cf-a60f-29e2f3af7262 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:23.673341 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1042/2084] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:29:23 2022] PUT /identity/v3/projects/53a1b9f40b964fe9a0ac930a8a328d53/users/ae04b1a8847045f0ac2a5238853eb14e/roles/7185d0cfbcd44502b1613bcfe1b42f6f => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:29:23.683244 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46976efc-3f63-4b12-809b-2b474d8ed1e3 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:23.683545 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46976efc-3f63-4b12-809b-2b474d8ed1e3 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:23.683832 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46976efc-3f63-4b12-809b-2b474d8ed1e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:23.714043 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-46976efc-3f63-4b12-809b-2b474d8ed1e3 None None] MFA Rules not processed for user `ae04b1a8847045f0ac2a5238853eb14e`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:29:23.715448 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-46976efc-3f63-4b12-809b-2b474d8ed1e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:23.785034 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1043/2085] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:29:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:29:23.798074 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e1623-5780-43cf-a60f-29e2f3af7262 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:23.800534 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-519e1623-5780-43cf-a60f-29e2f3af7262 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:23.861864 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e1623-5780-43cf-a60f-29e2f3af7262 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:23.865704 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228753a2-64e8-4b96-9dd6-717130aa2f09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45219f386f0147b6bd380efe4ab62812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:23.866403 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228753a2-64e8-4b96-9dd6-717130aa2f09 service cinder] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:23.866686 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228753a2-64e8-4b96-9dd6-717130aa2f09 service cinder] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:23.867021 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228753a2-64e8-4b96-9dd6-717130aa2f09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:23.878571 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228753a2-64e8-4b96-9dd6-717130aa2f09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:23.880325 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228753a2-64e8-4b96-9dd6-717130aa2f09 service cinder] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:23.891196 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1043/2086] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:29:23 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:29:28.959916 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46976efc-3f63-4b12-809b-2b474d8ed1e3 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:28.961479 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-46976efc-3f63-4b12-809b-2b474d8ed1e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:29.028886 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46976efc-3f63-4b12-809b-2b474d8ed1e3 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:29.035148 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e65f4f-91af-49ee-9f6a-348392e65941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:29.035886 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228753a2-64e8-4b96-9dd6-717130aa2f09 service cinder] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:29.036344 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e65f4f-91af-49ee-9f6a-348392e65941 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:29.036344 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e65f4f-91af-49ee-9f6a-348392e65941 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:29.036571 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e65f4f-91af-49ee-9f6a-348392e65941 admin admin] PATH_INFO: `/v3/users/698cb8225be54209a2f9bdccc51f0189` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:29.037765 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e65f4f-91af-49ee-9f6a-348392e65941 admin admin] RBAC: Authorizing `identity:delete_user(user_id=698cb8225be54209a2f9bdccc51f0189)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:29.039744 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e65f4f-91af-49ee-9f6a-348392e65941 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:29.047253 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228753a2-64e8-4b96-9dd6-717130aa2f09 service cinder] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:29.051841 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671e91fb-44a7-4989-bf64-a551a67dcee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:29.052695 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e91fb-44a7-4989-bf64-a551a67dcee7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:29.052980 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e91fb-44a7-4989-bf64-a551a67dcee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:29.053262 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e91fb-44a7-4989-bf64-a551a67dcee7 admin admin] PATH_INFO: `/v3/users/ae04b1a8847045f0ac2a5238853eb14e` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:29.054769 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671e91fb-44a7-4989-bf64-a551a67dcee7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae04b1a8847045f0ac2a5238853eb14e)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:29.057296 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671e91fb-44a7-4989-bf64-a551a67dcee7 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:29.104700 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-99e65f4f-91af-49ee-9f6a-348392e65941 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '698cb8225be54209a2f9bdccc51f0189'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:29.115981 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-99e65f4f-91af-49ee-9f6a-348392e65941 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '698cb8225be54209a2f9bdccc51f0189'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:29.116876 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-99e65f4f-91af-49ee-9f6a-348392e65941 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '698cb8225be54209a2f9bdccc51f0189'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:29.117354 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-671e91fb-44a7-4989-bf64-a551a67dcee7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae04b1a8847045f0ac2a5238853eb14e'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:29.127018 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-99e65f4f-91af-49ee-9f6a-348392e65941 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '698cb8225be54209a2f9bdccc51f0189'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:29.131823 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-671e91fb-44a7-4989-bf64-a551a67dcee7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae04b1a8847045f0ac2a5238853eb14e'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:29.140467 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-99e65f4f-91af-49ee-9f6a-348392e65941 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '698cb8225be54209a2f9bdccc51f0189'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:29.142615 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-671e91fb-44a7-4989-bf64-a551a67dcee7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae04b1a8847045f0ac2a5238853eb14e'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:29.143687 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-671e91fb-44a7-4989-bf64-a551a67dcee7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae04b1a8847045f0ac2a5238853eb14e'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:29.147911 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1044/2087] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:29:28 2022] DELETE /identity/v3/users/698cb8225be54209a2f9bdccc51f0189 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:29:29.153458 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009c916-9e2b-439f-a2c7-e2a6fd178124 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:29.153772 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009c916-9e2b-439f-a2c7-e2a6fd178124 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:29.154055 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009c916-9e2b-439f-a2c7-e2a6fd178124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:29.155822 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-671e91fb-44a7-4989-bf64-a551a67dcee7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae04b1a8847045f0ac2a5238853eb14e'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:29.162682 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1044/2088] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:29:29 2022] DELETE /identity/v3/users/ae04b1a8847045f0ac2a5238853eb14e => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:29:29.169689 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc74befe-1f69-4e2e-b195-fdf645252626 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:29.169988 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc74befe-1f69-4e2e-b195-fdf645252626 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:29.170585 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc74befe-1f69-4e2e-b195-fdf645252626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:29.176488 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-b009c916-9e2b-439f-a2c7-e2a6fd178124 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:29:29.177744 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-b009c916-9e2b-439f-a2c7-e2a6fd178124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:29.201598 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-fc74befe-1f69-4e2e-b195-fdf645252626 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:29:29.203285 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-fc74befe-1f69-4e2e-b195-fdf645252626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:29.276466 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1045/2089] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:29:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:29:29.285058 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1045/2090] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:29:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:29:29.296660 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009c916-9e2b-439f-a2c7-e2a6fd178124 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:29.296845 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc74befe-1f69-4e2e-b195-fdf645252626 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:29.299159 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-fc74befe-1f69-4e2e-b195-fdf645252626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:29.299315 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-b009c916-9e2b-439f-a2c7-e2a6fd178124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:29.375134 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc74befe-1f69-4e2e-b195-fdf645252626 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:29.380704 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da121354-c4a9-4164-ba37-c8bd9f480e62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:29.381578 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da121354-c4a9-4164-ba37-c8bd9f480e62 service neutron] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:29.381866 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da121354-c4a9-4164-ba37-c8bd9f480e62 service neutron] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:29.382146 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da121354-c4a9-4164-ba37-c8bd9f480e62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:29.388573 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009c916-9e2b-439f-a2c7-e2a6fd178124 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:29.393571 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da121354-c4a9-4164-ba37-c8bd9f480e62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:29.393743 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a71ee6-4d2e-448d-88dd-3af5818cecc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:29.394452 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a71ee6-4d2e-448d-88dd-3af5818cecc0 service neutron] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:29.394916 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a71ee6-4d2e-448d-88dd-3af5818cecc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:29.395087 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da121354-c4a9-4164-ba37-c8bd9f480e62 service neutron] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:29.395325 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a71ee6-4d2e-448d-88dd-3af5818cecc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:29.406740 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1046/2091] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:29:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:29:29.409203 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a71ee6-4d2e-448d-88dd-3af5818cecc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:29.410816 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a71ee6-4d2e-448d-88dd-3af5818cecc0 service neutron] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:29.423967 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1046/2092] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:29:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:29:29.809059 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da121354-c4a9-4164-ba37-c8bd9f480e62 service neutron] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:29.811022 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-da121354-c4a9-4164-ba37-c8bd9f480e62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:29.852603 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da121354-c4a9-4164-ba37-c8bd9f480e62 service neutron] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:29.868069 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367cb614-d788-4928-bb63-ad52d52e5be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:29.870055 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367cb614-d788-4928-bb63-ad52d52e5be4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:29.870562 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367cb614-d788-4928-bb63-ad52d52e5be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:29.870756 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367cb614-d788-4928-bb63-ad52d52e5be4 admin admin] PATH_INFO: `/v3/projects/53a1b9f40b964fe9a0ac930a8a328d53` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:29.877900 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367cb614-d788-4928-bb63-ad52d52e5be4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53a1b9f40b964fe9a0ac930a8a328d53)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:29.878229 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a71ee6-4d2e-448d-88dd-3af5818cecc0 service neutron] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:29.880348 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-19a71ee6-4d2e-448d-88dd-3af5818cecc0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:29.880603 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367cb614-d788-4928-bb63-ad52d52e5be4 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:29.909805 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a71ee6-4d2e-448d-88dd-3af5818cecc0 service neutron] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:29.940579 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d4a05f-191e-42c2-be40-73788b444274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:29.941716 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4a05f-191e-42c2-be40-73788b444274 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:29.942007 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4a05f-191e-42c2-be40-73788b444274 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:29.942308 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4a05f-191e-42c2-be40-73788b444274 admin admin] PATH_INFO: `/v3/users/255dcd0cc9374699b1c518ec0aa615c4` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:29.943750 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d4a05f-191e-42c2-be40-73788b444274 admin admin] RBAC: Authorizing `identity:delete_user(user_id=255dcd0cc9374699b1c518ec0aa615c4)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:29.945615 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d4a05f-191e-42c2-be40-73788b444274 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:29.977010 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-367cb614-d788-4928-bb63-ad52d52e5be4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53a1b9f40b964fe9a0ac930a8a328d53', 'request_id': 'req-367cb614-d788-4928-bb63-ad52d52e5be4'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:29.989581 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-367cb614-d788-4928-bb63-ad52d52e5be4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53a1b9f40b964fe9a0ac930a8a328d53', 'request_id': 'req-367cb614-d788-4928-bb63-ad52d52e5be4'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:29.997889 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-367cb614-d788-4928-bb63-ad52d52e5be4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53a1b9f40b964fe9a0ac930a8a328d53', 'request_id': 'req-367cb614-d788-4928-bb63-ad52d52e5be4'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:30.007397 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-03d4a05f-191e-42c2-be40-73788b444274 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '255dcd0cc9374699b1c518ec0aa615c4'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:30.014766 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-367cb614-d788-4928-bb63-ad52d52e5be4 admin admin] The token cache is being invalidate because project 53a1b9f40b964fe9a0ac930a8a328d53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:29:30.015095 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-367cb614-d788-4928-bb63-ad52d52e5be4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:30.015766 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-367cb614-d788-4928-bb63-ad52d52e5be4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:30.018581 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-03d4a05f-191e-42c2-be40-73788b444274 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '255dcd0cc9374699b1c518ec0aa615c4'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:30.019296 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-03d4a05f-191e-42c2-be40-73788b444274 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '255dcd0cc9374699b1c518ec0aa615c4'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:30.020974 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1047/2093] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:29:29 2022] DELETE /identity/v3/projects/53a1b9f40b964fe9a0ac930a8a328d53 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:29:30.021827 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367cb614-d788-4928-bb63-ad52d52e5be4 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:30.023203 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-367cb614-d788-4928-bb63-ad52d52e5be4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:30.028267 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-03d4a05f-191e-42c2-be40-73788b444274 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '255dcd0cc9374699b1c518ec0aa615c4'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:30.043863 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-03d4a05f-191e-42c2-be40-73788b444274 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '255dcd0cc9374699b1c518ec0aa615c4'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:30.060492 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1047/2094] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:29:29 2022] DELETE /identity/v3/users/255dcd0cc9374699b1c518ec0aa615c4 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:29:30.060492 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236e7df-2fce-4292-84cc-f2c43a85c25d None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:30.060492 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236e7df-2fce-4292-84cc-f2c43a85c25d None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:30.060492 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236e7df-2fce-4292-84cc-f2c43a85c25d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:30.075231 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-5236e7df-2fce-4292-84cc-f2c43a85c25d None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:29:30.076570 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-5236e7df-2fce-4292-84cc-f2c43a85c25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:30.095020 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367cb614-d788-4928-bb63-ad52d52e5be4 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:30.141307 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1048/2095] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:29:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:29:30.149729 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979d8a5-7caa-4cdb-b93c-4da763700e01 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:30.150054 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979d8a5-7caa-4cdb-b93c-4da763700e01 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:30.150479 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979d8a5-7caa-4cdb-b93c-4da763700e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:30.157921 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39944c2b-1f68-4a88-a417-72f9ddc4f353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:30.158810 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39944c2b-1f68-4a88-a417-72f9ddc4f353 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:30.159096 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39944c2b-1f68-4a88-a417-72f9ddc4f353 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:30.159374 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39944c2b-1f68-4a88-a417-72f9ddc4f353 admin admin] PATH_INFO: `/v3/projects/20c575a55f0e424e9c6b537473ec181f` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:30.160571 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39944c2b-1f68-4a88-a417-72f9ddc4f353 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20c575a55f0e424e9c6b537473ec181f)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:30.162542 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39944c2b-1f68-4a88-a417-72f9ddc4f353 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:30.167694 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-3979d8a5-7caa-4cdb-b93c-4da763700e01 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:29:30.168929 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-3979d8a5-7caa-4cdb-b93c-4da763700e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:30.176572 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1049/2096] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:29:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:29:30.177766 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e7e00-8034-4d8f-a311-7c0d1b71b1c8 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:30.178056 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e7e00-8034-4d8f-a311-7c0d1b71b1c8 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:30.178330 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e7e00-8034-4d8f-a311-7c0d1b71b1c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:30.198582 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-561e7e00-8034-4d8f-a311-7c0d1b71b1c8 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:29:30.199883 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-561e7e00-8034-4d8f-a311-7c0d1b71b1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:30.219847 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-39944c2b-1f68-4a88-a417-72f9ddc4f353 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20c575a55f0e424e9c6b537473ec181f', 'request_id': 'req-39944c2b-1f68-4a88-a417-72f9ddc4f353'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:30.227517 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-39944c2b-1f68-4a88-a417-72f9ddc4f353 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20c575a55f0e424e9c6b537473ec181f', 'request_id': 'req-39944c2b-1f68-4a88-a417-72f9ddc4f353'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:30.233666 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-39944c2b-1f68-4a88-a417-72f9ddc4f353 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20c575a55f0e424e9c6b537473ec181f', 'request_id': 'req-39944c2b-1f68-4a88-a417-72f9ddc4f353'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:30.245565 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-39944c2b-1f68-4a88-a417-72f9ddc4f353 admin admin] The token cache is being invalidate because project 20c575a55f0e424e9c6b537473ec181f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:29:30.246064 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-39944c2b-1f68-4a88-a417-72f9ddc4f353 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:30.246911 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-39944c2b-1f68-4a88-a417-72f9ddc4f353 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:30.251540 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1048/2097] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:29:30 2022] DELETE /identity/v3/projects/20c575a55f0e424e9c6b537473ec181f => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:29:30.251540 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39944c2b-1f68-4a88-a417-72f9ddc4f353 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:30.251540 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-39944c2b-1f68-4a88-a417-72f9ddc4f353 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:30.263829 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1050/2098] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:29:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:29:30.264811 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561e7e00-8034-4d8f-a311-7c0d1b71b1c8 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:30.268269 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-561e7e00-8034-4d8f-a311-7c0d1b71b1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:30.280776 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561e7e00-8034-4d8f-a311-7c0d1b71b1c8 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:30.286950 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a87feb-8bb6-4b90-a605-5ad41accfe35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:30.287815 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a87feb-8bb6-4b90-a605-5ad41accfe35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:30.288101 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a87feb-8bb6-4b90-a605-5ad41accfe35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:30.288489 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a87feb-8bb6-4b90-a605-5ad41accfe35 admin admin] PATH_INFO: `/v3/users/9ff13e25d0884d098144a8a0ba087049` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:30.289872 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a87feb-8bb6-4b90-a605-5ad41accfe35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ff13e25d0884d098144a8a0ba087049)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:30.292712 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a87feb-8bb6-4b90-a605-5ad41accfe35 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:30.321457 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39944c2b-1f68-4a88-a417-72f9ddc4f353 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:30.325601 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8951be8b-9fcd-4c28-a117-003e523657ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:30.326347 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951be8b-9fcd-4c28-a117-003e523657ca service neutron] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:30.326759 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951be8b-9fcd-4c28-a117-003e523657ca service neutron] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:30.327051 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951be8b-9fcd-4c28-a117-003e523657ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:30.329334 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-8951be8b-9fcd-4c28-a117-003e523657ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:30.340239 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-59a87feb-8bb6-4b90-a605-5ad41accfe35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ff13e25d0884d098144a8a0ba087049'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:30.340937 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8951be8b-9fcd-4c28-a117-003e523657ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:30.342338 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8951be8b-9fcd-4c28-a117-003e523657ca service neutron] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:30.348589 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-59a87feb-8bb6-4b90-a605-5ad41accfe35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ff13e25d0884d098144a8a0ba087049'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:30.349227 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-59a87feb-8bb6-4b90-a605-5ad41accfe35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ff13e25d0884d098144a8a0ba087049'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:30.352697 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1049/2099] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:29:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:29:30.354109 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8951be8b-9fcd-4c28-a117-003e523657ca service neutron] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:30.356982 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-59a87feb-8bb6-4b90-a605-5ad41accfe35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ff13e25d0884d098144a8a0ba087049'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:30.363678 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8951be8b-9fcd-4c28-a117-003e523657ca service neutron] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:30.370022 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-59a87feb-8bb6-4b90-a605-5ad41accfe35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ff13e25d0884d098144a8a0ba087049'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:30.370185 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b1a88-f5a5-43f1-9ce5-cdc545902ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:30.370734 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b1a88-f5a5-43f1-9ce5-cdc545902ee5 admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:30.371028 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b1a88-f5a5-43f1-9ce5-cdc545902ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:30.371309 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b1a88-f5a5-43f1-9ce5-cdc545902ee5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:30.372033 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6b1a88-f5a5-43f1-9ce5-cdc545902ee5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:29:30.372343 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6b1a88-f5a5-43f1-9ce5-cdc545902ee5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:30.373944 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6b1a88-f5a5-43f1-9ce5-cdc545902ee5 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:30.377663 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1051/2100] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:29:30 2022] DELETE /identity/v3/users/9ff13e25d0884d098144a8a0ba087049 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:29:30.392032 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1050/2101] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Mar 30 01:29:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:29:30.397307 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a87feb-8bb6-4b90-a605-5ad41accfe35 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:30.399629 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-59a87feb-8bb6-4b90-a605-5ad41accfe35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:30.477371 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a87feb-8bb6-4b90-a605-5ad41accfe35 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:30.483237 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043c41df-4e71-4ed3-ae90-69a17fce742a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:30.483925 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c41df-4e71-4ed3-ae90-69a17fce742a admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:30.484287 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c41df-4e71-4ed3-ae90-69a17fce742a admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:30.484557 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c41df-4e71-4ed3-ae90-69a17fce742a admin admin] PATH_INFO: `/v3/projects` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:30.485262 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043c41df-4e71-4ed3-ae90-69a17fce742a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:30.487184 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043c41df-4e71-4ed3-ae90-69a17fce742a admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:30.524932 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1052/2102] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:29:30 2022] POST /identity/v3/projects => generated 371 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:29:30.526316 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b1a88-f5a5-43f1-9ce5-cdc545902ee5 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:30.537454 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b1a88-f5a5-43f1-9ce5-cdc545902ee5 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:30.596724 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50309551-e807-4821-b4bd-6970070860c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:30.597635 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50309551-e807-4821-b4bd-6970070860c4 admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:30.597992 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50309551-e807-4821-b4bd-6970070860c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:30.598338 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50309551-e807-4821-b4bd-6970070860c4 admin admin] PATH_INFO: `/v3/users` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:30.599134 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50309551-e807-4821-b4bd-6970070860c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:30.601138 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50309551-e807-4821-b4bd-6970070860c4 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:30.626562 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1051/2103] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:29:30 2022] POST /identity/v3/users => generated 286 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 01:29:30.630473 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043c41df-4e71-4ed3-ae90-69a17fce742a admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:30.642263 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043c41df-4e71-4ed3-ae90-69a17fce742a admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:30.647192 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20946bf4-6421-4a59-a045-fa1c972fe070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:30.647849 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20946bf4-6421-4a59-a045-fa1c972fe070 admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:30.648148 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20946bf4-6421-4a59-a045-fa1c972fe070 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:30.648423 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20946bf4-6421-4a59-a045-fa1c972fe070 admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:30.649147 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20946bf4-6421-4a59-a045-fa1c972fe070 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:30.650868 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20946bf4-6421-4a59-a045-fa1c972fe070 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:30.662115 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1053/2104] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:29:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:29:30.666048 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50309551-e807-4821-b4bd-6970070860c4 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:30.676179 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50309551-e807-4821-b4bd-6970070860c4 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:30.680959 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffadce29-2fcd-4431-9097-e64c58b951fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:30.682274 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffadce29-2fcd-4431-9097-e64c58b951fb admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:30.682670 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffadce29-2fcd-4431-9097-e64c58b951fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:30.682997 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffadce29-2fcd-4431-9097-e64c58b951fb admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:30.683729 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffadce29-2fcd-4431-9097-e64c58b951fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:30.685317 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffadce29-2fcd-4431-9097-e64c58b951fb admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:30.695497 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1052/2105] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:29:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:29:30.700342 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20946bf4-6421-4a59-a045-fa1c972fe070 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:30.710298 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20946bf4-6421-4a59-a045-fa1c972fe070 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:30.715064 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d949e5e3-c683-4a9b-9f0d-d228984ee457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:30.715946 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949e5e3-c683-4a9b-9f0d-d228984ee457 admin admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:30.716231 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949e5e3-c683-4a9b-9f0d-d228984ee457 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:30.716509 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949e5e3-c683-4a9b-9f0d-d228984ee457 admin admin] PATH_INFO: `/v3/projects/babc9d0bca444ad7b1360d64894ac37c/users/a0d44eb4367940a8b21f99fc063939e4/roles/7185d0cfbcd44502b1613bcfe1b42f6f` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:30.731110 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d949e5e3-c683-4a9b-9f0d-d228984ee457 admin admin] RBAC: Authorizing `identity:create_grant(project_id=babc9d0bca444ad7b1360d64894ac37c, user_id=a0d44eb4367940a8b21f99fc063939e4, role_id=7185d0cfbcd44502b1613bcfe1b42f6f)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:30.733779 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d949e5e3-c683-4a9b-9f0d-d228984ee457 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:30.748107 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1054/2106] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:29:30 2022] PUT /identity/v3/projects/babc9d0bca444ad7b1360d64894ac37c/users/a0d44eb4367940a8b21f99fc063939e4/roles/7185d0cfbcd44502b1613bcfe1b42f6f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:29:30.753961 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d62e0-5df5-4c36-a17d-c6353f0c4e1b None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:30.754292 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d62e0-5df5-4c36-a17d-c6353f0c4e1b None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:30.754672 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d62e0-5df5-4c36-a17d-c6353f0c4e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:30.775213 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-be5d62e0-5df5-4c36-a17d-c6353f0c4e1b None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:29:30.776777 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-be5d62e0-5df5-4c36-a17d-c6353f0c4e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:30.803949 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d949e5e3-c683-4a9b-9f0d-d228984ee457 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:30.805819 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-d949e5e3-c683-4a9b-9f0d-d228984ee457 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:30.843636 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1053/2107] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:29:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 01:29:30.844504 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d62e0-5df5-4c36-a17d-c6353f0c4e1b None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:30.846326 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-be5d62e0-5df5-4c36-a17d-c6353f0c4e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:30.866487 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d62e0-5df5-4c36-a17d-c6353f0c4e1b None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:30.876233 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b640c5cc-4c10-4ed2-aefd-79aaa6ef744a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:30.877068 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b640c5cc-4c10-4ed2-aefd-79aaa6ef744a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:30.877369 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b640c5cc-4c10-4ed2-aefd-79aaa6ef744a admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:30.877614 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b640c5cc-4c10-4ed2-aefd-79aaa6ef744a admin admin] PATH_INFO: `/v3/projects/2fa1b5590d0547909a2f61342fea27a0` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:30.878951 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b640c5cc-4c10-4ed2-aefd-79aaa6ef744a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fa1b5590d0547909a2f61342fea27a0)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:30.880763 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b640c5cc-4c10-4ed2-aefd-79aaa6ef744a admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:30.888023 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d949e5e3-c683-4a9b-9f0d-d228984ee457 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:30.894354 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd8937c-6ca5-4384-99c0-4d0da3026587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:30.895338 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd8937c-6ca5-4384-99c0-4d0da3026587 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:30.895692 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd8937c-6ca5-4384-99c0-4d0da3026587 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:30.895979 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd8937c-6ca5-4384-99c0-4d0da3026587 admin admin] PATH_INFO: `/v3/projects/87d2e84a1b614ef3aaa4f2b201a14d75` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:30.897183 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd8937c-6ca5-4384-99c0-4d0da3026587 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87d2e84a1b614ef3aaa4f2b201a14d75)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:30.899144 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd8937c-6ca5-4384-99c0-4d0da3026587 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:30.929119 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-b640c5cc-4c10-4ed2-aefd-79aaa6ef744a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fa1b5590d0547909a2f61342fea27a0', 'request_id': 'req-b640c5cc-4c10-4ed2-aefd-79aaa6ef744a'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:30.938576 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-b640c5cc-4c10-4ed2-aefd-79aaa6ef744a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fa1b5590d0547909a2f61342fea27a0', 'request_id': 'req-b640c5cc-4c10-4ed2-aefd-79aaa6ef744a'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:30.946337 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-b640c5cc-4c10-4ed2-aefd-79aaa6ef744a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fa1b5590d0547909a2f61342fea27a0', 'request_id': 'req-b640c5cc-4c10-4ed2-aefd-79aaa6ef744a'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:30.946674 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-7cd8937c-6ca5-4384-99c0-4d0da3026587 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87d2e84a1b614ef3aaa4f2b201a14d75', 'request_id': 'req-7cd8937c-6ca5-4384-99c0-4d0da3026587'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:30.953080 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-7cd8937c-6ca5-4384-99c0-4d0da3026587 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87d2e84a1b614ef3aaa4f2b201a14d75', 'request_id': 'req-7cd8937c-6ca5-4384-99c0-4d0da3026587'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:30.958644 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-b640c5cc-4c10-4ed2-aefd-79aaa6ef744a admin admin] The token cache is being invalidate because project 2fa1b5590d0547909a2f61342fea27a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:29:30.959021 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-b640c5cc-4c10-4ed2-aefd-79aaa6ef744a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:30.959839 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-b640c5cc-4c10-4ed2-aefd-79aaa6ef744a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:30.960964 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-7cd8937c-6ca5-4384-99c0-4d0da3026587 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87d2e84a1b614ef3aaa4f2b201a14d75', 'request_id': 'req-7cd8937c-6ca5-4384-99c0-4d0da3026587'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:30.961839 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1054/2108] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:29:30 2022] DELETE /identity/v3/projects/2fa1b5590d0547909a2f61342fea27a0 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:29:30.962728 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b640c5cc-4c10-4ed2-aefd-79aaa6ef744a admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:30.964491 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-b640c5cc-4c10-4ed2-aefd-79aaa6ef744a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:30.973819 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-7cd8937c-6ca5-4384-99c0-4d0da3026587 admin admin] The token cache is being invalidate because project 87d2e84a1b614ef3aaa4f2b201a14d75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:29:30.974115 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-7cd8937c-6ca5-4384-99c0-4d0da3026587 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:30.974825 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-7cd8937c-6ca5-4384-99c0-4d0da3026587 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:30.976386 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1055/2109] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:29:30 2022] DELETE /identity/v3/projects/87d2e84a1b614ef3aaa4f2b201a14d75 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:29:30.977749 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757d42df-0faf-49df-a95e-8f9185e06a90 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:30.978292 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757d42df-0faf-49df-a95e-8f9185e06a90 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:30.978758 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757d42df-0faf-49df-a95e-8f9185e06a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:30.996771 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-757d42df-0faf-49df-a95e-8f9185e06a90 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:29:30.997988 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-757d42df-0faf-49df-a95e-8f9185e06a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:31.033521 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b640c5cc-4c10-4ed2-aefd-79aaa6ef744a admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:31.064369 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1056/2110] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:29:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:29:31.065563 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757d42df-0faf-49df-a95e-8f9185e06a90 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:31.067432 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-757d42df-0faf-49df-a95e-8f9185e06a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:31.083246 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757d42df-0faf-49df-a95e-8f9185e06a90 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:31.088997 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e3f2bb-0595-4a9d-b1ee-77d53355f7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:31.090000 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e3f2bb-0595-4a9d-b1ee-77d53355f7ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:31.090391 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e3f2bb-0595-4a9d-b1ee-77d53355f7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:31.090830 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e3f2bb-0595-4a9d-b1ee-77d53355f7ae admin admin] PATH_INFO: `/v3/users/b37df174612049b883cf67141b8f583a` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:31.092694 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e3f2bb-0595-4a9d-b1ee-77d53355f7ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=b37df174612049b883cf67141b8f583a)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:31.095757 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e3f2bb-0595-4a9d-b1ee-77d53355f7ae admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:31.098901 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991ca80-a5b5-4409-a614-8eaa46566b5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:31.100200 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991ca80-a5b5-4409-a614-8eaa46566b5a service neutron] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:31.100786 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991ca80-a5b5-4409-a614-8eaa46566b5a service neutron] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:31.101258 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991ca80-a5b5-4409-a614-8eaa46566b5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:31.105203 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-8991ca80-a5b5-4409-a614-8eaa46566b5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:31.120521 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8991ca80-a5b5-4409-a614-8eaa46566b5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:31.122291 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8991ca80-a5b5-4409-a614-8eaa46566b5a service neutron] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:31.136772 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1055/2111] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:29:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:29:31.151816 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8002a28-23a4-4d53-a4ee-8f88b9bc2663 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:31.152116 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8002a28-23a4-4d53-a4ee-8f88b9bc2663 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:31.152403 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8002a28-23a4-4d53-a4ee-8f88b9bc2663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:31.162763 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-91e3f2bb-0595-4a9d-b1ee-77d53355f7ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b37df174612049b883cf67141b8f583a'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:31.172426 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-91e3f2bb-0595-4a9d-b1ee-77d53355f7ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b37df174612049b883cf67141b8f583a'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:31.173620 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-91e3f2bb-0595-4a9d-b1ee-77d53355f7ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b37df174612049b883cf67141b8f583a'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:31.184703 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-f8002a28-23a4-4d53-a4ee-8f88b9bc2663 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:29:31.185878 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-f8002a28-23a4-4d53-a4ee-8f88b9bc2663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:31.188327 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-91e3f2bb-0595-4a9d-b1ee-77d53355f7ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b37df174612049b883cf67141b8f583a'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:31.199276 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1056/2112] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:29:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:29:31.200538 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8002a28-23a4-4d53-a4ee-8f88b9bc2663 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:31.210567 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8002a28-23a4-4d53-a4ee-8f88b9bc2663 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:31.216107 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca3be7-8d6f-46c8-ac60-19da590dabe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:31.216762 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca3be7-8d6f-46c8-ac60-19da590dabe3 admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:31.217043 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca3be7-8d6f-46c8-ac60-19da590dabe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:31.217318 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca3be7-8d6f-46c8-ac60-19da590dabe3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:31.218038 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ca3be7-8d6f-46c8-ac60-19da590dabe3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:29:31.218342 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ca3be7-8d6f-46c8-ac60-19da590dabe3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:31.226928 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-91e3f2bb-0595-4a9d-b1ee-77d53355f7ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b37df174612049b883cf67141b8f583a'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:31.229124 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ca3be7-8d6f-46c8-ac60-19da590dabe3 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:31.238805 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1057/2113] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:29:31 2022] DELETE /identity/v3/users/b37df174612049b883cf67141b8f583a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:29:31.250084 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1057/2114] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Mar 30 01:29:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:29:31.255335 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e3f2bb-0595-4a9d-b1ee-77d53355f7ae admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:31.365065 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e3f2bb-0595-4a9d-b1ee-77d53355f7ae admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:31.373896 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1341698d-d7a0-4b89-858c-4179a4838f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:31.375065 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341698d-d7a0-4b89-858c-4179a4838f21 admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:31.375476 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341698d-d7a0-4b89-858c-4179a4838f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:31.376109 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341698d-d7a0-4b89-858c-4179a4838f21 admin admin] PATH_INFO: `/v3/projects` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:31.377147 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1341698d-d7a0-4b89-858c-4179a4838f21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:31.379338 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1341698d-d7a0-4b89-858c-4179a4838f21 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:31.424940 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1058/2115] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:29:31 2022] POST /identity/v3/projects => generated 385 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 01:29:31.430085 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca3be7-8d6f-46c8-ac60-19da590dabe3 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:31.442191 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca3be7-8d6f-46c8-ac60-19da590dabe3 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:31.510571 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8dbf78-3b17-49b3-8580-77c62feb754e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:31.511373 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8dbf78-3b17-49b3-8580-77c62feb754e admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:31.511742 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8dbf78-3b17-49b3-8580-77c62feb754e admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:31.512339 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8dbf78-3b17-49b3-8580-77c62feb754e admin admin] PATH_INFO: `/v3/users` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:31.513036 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8dbf78-3b17-49b3-8580-77c62feb754e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:31.515131 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8dbf78-3b17-49b3-8580-77c62feb754e admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:31.549208 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1058/2116] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:29:31 2022] POST /identity/v3/users => generated 293 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:29:31.554239 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1341698d-d7a0-4b89-858c-4179a4838f21 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:31.577808 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1341698d-d7a0-4b89-858c-4179a4838f21 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:31.585455 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268bbe1f-72c9-4b76-9ddd-bcc4859eb489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:31.586182 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268bbe1f-72c9-4b76-9ddd-bcc4859eb489 admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:31.586466 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268bbe1f-72c9-4b76-9ddd-bcc4859eb489 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:31.587036 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268bbe1f-72c9-4b76-9ddd-bcc4859eb489 admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:31.588342 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268bbe1f-72c9-4b76-9ddd-bcc4859eb489 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:31.590274 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268bbe1f-72c9-4b76-9ddd-bcc4859eb489 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:31.607043 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8dbf78-3b17-49b3-8580-77c62feb754e admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:31.609164 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1059/2117] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:29:31 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 01:29:31.610120 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268bbe1f-72c9-4b76-9ddd-bcc4859eb489 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:31.611318 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-3a8dbf78-3b17-49b3-8580-77c62feb754e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:31.621421 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268bbe1f-72c9-4b76-9ddd-bcc4859eb489 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:31.627579 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b40fde8-e844-4df4-ba30-3c9d23ac719e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:31.628333 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40fde8-e844-4df4-ba30-3c9d23ac719e admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:31.628691 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40fde8-e844-4df4-ba30-3c9d23ac719e admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:31.629482 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40fde8-e844-4df4-ba30-3c9d23ac719e admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:31.630897 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b40fde8-e844-4df4-ba30-3c9d23ac719e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:31.632713 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b40fde8-e844-4df4-ba30-3c9d23ac719e admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:31.640027 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8dbf78-3b17-49b3-8580-77c62feb754e admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:31.658624 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1060/2118] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:29:31 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:29:31.658624 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b40fde8-e844-4df4-ba30-3c9d23ac719e admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:31.659738 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d5e194-ef29-4b34-9f72-6462bbfa987c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:31.660666 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d5e194-ef29-4b34-9f72-6462bbfa987c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:31.660977 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d5e194-ef29-4b34-9f72-6462bbfa987c admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:31.661277 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d5e194-ef29-4b34-9f72-6462bbfa987c admin admin] PATH_INFO: `/v3/projects/d76020e785494b67bd170b166f1a37a4` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:31.662514 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d5e194-ef29-4b34-9f72-6462bbfa987c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d76020e785494b67bd170b166f1a37a4)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:31.664604 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d5e194-ef29-4b34-9f72-6462bbfa987c admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:31.672699 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b40fde8-e844-4df4-ba30-3c9d23ac719e admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:31.678552 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d127bfd8-e126-456c-97a3-715e5ca3bd1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:31.680027 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d127bfd8-e126-456c-97a3-715e5ca3bd1b admin admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:31.680027 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d127bfd8-e126-456c-97a3-715e5ca3bd1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:31.680524 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d127bfd8-e126-456c-97a3-715e5ca3bd1b admin admin] PATH_INFO: `/v3/projects/967b00f7c3844bf2823fade44d8cd17e/users/d7f1aecfa00a458daea7a052b2a6d4fc/roles/7185d0cfbcd44502b1613bcfe1b42f6f` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:31.703387 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d127bfd8-e126-456c-97a3-715e5ca3bd1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=967b00f7c3844bf2823fade44d8cd17e, user_id=d7f1aecfa00a458daea7a052b2a6d4fc, role_id=7185d0cfbcd44502b1613bcfe1b42f6f)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:31.707076 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d127bfd8-e126-456c-97a3-715e5ca3bd1b admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:31.723817 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1061/2119] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:29:31 2022] PUT /identity/v3/projects/967b00f7c3844bf2823fade44d8cd17e/users/d7f1aecfa00a458daea7a052b2a6d4fc/roles/7185d0cfbcd44502b1613bcfe1b42f6f => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:29:31.734991 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-d8d5e194-ef29-4b34-9f72-6462bbfa987c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd76020e785494b67bd170b166f1a37a4', 'request_id': 'req-d8d5e194-ef29-4b34-9f72-6462bbfa987c'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:31.736152 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83d49e-6d65-451e-a3fb-ccfb68f5691b None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:31.736652 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83d49e-6d65-451e-a3fb-ccfb68f5691b None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:31.737314 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83d49e-6d65-451e-a3fb-ccfb68f5691b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:31.743082 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-d8d5e194-ef29-4b34-9f72-6462bbfa987c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd76020e785494b67bd170b166f1a37a4', 'request_id': 'req-d8d5e194-ef29-4b34-9f72-6462bbfa987c'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:31.756192 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-d8d5e194-ef29-4b34-9f72-6462bbfa987c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd76020e785494b67bd170b166f1a37a4', 'request_id': 'req-d8d5e194-ef29-4b34-9f72-6462bbfa987c'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:31.766736 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-3e83d49e-6d65-451e-a3fb-ccfb68f5691b None None] MFA Rules not processed for user `d7f1aecfa00a458daea7a052b2a6d4fc`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:29:31.767977 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-3e83d49e-6d65-451e-a3fb-ccfb68f5691b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:31.770448 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-d8d5e194-ef29-4b34-9f72-6462bbfa987c admin admin] The token cache is being invalidate because project d76020e785494b67bd170b166f1a37a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:29:31.770773 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-d8d5e194-ef29-4b34-9f72-6462bbfa987c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:31.771430 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-d8d5e194-ef29-4b34-9f72-6462bbfa987c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:31.773200 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1059/2120] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:29:31 2022] DELETE /identity/v3/projects/d76020e785494b67bd170b166f1a37a4 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:29:31.777977 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74775fd3-9b72-4988-8c39-293eb6338b7a None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:31.778270 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74775fd3-9b72-4988-8c39-293eb6338b7a None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:31.778553 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74775fd3-9b72-4988-8c39-293eb6338b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:31.798214 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-74775fd3-9b72-4988-8c39-293eb6338b7a None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:29:31.799457 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-74775fd3-9b72-4988-8c39-293eb6338b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:31.849020 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1062/2121] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:29:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:29:31.859902 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e83d49e-6d65-451e-a3fb-ccfb68f5691b None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:31.861449 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-3e83d49e-6d65-451e-a3fb-ccfb68f5691b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:31.864217 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1060/2122] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:29:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 01:29:31.871943 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f261d-abe5-43ef-8023-4fdb23efe10a None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:31.872437 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f261d-abe5-43ef-8023-4fdb23efe10a None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:31.872790 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f261d-abe5-43ef-8023-4fdb23efe10a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:31.893241 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-f26f261d-abe5-43ef-8023-4fdb23efe10a None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:29:31.894616 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-f26f261d-abe5-43ef-8023-4fdb23efe10a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:31.905937 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1061/2123] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:29:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:29:31.910298 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f261d-abe5-43ef-8023-4fdb23efe10a None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:31.920201 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f261d-abe5-43ef-8023-4fdb23efe10a None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:31.926164 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d249ad-9977-48a9-9c9b-d1ceb8a9a43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:31.926867 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d249ad-9977-48a9-9c9b-d1ceb8a9a43c admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:31.927195 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d249ad-9977-48a9-9c9b-d1ceb8a9a43c admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:31.928941 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d249ad-9977-48a9-9c9b-d1ceb8a9a43c admin admin] PATH_INFO: `/v3/domains` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:31.929794 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d249ad-9977-48a9-9c9b-d1ceb8a9a43c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:29:31.930122 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d249ad-9977-48a9-9c9b-d1ceb8a9a43c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:31.931860 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d249ad-9977-48a9-9c9b-d1ceb8a9a43c admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:31.952578 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1062/2124] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Mar 30 01:29:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:29:31.953642 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d249ad-9977-48a9-9c9b-d1ceb8a9a43c admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:31.977964 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e83d49e-6d65-451e-a3fb-ccfb68f5691b None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:31.980037 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d249ad-9977-48a9-9c9b-d1ceb8a9a43c admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:31.986154 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f3d3f2-f04d-457d-86b3-a7e168389ee4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45219f386f0147b6bd380efe4ab62812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:31.986741 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f3d3f2-f04d-457d-86b3-a7e168389ee4 service cinder] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:31.987065 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f3d3f2-f04d-457d-86b3-a7e168389ee4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:31.987312 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f3d3f2-f04d-457d-86b3-a7e168389ee4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:31.993166 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ad0fc7-48ab-4790-bfe2-01161b9791ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:31.994388 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad0fc7-48ab-4790-bfe2-01161b9791ac admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:31.994388 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad0fc7-48ab-4790-bfe2-01161b9791ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:31.994639 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad0fc7-48ab-4790-bfe2-01161b9791ac admin admin] PATH_INFO: `/v3/projects` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:31.995187 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ad0fc7-48ab-4790-bfe2-01161b9791ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:31.999616 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ad0fc7-48ab-4790-bfe2-01161b9791ac admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:32.010960 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f3d3f2-f04d-457d-86b3-a7e168389ee4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:32.012249 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f3d3f2-f04d-457d-86b3-a7e168389ee4 service cinder] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:32.027705 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1063/2125] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:29:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 30 01:29:32.040311 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b60524-64e0-4ea6-85e4-b0c185e14558 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:32.042246 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b60524-64e0-4ea6-85e4-b0c185e14558 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:32.042867 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b60524-64e0-4ea6-85e4-b0c185e14558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:32.054724 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1063/2126] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:29:31 2022] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:29:32.059403 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ad0fc7-48ab-4790-bfe2-01161b9791ac admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:32.109791 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-17b60524-64e0-4ea6-85e4-b0c185e14558 None None] MFA Rules not processed for user `a0d44eb4367940a8b21f99fc063939e4`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:29:32.111671 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-17b60524-64e0-4ea6-85e4-b0c185e14558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:32.140582 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ad0fc7-48ab-4790-bfe2-01161b9791ac admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:32.152990 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d1c2fb-91c0-4990-97c3-49328603a96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:32.153661 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d1c2fb-91c0-4990-97c3-49328603a96b admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:32.154166 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d1c2fb-91c0-4990-97c3-49328603a96b admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:32.154614 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d1c2fb-91c0-4990-97c3-49328603a96b admin admin] PATH_INFO: `/v3/users` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:32.155353 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d1c2fb-91c0-4990-97c3-49328603a96b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:32.158055 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d1c2fb-91c0-4990-97c3-49328603a96b admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:32.191040 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1064/2127] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:29:32 2022] POST /identity/v3/users => generated 293 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:29:32.192875 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d1c2fb-91c0-4990-97c3-49328603a96b admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:32.206436 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d1c2fb-91c0-4990-97c3-49328603a96b admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:32.214064 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1064/2128] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:29:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:29:32.214428 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ad049e-6317-41dd-a795-e0f36ae99d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:32.215334 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad049e-6317-41dd-a795-e0f36ae99d54 admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:32.215519 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad049e-6317-41dd-a795-e0f36ae99d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:32.216748 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad049e-6317-41dd-a795-e0f36ae99d54 admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:32.217770 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ad049e-6317-41dd-a795-e0f36ae99d54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:32.219551 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ad049e-6317-41dd-a795-e0f36ae99d54 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:32.234434 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1065/2129] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:29:32 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:29:32.236863 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b60524-64e0-4ea6-85e4-b0c185e14558 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:32.250166 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b60524-64e0-4ea6-85e4-b0c185e14558 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:32.250394 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ad049e-6317-41dd-a795-e0f36ae99d54 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:32.252301 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-f8ad049e-6317-41dd-a795-e0f36ae99d54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:32.255641 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3021cb-e80c-40a8-9bb0-a8af4899fd68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:32.256525 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3021cb-e80c-40a8-9bb0-a8af4899fd68 admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:32.256812 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3021cb-e80c-40a8-9bb0-a8af4899fd68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:32.257091 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3021cb-e80c-40a8-9bb0-a8af4899fd68 admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:32.257829 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3021cb-e80c-40a8-9bb0-a8af4899fd68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:32.260287 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3021cb-e80c-40a8-9bb0-a8af4899fd68 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:32.272294 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1065/2130] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:29:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 01:29:32.277618 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3021cb-e80c-40a8-9bb0-a8af4899fd68 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:32.288585 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3021cb-e80c-40a8-9bb0-a8af4899fd68 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:32.295839 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb03f593-8835-43b6-9d62-2be9d39ff8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:32.296940 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03f593-8835-43b6-9d62-2be9d39ff8b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:32.297274 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03f593-8835-43b6-9d62-2be9d39ff8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:32.297575 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03f593-8835-43b6-9d62-2be9d39ff8b0 admin admin] PATH_INFO: `/v3/projects/ada485b862e34f93837708afbe0b1ad8/users/c6e047b3989c4d83b8f1ef705fa30463/roles/7185d0cfbcd44502b1613bcfe1b42f6f` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:32.313562 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb03f593-8835-43b6-9d62-2be9d39ff8b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ada485b862e34f93837708afbe0b1ad8, user_id=c6e047b3989c4d83b8f1ef705fa30463, role_id=7185d0cfbcd44502b1613bcfe1b42f6f)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:32.316320 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb03f593-8835-43b6-9d62-2be9d39ff8b0 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:32.326408 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ad049e-6317-41dd-a795-e0f36ae99d54 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:32.331619 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1066/2131] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:29:32 2022] PUT /identity/v3/projects/ada485b862e34f93837708afbe0b1ad8/users/c6e047b3989c4d83b8f1ef705fa30463/roles/7185d0cfbcd44502b1613bcfe1b42f6f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:29:32.343099 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99decf-e093-4cbe-9765-89621d948947 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:32.343426 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99decf-e093-4cbe-9765-89621d948947 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:32.343746 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99decf-e093-4cbe-9765-89621d948947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:32.374793 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-9c99decf-e093-4cbe-9765-89621d948947 None None] MFA Rules not processed for user `c6e047b3989c4d83b8f1ef705fa30463`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:29:32.376335 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-9c99decf-e093-4cbe-9765-89621d948947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:32.382216 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f85833-ed0f-455b-aded-c629a911c6c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45219f386f0147b6bd380efe4ab62812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:32.383017 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f85833-ed0f-455b-aded-c629a911c6c5 service cinder] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:32.383377 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f85833-ed0f-455b-aded-c629a911c6c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:32.383779 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f85833-ed0f-455b-aded-c629a911c6c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:32.466643 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f85833-ed0f-455b-aded-c629a911c6c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:32.468125 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f85833-ed0f-455b-aded-c629a911c6c5 service cinder] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:32.471112 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1067/2132] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:29:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:29:32.475245 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c99decf-e093-4cbe-9765-89621d948947 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:32.478688 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1066/2133] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:29:32 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 30 01:29:32.574319 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f85833-ed0f-455b-aded-c629a911c6c5 service cinder] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:32.574641 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c99decf-e093-4cbe-9765-89621d948947 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:32.574750 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-c7f85833-ed0f-455b-aded-c629a911c6c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:32.584190 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e7eb23-682f-4468-bc29-687192efa424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:32.585424 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7eb23-682f-4468-bc29-687192efa424 admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:32.586045 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7eb23-682f-4468-bc29-687192efa424 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:32.586993 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7eb23-682f-4468-bc29-687192efa424 admin admin] PATH_INFO: `/v3/projects` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:32.588116 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e7eb23-682f-4468-bc29-687192efa424 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:32.590743 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e7eb23-682f-4468-bc29-687192efa424 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:32.593522 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f85833-ed0f-455b-aded-c629a911c6c5 service cinder] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:32.600696 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78e2c83-1983-4d46-b301-9c1f4e83f883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:32.601617 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e2c83-1983-4d46-b301-9c1f4e83f883 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:32.601898 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e2c83-1983-4d46-b301-9c1f4e83f883 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:32.602619 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e2c83-1983-4d46-b301-9c1f4e83f883 admin admin] PATH_INFO: `/v3/users/c09c2fb3f24e464b9730bf410652cef6` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:32.604947 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78e2c83-1983-4d46-b301-9c1f4e83f883 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c09c2fb3f24e464b9730bf410652cef6)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:32.606851 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78e2c83-1983-4d46-b301-9c1f4e83f883 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:32.636268 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1068/2134] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:29:32 2022] POST /identity/v3/projects => generated 385 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:29:32.640303 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e7eb23-682f-4468-bc29-687192efa424 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:32.692285 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-d78e2c83-1983-4d46-b301-9c1f4e83f883 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c09c2fb3f24e464b9730bf410652cef6'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:32.710175 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-d78e2c83-1983-4d46-b301-9c1f4e83f883 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c09c2fb3f24e464b9730bf410652cef6'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:32.723636 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-d78e2c83-1983-4d46-b301-9c1f4e83f883 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c09c2fb3f24e464b9730bf410652cef6'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:32.724640 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-d78e2c83-1983-4d46-b301-9c1f4e83f883 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c09c2fb3f24e464b9730bf410652cef6'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:32.730342 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e7eb23-682f-4468-bc29-687192efa424 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:32.735680 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b55de6-5c59-46b8-a3c8-121d386022d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:32.736367 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b55de6-5c59-46b8-a3c8-121d386022d2 admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:32.736479 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-d78e2c83-1983-4d46-b301-9c1f4e83f883 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c09c2fb3f24e464b9730bf410652cef6'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:32.736655 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b55de6-5c59-46b8-a3c8-121d386022d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:32.737053 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b55de6-5c59-46b8-a3c8-121d386022d2 admin admin] PATH_INFO: `/v3/users` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:32.737756 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b55de6-5c59-46b8-a3c8-121d386022d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:32.739807 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b55de6-5c59-46b8-a3c8-121d386022d2 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:32.744648 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1067/2135] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:29:32 2022] DELETE /identity/v3/users/c09c2fb3f24e464b9730bf410652cef6 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:29:32.749084 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b1ad45-7b03-4146-aad7-eeddda475bb2 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:32.749376 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b1ad45-7b03-4146-aad7-eeddda475bb2 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:32.749656 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b1ad45-7b03-4146-aad7-eeddda475bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:32.768757 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1069/2136] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:29:32 2022] POST /identity/v3/users => generated 299 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 01:29:32.772000 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b55de6-5c59-46b8-a3c8-121d386022d2 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:32.775636 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-43b1ad45-7b03-4146-aad7-eeddda475bb2 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:29:32.776007 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-81b55de6-5c59-46b8-a3c8-121d386022d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:32.777580 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-43b1ad45-7b03-4146-aad7-eeddda475bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:32.790178 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b55de6-5c59-46b8-a3c8-121d386022d2 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:32.867664 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1068/2137] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:29:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 01:29:32.888915 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b1ad45-7b03-4146-aad7-eeddda475bb2 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:32.890489 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-43b1ad45-7b03-4146-aad7-eeddda475bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:32.902616 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad198321-375c-4b8f-b9b1-c0474ab63242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:32.904224 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad198321-375c-4b8f-b9b1-c0474ab63242 admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:32.904700 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad198321-375c-4b8f-b9b1-c0474ab63242 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:32.905063 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad198321-375c-4b8f-b9b1-c0474ab63242 admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:32.905889 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad198321-375c-4b8f-b9b1-c0474ab63242 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:32.908315 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad198321-375c-4b8f-b9b1-c0474ab63242 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:32.926268 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1070/2138] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:29:32 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:29:32.928546 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad198321-375c-4b8f-b9b1-c0474ab63242 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:32.941645 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad198321-375c-4b8f-b9b1-c0474ab63242 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:32.947122 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03917b52-d095-431a-9820-529439e7bfc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:32.948014 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03917b52-d095-431a-9820-529439e7bfc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:32.948298 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03917b52-d095-431a-9820-529439e7bfc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:32.948573 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03917b52-d095-431a-9820-529439e7bfc3 admin admin] PATH_INFO: `/v3/projects/556900ee811e4967bd1592bffa32ec82/users/fc0debb3c92c447caf01fcae08cd0838/roles/36909bbf31d04993bb2a9fe587b572dc` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:32.965948 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03917b52-d095-431a-9820-529439e7bfc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=556900ee811e4967bd1592bffa32ec82, user_id=fc0debb3c92c447caf01fcae08cd0838, role_id=36909bbf31d04993bb2a9fe587b572dc)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:32.969250 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03917b52-d095-431a-9820-529439e7bfc3 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:32.977874 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b1ad45-7b03-4146-aad7-eeddda475bb2 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:32.987733 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1071/2139] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:29:32 2022] PUT /identity/v3/projects/556900ee811e4967bd1592bffa32ec82/users/fc0debb3c92c447caf01fcae08cd0838/roles/36909bbf31d04993bb2a9fe587b572dc => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:29:32.988839 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03917b52-d095-431a-9820-529439e7bfc3 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:33.037416 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870e4db7-ba51-4d40-91a5-18a21d7ad793 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:33.038192 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870e4db7-ba51-4d40-91a5-18a21d7ad793 service neutron] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:33.038487 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870e4db7-ba51-4d40-91a5-18a21d7ad793 service neutron] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:33.038803 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870e4db7-ba51-4d40-91a5-18a21d7ad793 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:33.061328 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03917b52-d095-431a-9820-529439e7bfc3 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:33.066355 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d7bc4b-7b7b-46d6-814c-b64f51564599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:33.067057 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d7bc4b-7b7b-46d6-814c-b64f51564599 admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:33.067341 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d7bc4b-7b7b-46d6-814c-b64f51564599 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:33.067919 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d7bc4b-7b7b-46d6-814c-b64f51564599 admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:33.068755 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d7bc4b-7b7b-46d6-814c-b64f51564599 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:33.070399 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d7bc4b-7b7b-46d6-814c-b64f51564599 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:33.085910 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1072/2140] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:29:32 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 01:29:33.086816 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d7bc4b-7b7b-46d6-814c-b64f51564599 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:33.097864 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d7bc4b-7b7b-46d6-814c-b64f51564599 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:33.103296 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c92628-8c4d-4753-aec1-a0828ebcb026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:33.104285 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c92628-8c4d-4753-aec1-a0828ebcb026 admin admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:33.104733 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c92628-8c4d-4753-aec1-a0828ebcb026 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:33.105013 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c92628-8c4d-4753-aec1-a0828ebcb026 admin admin] PATH_INFO: `/v3/projects/556900ee811e4967bd1592bffa32ec82/users/fc0debb3c92c447caf01fcae08cd0838/roles/36909bbf31d04993bb2a9fe587b572dc` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:33.105381 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870e4db7-ba51-4d40-91a5-18a21d7ad793 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:33.107341 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870e4db7-ba51-4d40-91a5-18a21d7ad793 service neutron] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:33.107473 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c92628-8c4d-4753-aec1-a0828ebcb026 admin admin] RBAC: Authorizing `identity:create_grant(project_id=556900ee811e4967bd1592bffa32ec82, user_id=fc0debb3c92c447caf01fcae08cd0838, role_id=36909bbf31d04993bb2a9fe587b572dc)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:33.109803 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c92628-8c4d-4753-aec1-a0828ebcb026 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:33.119316 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1069/2141] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:29:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 30 01:29:33.124388 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1073/2142] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:29:33 2022] PUT /identity/v3/projects/556900ee811e4967bd1592bffa32ec82/users/fc0debb3c92c447caf01fcae08cd0838/roles/36909bbf31d04993bb2a9fe587b572dc => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:29:33.136146 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227e158-0f83-4e6f-8667-97a9dd753f2d None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:33.136436 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227e158-0f83-4e6f-8667-97a9dd753f2d None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:33.136723 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227e158-0f83-4e6f-8667-97a9dd753f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:33.165156 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-c227e158-0f83-4e6f-8667-97a9dd753f2d None None] MFA Rules not processed for user `fc0debb3c92c447caf01fcae08cd0838`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:29:33.166515 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-c227e158-0f83-4e6f-8667-97a9dd753f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:33.240305 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1070/2143] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:29:33 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:29:33.253654 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c92628-8c4d-4753-aec1-a0828ebcb026 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:33.255425 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-a4c92628-8c4d-4753-aec1-a0828ebcb026 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:33.265358 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c227e158-0f83-4e6f-8667-97a9dd753f2d None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:33.267643 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-c227e158-0f83-4e6f-8667-97a9dd753f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:33.332800 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c92628-8c4d-4753-aec1-a0828ebcb026 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:33.337336 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76c0619-9e04-4f4b-a8ec-a885fbd97c74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45219f386f0147b6bd380efe4ab62812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:33.338027 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c0619-9e04-4f4b-a8ec-a885fbd97c74 service cinder] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:33.338474 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c0619-9e04-4f4b-a8ec-a885fbd97c74 service cinder] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:33.338787 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c0619-9e04-4f4b-a8ec-a885fbd97c74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:33.340729 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-c76c0619-9e04-4f4b-a8ec-a885fbd97c74 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:33.363962 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c227e158-0f83-4e6f-8667-97a9dd753f2d None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:33.370265 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc6754-674b-46c9-8194-fa199a328f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:33.371463 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc6754-674b-46c9-8194-fa199a328f47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:33.371463 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc6754-674b-46c9-8194-fa199a328f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:33.371766 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc6754-674b-46c9-8194-fa199a328f47 admin admin] PATH_INFO: `/v3/users/82e0471675454cd69f0b28c0edf570b3` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:33.372965 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbc6754-674b-46c9-8194-fa199a328f47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82e0471675454cd69f0b28c0edf570b3)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:33.375343 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbc6754-674b-46c9-8194-fa199a328f47 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:33.407610 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76c0619-9e04-4f4b-a8ec-a885fbd97c74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:33.409057 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76c0619-9e04-4f4b-a8ec-a885fbd97c74 service cinder] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:33.419575 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1074/2144] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:29:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:29:33.440080 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-4bbc6754-674b-46c9-8194-fa199a328f47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82e0471675454cd69f0b28c0edf570b3'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:33.455598 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-4bbc6754-674b-46c9-8194-fa199a328f47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82e0471675454cd69f0b28c0edf570b3'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:33.463741 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-4bbc6754-674b-46c9-8194-fa199a328f47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82e0471675454cd69f0b28c0edf570b3'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:33.464457 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-4bbc6754-674b-46c9-8194-fa199a328f47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82e0471675454cd69f0b28c0edf570b3'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:33.472138 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-4bbc6754-674b-46c9-8194-fa199a328f47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82e0471675454cd69f0b28c0edf570b3'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:33.480639 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1071/2145] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:29:33 2022] DELETE /identity/v3/users/82e0471675454cd69f0b28c0edf570b3 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:29:33.620363 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76c0619-9e04-4f4b-a8ec-a885fbd97c74 service cinder] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:33.621958 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-c76c0619-9e04-4f4b-a8ec-a885fbd97c74 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:33.649513 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76c0619-9e04-4f4b-a8ec-a885fbd97c74 service cinder] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:33.713646 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc6754-674b-46c9-8194-fa199a328f47 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:33.716428 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-4bbc6754-674b-46c9-8194-fa199a328f47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:33.761652 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7b0dfa-69c0-4f81-8d65-18bc04549cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:33.764473 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7b0dfa-69c0-4f81-8d65-18bc04549cd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:33.765155 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7b0dfa-69c0-4f81-8d65-18bc04549cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:33.765393 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7b0dfa-69c0-4f81-8d65-18bc04549cd6 admin admin] PATH_INFO: `/v3/projects/0b9e7844e3fb4dd68e7480f9b8e0ee60` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:33.770424 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7b0dfa-69c0-4f81-8d65-18bc04549cd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b9e7844e3fb4dd68e7480f9b8e0ee60)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:33.773016 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7b0dfa-69c0-4f81-8d65-18bc04549cd6 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:33.823544 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc6754-674b-46c9-8194-fa199a328f47 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:33.833771 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-df7b0dfa-69c0-4f81-8d65-18bc04549cd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b9e7844e3fb4dd68e7480f9b8e0ee60', 'request_id': 'req-df7b0dfa-69c0-4f81-8d65-18bc04549cd6'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:33.844309 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-df7b0dfa-69c0-4f81-8d65-18bc04549cd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b9e7844e3fb4dd68e7480f9b8e0ee60', 'request_id': 'req-df7b0dfa-69c0-4f81-8d65-18bc04549cd6'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:33.854426 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-df7b0dfa-69c0-4f81-8d65-18bc04549cd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b9e7844e3fb4dd68e7480f9b8e0ee60', 'request_id': 'req-df7b0dfa-69c0-4f81-8d65-18bc04549cd6'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:33.871144 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-df7b0dfa-69c0-4f81-8d65-18bc04549cd6 admin admin] The token cache is being invalidate because project 0b9e7844e3fb4dd68e7480f9b8e0ee60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:29:33.871439 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-df7b0dfa-69c0-4f81-8d65-18bc04549cd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:33.872106 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-df7b0dfa-69c0-4f81-8d65-18bc04549cd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:33.873832 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1075/2146] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:29:33 2022] DELETE /identity/v3/projects/0b9e7844e3fb4dd68e7480f9b8e0ee60 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:29:33.880166 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb2423-7c68-4601-bc12-389fbc91e5d4 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:33.880528 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb2423-7c68-4601-bc12-389fbc91e5d4 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:33.880879 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb2423-7c68-4601-bc12-389fbc91e5d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:33.903675 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-fbeb2423-7c68-4601-bc12-389fbc91e5d4 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:29:33.904950 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-fbeb2423-7c68-4601-bc12-389fbc91e5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:33.916915 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aed323f-6f73-4103-8b4c-6fd06834f63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:33.917779 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed323f-6f73-4103-8b4c-6fd06834f63c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:33.918065 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed323f-6f73-4103-8b4c-6fd06834f63c admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:33.918354 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed323f-6f73-4103-8b4c-6fd06834f63c admin admin] PATH_INFO: `/v3/projects/36ec6db6f0a941ef9b2b72c285362951` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:33.919615 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aed323f-6f73-4103-8b4c-6fd06834f63c admin admin] RBAC: Authorizing `identity:delete_project(project_id=36ec6db6f0a941ef9b2b72c285362951)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:33.922541 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aed323f-6f73-4103-8b4c-6fd06834f63c admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:33.922929 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1076/2147] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:29:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:29:33.930369 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de65ae-4f3c-4ea2-a9f6-733d5a73b312 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:33.930911 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de65ae-4f3c-4ea2-a9f6-733d5a73b312 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:33.931975 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de65ae-4f3c-4ea2-a9f6-733d5a73b312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:33.970880 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-06de65ae-4f3c-4ea2-a9f6-733d5a73b312 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:29:33.972093 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-06de65ae-4f3c-4ea2-a9f6-733d5a73b312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:33.977586 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-0aed323f-6f73-4103-8b4c-6fd06834f63c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36ec6db6f0a941ef9b2b72c285362951', 'request_id': 'req-0aed323f-6f73-4103-8b4c-6fd06834f63c'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:33.985339 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-0aed323f-6f73-4103-8b4c-6fd06834f63c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36ec6db6f0a941ef9b2b72c285362951', 'request_id': 'req-0aed323f-6f73-4103-8b4c-6fd06834f63c'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:33.990898 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-0aed323f-6f73-4103-8b4c-6fd06834f63c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36ec6db6f0a941ef9b2b72c285362951', 'request_id': 'req-0aed323f-6f73-4103-8b4c-6fd06834f63c'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:34.003472 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-0aed323f-6f73-4103-8b4c-6fd06834f63c admin admin] The token cache is being invalidate because project 36ec6db6f0a941ef9b2b72c285362951 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:29:34.003846 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-0aed323f-6f73-4103-8b4c-6fd06834f63c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:34.004600 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-0aed323f-6f73-4103-8b4c-6fd06834f63c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:34.006221 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1072/2148] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:29:33 2022] DELETE /identity/v3/projects/36ec6db6f0a941ef9b2b72c285362951 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:29:34.010062 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d29ffb-f4a8-4865-b09f-a325ed21f973 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:34.010062 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d29ffb-f4a8-4865-b09f-a325ed21f973 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:34.010062 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d29ffb-f4a8-4865-b09f-a325ed21f973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:34.026580 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-56d29ffb-f4a8-4865-b09f-a325ed21f973 None None] MFA Rules not processed for user `a0d44eb4367940a8b21f99fc063939e4`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:29:34.027817 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-56d29ffb-f4a8-4865-b09f-a325ed21f973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:34.034464 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1077/2149] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:29:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 01:29:34.035943 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f91183a-569d-4377-8b28-1480654658d2 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:34.036142 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f91183a-569d-4377-8b28-1480654658d2 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:34.036423 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f91183a-569d-4377-8b28-1480654658d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:34.054594 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-4f91183a-569d-4377-8b28-1480654658d2 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:29:34.055941 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-4f91183a-569d-4377-8b28-1480654658d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:34.064520 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1078/2150] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:29:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:29:34.065391 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f91183a-569d-4377-8b28-1480654658d2 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:34.074803 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f91183a-569d-4377-8b28-1480654658d2 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:34.079672 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce1636b-e0ee-4236-aff2-54ffe6b7def3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:34.080311 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1636b-e0ee-4236-aff2-54ffe6b7def3 admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:34.080591 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1636b-e0ee-4236-aff2-54ffe6b7def3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:34.080893 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1636b-e0ee-4236-aff2-54ffe6b7def3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:34.081608 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce1636b-e0ee-4236-aff2-54ffe6b7def3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:29:34.081968 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce1636b-e0ee-4236-aff2-54ffe6b7def3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:34.082366 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1073/2151] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:29:34 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:29:34.083623 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce1636b-e0ee-4236-aff2-54ffe6b7def3 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:34.083727 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a0735-d934-453d-b251-815da24c89eb None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:34.083937 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a0735-d934-453d-b251-815da24c89eb None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:34.084214 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a0735-d934-453d-b251-815da24c89eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:34.096771 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1079/2152] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Mar 30 01:29:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:29:34.101383 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce1636b-e0ee-4236-aff2-54ffe6b7def3 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:34.102748 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-9b3a0735-d934-453d-b251-815da24c89eb None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:29:34.104487 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-9b3a0735-d934-453d-b251-815da24c89eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:34.112960 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce1636b-e0ee-4236-aff2-54ffe6b7def3 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:34.113707 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1074/2153] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:29:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:29:34.117307 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a0735-d934-453d-b251-815da24c89eb None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:34.121750 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186a97c0-4224-4d67-be06-8b5c9049a54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:34.122420 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a97c0-4224-4d67-be06-8b5c9049a54b admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:34.122736 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a97c0-4224-4d67-be06-8b5c9049a54b admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:34.123021 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a97c0-4224-4d67-be06-8b5c9049a54b admin admin] PATH_INFO: `/v3/projects` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:34.123714 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186a97c0-4224-4d67-be06-8b5c9049a54b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:34.125624 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186a97c0-4224-4d67-be06-8b5c9049a54b admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:34.128339 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a0735-d934-453d-b251-815da24c89eb None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:34.133543 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47d77bd-2e24-4fa2-be27-218d6db9c668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:34.134438 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d77bd-2e24-4fa2-be27-218d6db9c668 admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:34.135437 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d77bd-2e24-4fa2-be27-218d6db9c668 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:34.135724 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d77bd-2e24-4fa2-be27-218d6db9c668 admin admin] PATH_INFO: `/v3/domains` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:34.136562 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47d77bd-2e24-4fa2-be27-218d6db9c668 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:29:34.136747 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47d77bd-2e24-4fa2-be27-218d6db9c668 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:34.138338 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47d77bd-2e24-4fa2-be27-218d6db9c668 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:34.151539 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1075/2154] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Mar 30 01:29:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:29:34.155752 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1080/2155] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:29:34 2022] POST /identity/v3/projects => generated 365 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 01:29:34.159124 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47d77bd-2e24-4fa2-be27-218d6db9c668 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:34.159763 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186a97c0-4224-4d67-be06-8b5c9049a54b admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:34.170557 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47d77bd-2e24-4fa2-be27-218d6db9c668 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:34.236346 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1534fc28-ad4e-4295-8d96-cd54594c8370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:34.237020 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534fc28-ad4e-4295-8d96-cd54594c8370 admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:34.237292 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534fc28-ad4e-4295-8d96-cd54594c8370 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:34.237947 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534fc28-ad4e-4295-8d96-cd54594c8370 admin admin] PATH_INFO: `/v3/projects` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:34.238277 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1534fc28-ad4e-4295-8d96-cd54594c8370 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:34.239151 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186a97c0-4224-4d67-be06-8b5c9049a54b admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:34.240195 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1534fc28-ad4e-4295-8d96-cd54594c8370 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:34.246423 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901bade-3258-4a30-8c91-52ff1aae205b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:34.247365 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901bade-3258-4a30-8c91-52ff1aae205b admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:34.247867 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901bade-3258-4a30-8c91-52ff1aae205b admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:34.248221 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901bade-3258-4a30-8c91-52ff1aae205b admin admin] PATH_INFO: `/v3/users` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:34.249392 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2901bade-3258-4a30-8c91-52ff1aae205b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:34.251781 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2901bade-3258-4a30-8c91-52ff1aae205b admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:34.272653 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1076/2156] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:29:34 2022] POST /identity/v3/projects => generated 371 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 01:29:34.278733 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1081/2157] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:29:34 2022] POST /identity/v3/users => generated 283 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:29:34.278933 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1534fc28-ad4e-4295-8d96-cd54594c8370 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:34.280013 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901bade-3258-4a30-8c91-52ff1aae205b admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:34.293914 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901bade-3258-4a30-8c91-52ff1aae205b admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:34.347825 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1534fc28-ad4e-4295-8d96-cd54594c8370 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:34.353711 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d4438-1482-455e-8b25-e8f885d16c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:34.354439 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d4438-1482-455e-8b25-e8f885d16c81 admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:34.354899 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d4438-1482-455e-8b25-e8f885d16c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:34.355139 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d4438-1482-455e-8b25-e8f885d16c81 admin admin] PATH_INFO: `/v3/users` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:34.355641 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc599e7-4557-4a9a-88f9-56430b547f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:34.355837 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25d4438-1482-455e-8b25-e8f885d16c81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:34.356437 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc599e7-4557-4a9a-88f9-56430b547f27 admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:34.356784 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc599e7-4557-4a9a-88f9-56430b547f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:34.357140 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc599e7-4557-4a9a-88f9-56430b547f27 admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:34.357771 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25d4438-1482-455e-8b25-e8f885d16c81 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:34.357988 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc599e7-4557-4a9a-88f9-56430b547f27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:34.359703 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc599e7-4557-4a9a-88f9-56430b547f27 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:34.370919 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1082/2158] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:29:34 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 01:29:34.374853 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc599e7-4557-4a9a-88f9-56430b547f27 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:34.383590 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1077/2159] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:29:34 2022] POST /identity/v3/users => generated 286 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 01:29:34.384612 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc599e7-4557-4a9a-88f9-56430b547f27 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:34.385070 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d4438-1482-455e-8b25-e8f885d16c81 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:34.389595 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33fec9b-7bb7-4166-9db1-54b070c4eab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:34.390258 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33fec9b-7bb7-4166-9db1-54b070c4eab3 admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:34.390545 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33fec9b-7bb7-4166-9db1-54b070c4eab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:34.390978 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33fec9b-7bb7-4166-9db1-54b070c4eab3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:34.391709 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33fec9b-7bb7-4166-9db1-54b070c4eab3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:34.393331 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33fec9b-7bb7-4166-9db1-54b070c4eab3 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:34.395902 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d4438-1482-455e-8b25-e8f885d16c81 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:34.401635 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464903bd-639e-46eb-b8cc-543e89a0c5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:34.402167 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464903bd-639e-46eb-b8cc-543e89a0c5d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:34.402523 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464903bd-639e-46eb-b8cc-543e89a0c5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:34.402785 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464903bd-639e-46eb-b8cc-543e89a0c5d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:34.403908 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464903bd-639e-46eb-b8cc-543e89a0c5d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:34.405699 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464903bd-639e-46eb-b8cc-543e89a0c5d4 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:34.406319 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1083/2160] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:29:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 01:29:34.410503 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33fec9b-7bb7-4166-9db1-54b070c4eab3 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:34.418873 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1078/2161] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:29:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:29:34.421276 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464903bd-639e-46eb-b8cc-543e89a0c5d4 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:34.422342 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33fec9b-7bb7-4166-9db1-54b070c4eab3 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:34.426997 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b90137-8c3b-4787-bfd9-7fa0c971b9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:34.427877 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b90137-8c3b-4787-bfd9-7fa0c971b9e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:34.428163 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b90137-8c3b-4787-bfd9-7fa0c971b9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:34.428440 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b90137-8c3b-4787-bfd9-7fa0c971b9e9 admin admin] PATH_INFO: `/v3/projects/5391d7975b744ef2ae7881382b05c486/users/5744e235f4d947a28c71fb084b3322eb/roles/7185d0cfbcd44502b1613bcfe1b42f6f` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:34.431304 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464903bd-639e-46eb-b8cc-543e89a0c5d4 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:34.436202 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962fd1af-5132-4ae7-8de9-6f18c3fbdd7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:34.436964 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962fd1af-5132-4ae7-8de9-6f18c3fbdd7e admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:34.437323 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962fd1af-5132-4ae7-8de9-6f18c3fbdd7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:34.437670 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962fd1af-5132-4ae7-8de9-6f18c3fbdd7e admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:34.438405 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962fd1af-5132-4ae7-8de9-6f18c3fbdd7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:34.440036 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962fd1af-5132-4ae7-8de9-6f18c3fbdd7e admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:34.444383 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b90137-8c3b-4787-bfd9-7fa0c971b9e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5391d7975b744ef2ae7881382b05c486, user_id=5744e235f4d947a28c71fb084b3322eb, role_id=7185d0cfbcd44502b1613bcfe1b42f6f)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:34.447557 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b90137-8c3b-4787-bfd9-7fa0c971b9e9 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:34.451306 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1079/2162] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:29:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 01:29:34.455976 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962fd1af-5132-4ae7-8de9-6f18c3fbdd7e admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:34.461368 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1084/2163] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:29:34 2022] PUT /identity/v3/projects/5391d7975b744ef2ae7881382b05c486/users/5744e235f4d947a28c71fb084b3322eb/roles/7185d0cfbcd44502b1613bcfe1b42f6f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:29:34.472723 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9eac91-d7e0-4d3d-b967-6eb42aac5ea1 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:34.473037 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9eac91-d7e0-4d3d-b967-6eb42aac5ea1 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:34.473287 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9eac91-d7e0-4d3d-b967-6eb42aac5ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:34.482331 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962fd1af-5132-4ae7-8de9-6f18c3fbdd7e admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:34.512918 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-8f9eac91-d7e0-4d3d-b967-6eb42aac5ea1 None None] MFA Rules not processed for user `5744e235f4d947a28c71fb084b3322eb`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:29:34.514130 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-8f9eac91-d7e0-4d3d-b967-6eb42aac5ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:34.562365 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edf057f-19e2-4be5-b25a-a2a7c486b2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:34.563638 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf057f-19e2-4be5-b25a-a2a7c486b2a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:34.563923 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf057f-19e2-4be5-b25a-a2a7c486b2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:34.564198 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf057f-19e2-4be5-b25a-a2a7c486b2a2 admin admin] PATH_INFO: `/v3/projects/d77e3304ee204d41996c14196317046c/users/23585756d4bc4e30b29322c09e5e5235/roles/7185d0cfbcd44502b1613bcfe1b42f6f` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:34.586148 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edf057f-19e2-4be5-b25a-a2a7c486b2a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d77e3304ee204d41996c14196317046c, user_id=23585756d4bc4e30b29322c09e5e5235, role_id=7185d0cfbcd44502b1613bcfe1b42f6f)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:34.589598 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edf057f-19e2-4be5-b25a-a2a7c486b2a2 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:34.598543 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1085/2164] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:29:34 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:29:34.608572 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9eac91-d7e0-4d3d-b967-6eb42aac5ea1 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:34.610014 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-8f9eac91-d7e0-4d3d-b967-6eb42aac5ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:34.610780 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1080/2165] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:29:34 2022] PUT /identity/v3/projects/d77e3304ee204d41996c14196317046c/users/23585756d4bc4e30b29322c09e5e5235/roles/7185d0cfbcd44502b1613bcfe1b42f6f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:29:34.626632 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23663ef8-6642-41f4-84a9-0d996f45fced None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:34.627117 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23663ef8-6642-41f4-84a9-0d996f45fced None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:34.627588 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23663ef8-6642-41f4-84a9-0d996f45fced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:34.727313 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9eac91-d7e0-4d3d-b967-6eb42aac5ea1 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:34.807572 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96dec46-77d2-4e22-ab6f-6e0fc0b79cc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45219f386f0147b6bd380efe4ab62812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:34.808428 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96dec46-77d2-4e22-ab6f-6e0fc0b79cc5 service cinder] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:34.808714 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96dec46-77d2-4e22-ab6f-6e0fc0b79cc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:34.808985 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96dec46-77d2-4e22-ab6f-6e0fc0b79cc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:34.827052 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-23663ef8-6642-41f4-84a9-0d996f45fced None None] MFA Rules not processed for user `23585756d4bc4e30b29322c09e5e5235`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:29:34.828373 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-23663ef8-6642-41f4-84a9-0d996f45fced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:34.871088 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96dec46-77d2-4e22-ab6f-6e0fc0b79cc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:34.872633 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96dec46-77d2-4e22-ab6f-6e0fc0b79cc5 service cinder] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:34.882728 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1086/2166] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:29:34 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 30 01:29:34.904341 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1081/2167] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:29:34 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:29:34.905607 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96dec46-77d2-4e22-ab6f-6e0fc0b79cc5 service cinder] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:34.991643 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96dec46-77d2-4e22-ab6f-6e0fc0b79cc5 service cinder] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:34.997588 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c116a6-52a1-4144-b9dc-296112ac0483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:34.998440 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c116a6-52a1-4144-b9dc-296112ac0483 admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:34.998756 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c116a6-52a1-4144-b9dc-296112ac0483 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:34.999083 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c116a6-52a1-4144-b9dc-296112ac0483 admin admin] PATH_INFO: `/v3/projects` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:34.999992 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c116a6-52a1-4144-b9dc-296112ac0483 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:35.002137 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c116a6-52a1-4144-b9dc-296112ac0483 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:35.034074 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1087/2168] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:29:34 2022] POST /identity/v3/projects => generated 371 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:29:35.035465 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23663ef8-6642-41f4-84a9-0d996f45fced None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:35.047101 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23663ef8-6642-41f4-84a9-0d996f45fced None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:35.112014 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c08f8c2-370e-44e1-8e7c-97df347d80e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:35.112881 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08f8c2-370e-44e1-8e7c-97df347d80e7 admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:35.113203 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08f8c2-370e-44e1-8e7c-97df347d80e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:35.113592 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08f8c2-370e-44e1-8e7c-97df347d80e7 admin admin] PATH_INFO: `/v3/users` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:35.114485 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c08f8c2-370e-44e1-8e7c-97df347d80e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:35.116559 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c08f8c2-370e-44e1-8e7c-97df347d80e7 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:35.139706 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1082/2169] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:29:35 2022] POST /identity/v3/users => generated 292 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:29:35.143880 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c116a6-52a1-4144-b9dc-296112ac0483 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:35.154890 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c116a6-52a1-4144-b9dc-296112ac0483 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:35.169117 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131fd7e7-5020-4ce4-ab3f-e8d41e32975e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:35.170077 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131fd7e7-5020-4ce4-ab3f-e8d41e32975e admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:35.170544 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131fd7e7-5020-4ce4-ab3f-e8d41e32975e admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:35.171032 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131fd7e7-5020-4ce4-ab3f-e8d41e32975e admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:35.172349 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131fd7e7-5020-4ce4-ab3f-e8d41e32975e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:35.174401 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131fd7e7-5020-4ce4-ab3f-e8d41e32975e admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:35.187453 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1088/2170] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:29:35 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 01:29:35.191646 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c08f8c2-370e-44e1-8e7c-97df347d80e7 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:35.204040 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c08f8c2-370e-44e1-8e7c-97df347d80e7 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:35.209338 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c9bfe2-40af-4fec-9476-3a1a6957056b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:35.210208 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c9bfe2-40af-4fec-9476-3a1a6957056b admin admin] REQUEST_METHOD: `PUT` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:35.210487 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c9bfe2-40af-4fec-9476-3a1a6957056b admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:35.210812 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c9bfe2-40af-4fec-9476-3a1a6957056b admin admin] PATH_INFO: `/v3/projects/eb4ea19517ec48eeb5aba23620c2ef2a/users/6e7ee5f494e64696bf6cdb03da25f5ce/roles/36909bbf31d04993bb2a9fe587b572dc` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:35.226384 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c9bfe2-40af-4fec-9476-3a1a6957056b admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb4ea19517ec48eeb5aba23620c2ef2a, user_id=6e7ee5f494e64696bf6cdb03da25f5ce, role_id=36909bbf31d04993bb2a9fe587b572dc)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:35.229127 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c9bfe2-40af-4fec-9476-3a1a6957056b admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:35.242343 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1083/2171] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:29:35 2022] PUT /identity/v3/projects/eb4ea19517ec48eeb5aba23620c2ef2a/users/6e7ee5f494e64696bf6cdb03da25f5ce/roles/36909bbf31d04993bb2a9fe587b572dc => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:29:35.246727 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131fd7e7-5020-4ce4-ab3f-e8d41e32975e admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:35.256536 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131fd7e7-5020-4ce4-ab3f-e8d41e32975e admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:35.310365 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f43db77-1afc-4cec-b413-99d024522119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:35.311086 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43db77-1afc-4cec-b413-99d024522119 admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:35.311366 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43db77-1afc-4cec-b413-99d024522119 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:35.311640 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43db77-1afc-4cec-b413-99d024522119 admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:35.312353 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f43db77-1afc-4cec-b413-99d024522119 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:35.313949 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f43db77-1afc-4cec-b413-99d024522119 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:35.324137 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1089/2172] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:29:35 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:29:35.328214 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c9bfe2-40af-4fec-9476-3a1a6957056b admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:35.338271 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c9bfe2-40af-4fec-9476-3a1a6957056b admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:35.342884 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d44aced-f4af-4260-a157-abd784e53304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:35.343749 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44aced-f4af-4260-a157-abd784e53304 admin admin] REQUEST_METHOD: `PUT` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:35.344030 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44aced-f4af-4260-a157-abd784e53304 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:35.344308 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44aced-f4af-4260-a157-abd784e53304 admin admin] PATH_INFO: `/v3/projects/eb4ea19517ec48eeb5aba23620c2ef2a/users/6e7ee5f494e64696bf6cdb03da25f5ce/roles/36909bbf31d04993bb2a9fe587b572dc` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:35.346301 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d44aced-f4af-4260-a157-abd784e53304 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb4ea19517ec48eeb5aba23620c2ef2a, user_id=6e7ee5f494e64696bf6cdb03da25f5ce, role_id=36909bbf31d04993bb2a9fe587b572dc)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:35.348971 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d44aced-f4af-4260-a157-abd784e53304 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:35.358775 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1084/2173] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:29:35 2022] PUT /identity/v3/projects/eb4ea19517ec48eeb5aba23620c2ef2a/users/6e7ee5f494e64696bf6cdb03da25f5ce/roles/36909bbf31d04993bb2a9fe587b572dc => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:29:35.369819 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e169ce83-e08a-47ea-aae6-f9c9263f9a1f None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:35.370105 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e169ce83-e08a-47ea-aae6-f9c9263f9a1f None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:35.370382 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e169ce83-e08a-47ea-aae6-f9c9263f9a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:35.395910 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-e169ce83-e08a-47ea-aae6-f9c9263f9a1f None None] MFA Rules not processed for user `6e7ee5f494e64696bf6cdb03da25f5ce`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:29:35.397103 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-e169ce83-e08a-47ea-aae6-f9c9263f9a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:35.462094 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1090/2174] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:29:35 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:29:35.473920 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d44aced-f4af-4260-a157-abd784e53304 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:35.528127 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d44aced-f4af-4260-a157-abd784e53304 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:35.531764 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2a9bcf-b2a4-4e1f-8905-2b72b3dea496 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45219f386f0147b6bd380efe4ab62812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:35.532646 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a9bcf-b2a4-4e1f-8905-2b72b3dea496 service cinder] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:35.532933 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a9bcf-b2a4-4e1f-8905-2b72b3dea496 service cinder] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:35.533208 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a9bcf-b2a4-4e1f-8905-2b72b3dea496 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:35.542681 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2a9bcf-b2a4-4e1f-8905-2b72b3dea496 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:35.544127 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2a9bcf-b2a4-4e1f-8905-2b72b3dea496 service cinder] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:35.553315 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1085/2175] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:29:35 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:29:35.624531 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e169ce83-e08a-47ea-aae6-f9c9263f9a1f None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:35.633899 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e169ce83-e08a-47ea-aae6-f9c9263f9a1f None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:35.637737 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab952e64-a448-4ae5-a847-18eee9b35073 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45219f386f0147b6bd380efe4ab62812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:35.638373 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab952e64-a448-4ae5-a847-18eee9b35073 service cinder] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:35.638661 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab952e64-a448-4ae5-a847-18eee9b35073 service cinder] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:35.638973 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab952e64-a448-4ae5-a847-18eee9b35073 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:35.693701 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab952e64-a448-4ae5-a847-18eee9b35073 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:35.695194 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab952e64-a448-4ae5-a847-18eee9b35073 service cinder] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:35.704587 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1091/2176] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:29:35 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:29:43.194597 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2a9bcf-b2a4-4e1f-8905-2b72b3dea496 service cinder] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:43.196031 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-9c2a9bcf-b2a4-4e1f-8905-2b72b3dea496 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:43.271512 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab952e64-a448-4ae5-a847-18eee9b35073 service cinder] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:43.282582 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab952e64-a448-4ae5-a847-18eee9b35073 service cinder] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:43.287071 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2a9bcf-b2a4-4e1f-8905-2b72b3dea496 service cinder] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:43.287217 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3d36dc-37b4-45cc-81e7-1eb068485231 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45219f386f0147b6bd380efe4ab62812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:43.287817 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d36dc-37b4-45cc-81e7-1eb068485231 service cinder] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:43.288100 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d36dc-37b4-45cc-81e7-1eb068485231 service cinder] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:43.288375 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d36dc-37b4-45cc-81e7-1eb068485231 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:43.290292 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-6c3d36dc-37b4-45cc-81e7-1eb068485231 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:43.295556 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f3aed-41db-4ec5-90f9-c07b8ac68da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:43.296718 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f3aed-41db-4ec5-90f9-c07b8ac68da2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:43.297291 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f3aed-41db-4ec5-90f9-c07b8ac68da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:43.297769 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f3aed-41db-4ec5-90f9-c07b8ac68da2 admin admin] PATH_INFO: `/v3/users/d7f1aecfa00a458daea7a052b2a6d4fc` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:43.299336 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21f3aed-41db-4ec5-90f9-c07b8ac68da2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7f1aecfa00a458daea7a052b2a6d4fc)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:43.301850 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21f3aed-41db-4ec5-90f9-c07b8ac68da2 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:43.375206 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3d36dc-37b4-45cc-81e7-1eb068485231 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:43.376880 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3d36dc-37b4-45cc-81e7-1eb068485231 service cinder] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:43.380965 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-a21f3aed-41db-4ec5-90f9-c07b8ac68da2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7f1aecfa00a458daea7a052b2a6d4fc'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:43.387950 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1092/2177] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:29:43 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:29:43.396153 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-a21f3aed-41db-4ec5-90f9-c07b8ac68da2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7f1aecfa00a458daea7a052b2a6d4fc'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:43.408906 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-a21f3aed-41db-4ec5-90f9-c07b8ac68da2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7f1aecfa00a458daea7a052b2a6d4fc'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:43.410014 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-a21f3aed-41db-4ec5-90f9-c07b8ac68da2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7f1aecfa00a458daea7a052b2a6d4fc'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:43.419614 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-a21f3aed-41db-4ec5-90f9-c07b8ac68da2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7f1aecfa00a458daea7a052b2a6d4fc'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:43.429537 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1086/2178] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:29:43 2022] DELETE /identity/v3/users/d7f1aecfa00a458daea7a052b2a6d4fc => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:29:43.434982 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a3cb59-b837-4c9c-8715-8cf497281b03 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:43.435275 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a3cb59-b837-4c9c-8715-8cf497281b03 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:43.435672 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a3cb59-b837-4c9c-8715-8cf497281b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:43.462038 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-14a3cb59-b837-4c9c-8715-8cf497281b03 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:29:43.471802 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-14a3cb59-b837-4c9c-8715-8cf497281b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:43.544908 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1093/2179] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:29:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 01:29:43.557044 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f3aed-41db-4ec5-90f9-c07b8ac68da2 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:43.558753 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-a21f3aed-41db-4ec5-90f9-c07b8ac68da2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:43.632563 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f3aed-41db-4ec5-90f9-c07b8ac68da2 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:43.638180 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f26900c-d845-45fc-a0d7-38241c5ab723 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:43.639271 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26900c-d845-45fc-a0d7-38241c5ab723 service neutron] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:43.639684 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26900c-d845-45fc-a0d7-38241c5ab723 service neutron] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:43.640088 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26900c-d845-45fc-a0d7-38241c5ab723 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:43.654751 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f26900c-d845-45fc-a0d7-38241c5ab723 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:43.657297 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f26900c-d845-45fc-a0d7-38241c5ab723 service neutron] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:43.687234 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1087/2180] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:29:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:29:44.064908 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a3cb59-b837-4c9c-8715-8cf497281b03 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:44.066910 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-14a3cb59-b837-4c9c-8715-8cf497281b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:44.084576 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a3cb59-b837-4c9c-8715-8cf497281b03 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:44.092973 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1edd704-3fbc-42e7-b2d0-b0a44ecb3f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:44.093937 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1edd704-3fbc-42e7-b2d0-b0a44ecb3f80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:44.094396 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1edd704-3fbc-42e7-b2d0-b0a44ecb3f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:44.094788 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1edd704-3fbc-42e7-b2d0-b0a44ecb3f80 admin admin] PATH_INFO: `/v3/projects/967b00f7c3844bf2823fade44d8cd17e` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:44.096633 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1edd704-3fbc-42e7-b2d0-b0a44ecb3f80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=967b00f7c3844bf2823fade44d8cd17e)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:44.098117 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1edd704-3fbc-42e7-b2d0-b0a44ecb3f80 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:44.174088 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-b1edd704-3fbc-42e7-b2d0-b0a44ecb3f80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '967b00f7c3844bf2823fade44d8cd17e', 'request_id': 'req-b1edd704-3fbc-42e7-b2d0-b0a44ecb3f80'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:44.186078 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-b1edd704-3fbc-42e7-b2d0-b0a44ecb3f80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '967b00f7c3844bf2823fade44d8cd17e', 'request_id': 'req-b1edd704-3fbc-42e7-b2d0-b0a44ecb3f80'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:44.198515 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-b1edd704-3fbc-42e7-b2d0-b0a44ecb3f80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '967b00f7c3844bf2823fade44d8cd17e', 'request_id': 'req-b1edd704-3fbc-42e7-b2d0-b0a44ecb3f80'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:44.215442 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-b1edd704-3fbc-42e7-b2d0-b0a44ecb3f80 admin admin] The token cache is being invalidate because project 967b00f7c3844bf2823fade44d8cd17e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:29:44.215745 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-b1edd704-3fbc-42e7-b2d0-b0a44ecb3f80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:44.217595 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-b1edd704-3fbc-42e7-b2d0-b0a44ecb3f80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:44.219825 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1094/2181] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:29:44 2022] DELETE /identity/v3/projects/967b00f7c3844bf2823fade44d8cd17e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:29:44.225410 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5571eb04-5d20-4fcc-9241-4464c07c5d3f None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:44.225851 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5571eb04-5d20-4fcc-9241-4464c07c5d3f None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:44.226172 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5571eb04-5d20-4fcc-9241-4464c07c5d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:44.259025 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-5571eb04-5d20-4fcc-9241-4464c07c5d3f None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:29:44.260646 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-5571eb04-5d20-4fcc-9241-4464c07c5d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:44.339889 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1088/2182] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:29:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 01:29:44.349105 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43db92f-b9e6-4e77-b203-7a41dfa3de09 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:44.349627 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43db92f-b9e6-4e77-b203-7a41dfa3de09 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:44.349763 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43db92f-b9e6-4e77-b203-7a41dfa3de09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:44.369672 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-a43db92f-b9e6-4e77-b203-7a41dfa3de09 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:29:44.371135 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-a43db92f-b9e6-4e77-b203-7a41dfa3de09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:44.379476 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1095/2183] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:29:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:29:44.383699 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5571eb04-5d20-4fcc-9241-4464c07c5d3f None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:44.394776 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5571eb04-5d20-4fcc-9241-4464c07c5d3f None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:44.399418 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0daea5c-3aea-4b4b-a66d-c8b5a05f33a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:44.400092 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0daea5c-3aea-4b4b-a66d-c8b5a05f33a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:44.400395 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0daea5c-3aea-4b4b-a66d-c8b5a05f33a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:44.400848 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0daea5c-3aea-4b4b-a66d-c8b5a05f33a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:44.401565 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0daea5c-3aea-4b4b-a66d-c8b5a05f33a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:29:44.401872 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0daea5c-3aea-4b4b-a66d-c8b5a05f33a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:44.403509 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0daea5c-3aea-4b4b-a66d-c8b5a05f33a8 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:44.416215 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1089/2184] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Mar 30 01:29:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:29:44.420458 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43db92f-b9e6-4e77-b203-7a41dfa3de09 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:44.429356 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43db92f-b9e6-4e77-b203-7a41dfa3de09 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:44.435281 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6cef9f-5aa1-4d9e-bba7-56adb8afb899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:44.435938 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6cef9f-5aa1-4d9e-bba7-56adb8afb899 admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:44.436301 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6cef9f-5aa1-4d9e-bba7-56adb8afb899 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:44.436623 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6cef9f-5aa1-4d9e-bba7-56adb8afb899 admin admin] PATH_INFO: `/v3/projects` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:44.437331 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6cef9f-5aa1-4d9e-bba7-56adb8afb899 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:44.439410 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6cef9f-5aa1-4d9e-bba7-56adb8afb899 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:44.464857 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1096/2185] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:29:44 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:29:44.469045 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0daea5c-3aea-4b4b-a66d-c8b5a05f33a8 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:44.479427 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0daea5c-3aea-4b4b-a66d-c8b5a05f33a8 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:44.535040 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc0145d-c21b-4216-a112-f9cba8cd2d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:44.535739 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc0145d-c21b-4216-a112-f9cba8cd2d85 admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:44.536028 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc0145d-c21b-4216-a112-f9cba8cd2d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:44.536306 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc0145d-c21b-4216-a112-f9cba8cd2d85 admin admin] PATH_INFO: `/v3/users` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:44.536995 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc0145d-c21b-4216-a112-f9cba8cd2d85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:44.538910 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc0145d-c21b-4216-a112-f9cba8cd2d85 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:44.560571 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1090/2186] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:29:44 2022] POST /identity/v3/users => generated 291 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:29:44.564607 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6cef9f-5aa1-4d9e-bba7-56adb8afb899 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:44.574898 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6cef9f-5aa1-4d9e-bba7-56adb8afb899 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:44.579692 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa0554-6d3c-4840-9276-087e328423ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:44.580354 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa0554-6d3c-4840-9276-087e328423ff admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:44.580636 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa0554-6d3c-4840-9276-087e328423ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:44.581009 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa0554-6d3c-4840-9276-087e328423ff admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:44.581768 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffa0554-6d3c-4840-9276-087e328423ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:44.583430 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffa0554-6d3c-4840-9276-087e328423ff admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:44.593990 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1097/2187] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:29:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:29:44.597884 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc0145d-c21b-4216-a112-f9cba8cd2d85 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:44.608082 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc0145d-c21b-4216-a112-f9cba8cd2d85 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:44.612662 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec18e32-dd01-44fe-a935-9e12f00a0157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:44.613307 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec18e32-dd01-44fe-a935-9e12f00a0157 admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:44.613586 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec18e32-dd01-44fe-a935-9e12f00a0157 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:44.613857 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec18e32-dd01-44fe-a935-9e12f00a0157 admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:44.614583 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec18e32-dd01-44fe-a935-9e12f00a0157 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:44.616188 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec18e32-dd01-44fe-a935-9e12f00a0157 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:44.626603 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1091/2188] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:29:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:29:44.630656 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa0554-6d3c-4840-9276-087e328423ff admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:44.640316 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa0554-6d3c-4840-9276-087e328423ff admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:44.644882 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf89b4a-e594-484e-9cb7-bccfff18eb26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:44.645744 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf89b4a-e594-484e-9cb7-bccfff18eb26 admin admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:44.646023 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf89b4a-e594-484e-9cb7-bccfff18eb26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:44.646294 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf89b4a-e594-484e-9cb7-bccfff18eb26 admin admin] PATH_INFO: `/v3/projects/3c5f5559501e4265ace8a4c9b0914eb7/users/6d93afdf3a67428e8b712c00ca84277b/roles/7185d0cfbcd44502b1613bcfe1b42f6f` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:44.661112 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf89b4a-e594-484e-9cb7-bccfff18eb26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c5f5559501e4265ace8a4c9b0914eb7, user_id=6d93afdf3a67428e8b712c00ca84277b, role_id=7185d0cfbcd44502b1613bcfe1b42f6f)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:44.663864 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf89b4a-e594-484e-9cb7-bccfff18eb26 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:44.677370 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1098/2189] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:29:44 2022] PUT /identity/v3/projects/3c5f5559501e4265ace8a4c9b0914eb7/users/6d93afdf3a67428e8b712c00ca84277b/roles/7185d0cfbcd44502b1613bcfe1b42f6f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:29:44.682673 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f0b3d-3e2e-4985-8823-f258041bf5ec None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:44.682990 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f0b3d-3e2e-4985-8823-f258041bf5ec None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:44.683263 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f0b3d-3e2e-4985-8823-f258041bf5ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:44.700723 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-343f0b3d-3e2e-4985-8823-f258041bf5ec None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:29:44.701897 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-343f0b3d-3e2e-4985-8823-f258041bf5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:44.758496 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1092/2190] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:29:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:29:44.768277 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf89b4a-e594-484e-9cb7-bccfff18eb26 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:44.770072 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-bcf89b4a-e594-484e-9cb7-bccfff18eb26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:44.828937 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf89b4a-e594-484e-9cb7-bccfff18eb26 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:44.832564 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9bc598-65e7-4a08-8690-c33ebf2293f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:44.833316 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9bc598-65e7-4a08-8690-c33ebf2293f9 service neutron] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:44.833591 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9bc598-65e7-4a08-8690-c33ebf2293f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:44.833964 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9bc598-65e7-4a08-8690-c33ebf2293f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:44.843926 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9bc598-65e7-4a08-8690-c33ebf2293f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:44.845354 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9bc598-65e7-4a08-8690-c33ebf2293f9 service neutron] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:44.861127 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1099/2191] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:29:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:29:45.703630 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab1fd14-0f91-4961-8ffc-31a1f7cdcde5 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:45.704140 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab1fd14-0f91-4961-8ffc-31a1f7cdcde5 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:45.704231 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab1fd14-0f91-4961-8ffc-31a1f7cdcde5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:45.730304 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-0ab1fd14-0f91-4961-8ffc-31a1f7cdcde5 None None] MFA Rules not processed for user `6d93afdf3a67428e8b712c00ca84277b`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:29:45.731579 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-0ab1fd14-0f91-4961-8ffc-31a1f7cdcde5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:45.798822 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1093/2192] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:29:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:29:45.807070 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9bc598-65e7-4a08-8690-c33ebf2293f9 service neutron] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:45.808505 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-7a9bc598-65e7-4a08-8690-c33ebf2293f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:45.865687 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9bc598-65e7-4a08-8690-c33ebf2293f9 service neutron] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:45.870218 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98023c01-6eb8-4983-9632-3cc36e812ecc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45219f386f0147b6bd380efe4ab62812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:45.870928 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98023c01-6eb8-4983-9632-3cc36e812ecc service cinder] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:45.871213 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98023c01-6eb8-4983-9632-3cc36e812ecc service cinder] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:45.871491 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98023c01-6eb8-4983-9632-3cc36e812ecc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:45.883831 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98023c01-6eb8-4983-9632-3cc36e812ecc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:45.885836 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98023c01-6eb8-4983-9632-3cc36e812ecc service cinder] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:45.897977 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1100/2193] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:29:45 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:29:49.347515 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793cac6e-8cde-4a49-8274-1eed405cff4e None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:49.348029 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793cac6e-8cde-4a49-8274-1eed405cff4e None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:49.348126 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793cac6e-8cde-4a49-8274-1eed405cff4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:49.365808 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-793cac6e-8cde-4a49-8274-1eed405cff4e None None] MFA Rules not processed for user `6d93afdf3a67428e8b712c00ca84277b`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:29:49.367022 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-793cac6e-8cde-4a49-8274-1eed405cff4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:49.375589 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1094/2194] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:29:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:29:50.558571 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98023c01-6eb8-4983-9632-3cc36e812ecc service cinder] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:50.560162 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-98023c01-6eb8-4983-9632-3cc36e812ecc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:50.574182 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98023c01-6eb8-4983-9632-3cc36e812ecc service cinder] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:50.579434 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae6e2b1-6375-4978-87f4-630d13998891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:50.580605 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae6e2b1-6375-4978-87f4-630d13998891 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:50.580949 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae6e2b1-6375-4978-87f4-630d13998891 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:50.581232 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae6e2b1-6375-4978-87f4-630d13998891 admin admin] PATH_INFO: `/v3/users/c6e047b3989c4d83b8f1ef705fa30463` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:50.582825 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae6e2b1-6375-4978-87f4-630d13998891 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6e047b3989c4d83b8f1ef705fa30463)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:50.585260 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae6e2b1-6375-4978-87f4-630d13998891 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:50.641205 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-8ae6e2b1-6375-4978-87f4-630d13998891 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6e047b3989c4d83b8f1ef705fa30463'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:50.648783 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-8ae6e2b1-6375-4978-87f4-630d13998891 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6e047b3989c4d83b8f1ef705fa30463'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:50.649426 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-8ae6e2b1-6375-4978-87f4-630d13998891 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6e047b3989c4d83b8f1ef705fa30463'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:50.658096 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-8ae6e2b1-6375-4978-87f4-630d13998891 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6e047b3989c4d83b8f1ef705fa30463'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:50.671378 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-8ae6e2b1-6375-4978-87f4-630d13998891 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6e047b3989c4d83b8f1ef705fa30463'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:50.677679 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1101/2195] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:29:50 2022] DELETE /identity/v3/users/c6e047b3989c4d83b8f1ef705fa30463 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:29:50.682487 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2fa53-bd7d-476f-9d7e-a5128ee94ac9 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:50.682993 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2fa53-bd7d-476f-9d7e-a5128ee94ac9 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:50.683195 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2fa53-bd7d-476f-9d7e-a5128ee94ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:50.701515 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-35b2fa53-bd7d-476f-9d7e-a5128ee94ac9 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:29:50.702748 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-35b2fa53-bd7d-476f-9d7e-a5128ee94ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:50.763398 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1095/2196] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:29:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:29:50.772694 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae6e2b1-6375-4978-87f4-630d13998891 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:50.774094 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-8ae6e2b1-6375-4978-87f4-630d13998891 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:50.833657 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae6e2b1-6375-4978-87f4-630d13998891 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:50.837943 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6c6182-031b-4f1c-b785-025da4ce4990 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:50.839325 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c6182-031b-4f1c-b785-025da4ce4990 service neutron] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:50.839505 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c6182-031b-4f1c-b785-025da4ce4990 service neutron] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:50.839784 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c6182-031b-4f1c-b785-025da4ce4990 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:50.850334 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6c6182-031b-4f1c-b785-025da4ce4990 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:50.851786 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6c6182-031b-4f1c-b785-025da4ce4990 service neutron] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:50.862546 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1102/2197] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:29:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:29:51.382508 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b2fa53-bd7d-476f-9d7e-a5128ee94ac9 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:51.385017 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-35b2fa53-bd7d-476f-9d7e-a5128ee94ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:51.403387 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b2fa53-bd7d-476f-9d7e-a5128ee94ac9 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:51.410360 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2b6038-a852-41f4-9cd5-bf82b376421f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:51.411471 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2b6038-a852-41f4-9cd5-bf82b376421f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:51.411745 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2b6038-a852-41f4-9cd5-bf82b376421f admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:51.412164 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2b6038-a852-41f4-9cd5-bf82b376421f admin admin] PATH_INFO: `/v3/projects/ada485b862e34f93837708afbe0b1ad8` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:51.413523 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2b6038-a852-41f4-9cd5-bf82b376421f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ada485b862e34f93837708afbe0b1ad8)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:51.416427 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2b6038-a852-41f4-9cd5-bf82b376421f admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:51.487068 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-0e2b6038-a852-41f4-9cd5-bf82b376421f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ada485b862e34f93837708afbe0b1ad8', 'request_id': 'req-0e2b6038-a852-41f4-9cd5-bf82b376421f'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:51.499268 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-0e2b6038-a852-41f4-9cd5-bf82b376421f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ada485b862e34f93837708afbe0b1ad8', 'request_id': 'req-0e2b6038-a852-41f4-9cd5-bf82b376421f'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:51.505869 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-0e2b6038-a852-41f4-9cd5-bf82b376421f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ada485b862e34f93837708afbe0b1ad8', 'request_id': 'req-0e2b6038-a852-41f4-9cd5-bf82b376421f'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:51.522591 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-0e2b6038-a852-41f4-9cd5-bf82b376421f admin admin] The token cache is being invalidate because project ada485b862e34f93837708afbe0b1ad8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:29:51.523066 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-0e2b6038-a852-41f4-9cd5-bf82b376421f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:51.523816 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-0e2b6038-a852-41f4-9cd5-bf82b376421f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:51.526730 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1096/2198] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:29:51 2022] DELETE /identity/v3/projects/ada485b862e34f93837708afbe0b1ad8 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:29:51.531105 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6c6182-031b-4f1c-b785-025da4ce4990 service neutron] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:51.543960 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6c6182-031b-4f1c-b785-025da4ce4990 service neutron] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:51.661745 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eefc4e8-dbcd-4144-8669-970801bace62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:51.663988 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eefc4e8-dbcd-4144-8669-970801bace62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:51.664275 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eefc4e8-dbcd-4144-8669-970801bace62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:51.664555 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eefc4e8-dbcd-4144-8669-970801bace62 admin admin] PATH_INFO: `/v3/users/fc0debb3c92c447caf01fcae08cd0838` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:51.666158 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eefc4e8-dbcd-4144-8669-970801bace62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc0debb3c92c447caf01fcae08cd0838)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:51.668365 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eefc4e8-dbcd-4144-8669-970801bace62 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:51.736751 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-9eefc4e8-dbcd-4144-8669-970801bace62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc0debb3c92c447caf01fcae08cd0838'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:51.745450 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-9eefc4e8-dbcd-4144-8669-970801bace62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc0debb3c92c447caf01fcae08cd0838'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:51.746124 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-9eefc4e8-dbcd-4144-8669-970801bace62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc0debb3c92c447caf01fcae08cd0838'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:51.753282 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-9eefc4e8-dbcd-4144-8669-970801bace62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc0debb3c92c447caf01fcae08cd0838'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:51.765259 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-9eefc4e8-dbcd-4144-8669-970801bace62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc0debb3c92c447caf01fcae08cd0838'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:51.771455 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1103/2199] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:29:51 2022] DELETE /identity/v3/users/fc0debb3c92c447caf01fcae08cd0838 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:29:52.175074 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2b6038-a852-41f4-9cd5-bf82b376421f admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:52.176564 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-0e2b6038-a852-41f4-9cd5-bf82b376421f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:52.200694 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2b6038-a852-41f4-9cd5-bf82b376421f admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:52.283738 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e65be1-e74a-4386-b613-c377a808931b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:52.284999 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e65be1-e74a-4386-b613-c377a808931b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:52.285086 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e65be1-e74a-4386-b613-c377a808931b admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:52.288376 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e65be1-e74a-4386-b613-c377a808931b admin admin] PATH_INFO: `/v3/projects/556900ee811e4967bd1592bffa32ec82` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:52.289318 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e65be1-e74a-4386-b613-c377a808931b admin admin] RBAC: Authorizing `identity:delete_project(project_id=556900ee811e4967bd1592bffa32ec82)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:52.292045 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e65be1-e74a-4386-b613-c377a808931b admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:52.348590 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-26e65be1-e74a-4386-b613-c377a808931b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '556900ee811e4967bd1592bffa32ec82', 'request_id': 'req-26e65be1-e74a-4386-b613-c377a808931b'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:52.363105 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-26e65be1-e74a-4386-b613-c377a808931b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '556900ee811e4967bd1592bffa32ec82', 'request_id': 'req-26e65be1-e74a-4386-b613-c377a808931b'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:52.378610 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-26e65be1-e74a-4386-b613-c377a808931b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '556900ee811e4967bd1592bffa32ec82', 'request_id': 'req-26e65be1-e74a-4386-b613-c377a808931b'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:52.396049 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-26e65be1-e74a-4386-b613-c377a808931b admin admin] The token cache is being invalidate because project 556900ee811e4967bd1592bffa32ec82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:29:52.396696 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-26e65be1-e74a-4386-b613-c377a808931b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:52.397519 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-26e65be1-e74a-4386-b613-c377a808931b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:52.402114 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1097/2200] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:29:52 2022] DELETE /identity/v3/projects/556900ee811e4967bd1592bffa32ec82 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:29:52.408506 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d632e8-7f1a-435d-8b3c-58f0bf5a0825 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:52.409474 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d632e8-7f1a-435d-8b3c-58f0bf5a0825 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:52.409787 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d632e8-7f1a-435d-8b3c-58f0bf5a0825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:52.433846 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-87d632e8-7f1a-435d-8b3c-58f0bf5a0825 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:29:52.435189 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-87d632e8-7f1a-435d-8b3c-58f0bf5a0825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:52.496326 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1104/2201] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:29:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:29:52.504701 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc51c85d-acfc-47a7-9ae4-3e358432a0a4 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:52.504992 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc51c85d-acfc-47a7-9ae4-3e358432a0a4 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:52.505273 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc51c85d-acfc-47a7-9ae4-3e358432a0a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:52.523686 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-fc51c85d-acfc-47a7-9ae4-3e358432a0a4 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:29:52.525385 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-fc51c85d-acfc-47a7-9ae4-3e358432a0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:52.533847 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1098/2202] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:29:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:29:52.538015 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d632e8-7f1a-435d-8b3c-58f0bf5a0825 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:52.548745 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d632e8-7f1a-435d-8b3c-58f0bf5a0825 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:52.553482 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2690c2e-79e7-4133-b290-13edf5645d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:52.554078 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2690c2e-79e7-4133-b290-13edf5645d26 admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:52.554435 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2690c2e-79e7-4133-b290-13edf5645d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:52.554744 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2690c2e-79e7-4133-b290-13edf5645d26 admin admin] PATH_INFO: `/v3/domains` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:52.555479 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2690c2e-79e7-4133-b290-13edf5645d26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:29:52.555792 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2690c2e-79e7-4133-b290-13edf5645d26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:52.557842 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2690c2e-79e7-4133-b290-13edf5645d26 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:52.571656 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1105/2203] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Mar 30 01:29:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:29:52.579853 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc51c85d-acfc-47a7-9ae4-3e358432a0a4 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:52.591985 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc51c85d-acfc-47a7-9ae4-3e358432a0a4 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:52.597052 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ecd74a-7c3f-4365-bea5-0b9630571556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:52.597701 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ecd74a-7c3f-4365-bea5-0b9630571556 admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:52.598033 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ecd74a-7c3f-4365-bea5-0b9630571556 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:52.598312 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ecd74a-7c3f-4365-bea5-0b9630571556 admin admin] PATH_INFO: `/v3/projects` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:52.599062 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ecd74a-7c3f-4365-bea5-0b9630571556 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:52.600986 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ecd74a-7c3f-4365-bea5-0b9630571556 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:52.631462 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1099/2204] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:29:52 2022] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:29:52.635944 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2690c2e-79e7-4133-b290-13edf5645d26 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:52.646020 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2690c2e-79e7-4133-b290-13edf5645d26 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:52.705891 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c384a9-ab20-4dc3-bc12-1889d4a60a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:52.706673 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c384a9-ab20-4dc3-bc12-1889d4a60a73 admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:52.706881 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c384a9-ab20-4dc3-bc12-1889d4a60a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:52.707159 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c384a9-ab20-4dc3-bc12-1889d4a60a73 admin admin] PATH_INFO: `/v3/users` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:52.707859 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c384a9-ab20-4dc3-bc12-1889d4a60a73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:52.709766 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c384a9-ab20-4dc3-bc12-1889d4a60a73 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:52.731894 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1106/2205] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:29:52 2022] POST /identity/v3/users => generated 290 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 01:29:52.736468 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ecd74a-7c3f-4365-bea5-0b9630571556 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:52.747582 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ecd74a-7c3f-4365-bea5-0b9630571556 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:52.753090 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9382da5-194a-49f4-8dbb-b8f36c7850bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:52.754319 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9382da5-194a-49f4-8dbb-b8f36c7850bf admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:52.755077 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9382da5-194a-49f4-8dbb-b8f36c7850bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:52.755346 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9382da5-194a-49f4-8dbb-b8f36c7850bf admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:52.756339 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9382da5-194a-49f4-8dbb-b8f36c7850bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:52.758158 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9382da5-194a-49f4-8dbb-b8f36c7850bf admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:52.771912 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1100/2206] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:29:52.776877 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c384a9-ab20-4dc3-bc12-1889d4a60a73 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:52.787980 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c384a9-ab20-4dc3-bc12-1889d4a60a73 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:52.793172 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2443a4-e716-454d-8eb3-62db2b441678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:52.794041 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2443a4-e716-454d-8eb3-62db2b441678 admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:52.794324 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2443a4-e716-454d-8eb3-62db2b441678 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:52.794595 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2443a4-e716-454d-8eb3-62db2b441678 admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:52.795356 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2443a4-e716-454d-8eb3-62db2b441678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:52.796965 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2443a4-e716-454d-8eb3-62db2b441678 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:52.807833 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1107/2207] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 01:29:52.812057 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9382da5-194a-49f4-8dbb-b8f36c7850bf admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:52.835931 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9382da5-194a-49f4-8dbb-b8f36c7850bf admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:52.843375 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5724feca-1a60-4513-9a1f-de736a02b572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:52.844480 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5724feca-1a60-4513-9a1f-de736a02b572 admin admin] REQUEST_METHOD: `PUT` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:52.844972 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5724feca-1a60-4513-9a1f-de736a02b572 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:52.845426 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5724feca-1a60-4513-9a1f-de736a02b572 admin admin] PATH_INFO: `/v3/projects/bf416da554734eada769e304b4e0c9fe/users/11706fa538d04262a31a90e75b6ff75c/roles/7185d0cfbcd44502b1613bcfe1b42f6f` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:52.862774 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5724feca-1a60-4513-9a1f-de736a02b572 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf416da554734eada769e304b4e0c9fe, user_id=11706fa538d04262a31a90e75b6ff75c, role_id=7185d0cfbcd44502b1613bcfe1b42f6f)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:52.865986 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5724feca-1a60-4513-9a1f-de736a02b572 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:52.885948 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1101/2208] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:29:52 2022] PUT /identity/v3/projects/bf416da554734eada769e304b4e0c9fe/users/11706fa538d04262a31a90e75b6ff75c/roles/7185d0cfbcd44502b1613bcfe1b42f6f => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:29:52.897823 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174c1d2-d9e8-4df7-be65-00e2fbc16dec None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:52.898112 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174c1d2-d9e8-4df7-be65-00e2fbc16dec None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:52.898405 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174c1d2-d9e8-4df7-be65-00e2fbc16dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:52.929707 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-3174c1d2-d9e8-4df7-be65-00e2fbc16dec None None] MFA Rules not processed for user `11706fa538d04262a31a90e75b6ff75c`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:29:52.932162 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-3174c1d2-d9e8-4df7-be65-00e2fbc16dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:53.023399 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1108/2209] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:29:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 01:29:53.036741 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5724feca-1a60-4513-9a1f-de736a02b572 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:53.039228 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-5724feca-1a60-4513-9a1f-de736a02b572 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:53.175613 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5724feca-1a60-4513-9a1f-de736a02b572 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:53.185941 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e12dcb-7351-4bc5-a330-c4831c35914b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45219f386f0147b6bd380efe4ab62812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:53.187790 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e12dcb-7351-4bc5-a330-c4831c35914b service cinder] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:53.188484 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e12dcb-7351-4bc5-a330-c4831c35914b service cinder] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:53.189023 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e12dcb-7351-4bc5-a330-c4831c35914b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:53.201042 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e12dcb-7351-4bc5-a330-c4831c35914b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:53.203212 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e12dcb-7351-4bc5-a330-c4831c35914b service cinder] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:53.216814 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1102/2210] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:29:53 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:29:54.845159 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c348e2-3ebe-4265-a5fd-7f0a1f0e0e80 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:54.845860 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c348e2-3ebe-4265-a5fd-7f0a1f0e0e80 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:54.845860 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c348e2-3ebe-4265-a5fd-7f0a1f0e0e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:54.864207 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-07c348e2-3ebe-4265-a5fd-7f0a1f0e0e80 None None] MFA Rules not processed for user `a0d44eb4367940a8b21f99fc063939e4`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:29:54.865453 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-07c348e2-3ebe-4265-a5fd-7f0a1f0e0e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:54.924280 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1109/2211] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:29:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 01:29:55.937706 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e12dcb-7351-4bc5-a330-c4831c35914b service cinder] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:56.007821 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e12dcb-7351-4bc5-a330-c4831c35914b service cinder] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:56.013244 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58e13b0-e5bd-4665-a8f3-0c21253230e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:56.014270 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e13b0-e5bd-4665-a8f3-0c21253230e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:56.014559 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e13b0-e5bd-4665-a8f3-0c21253230e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:56.014867 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e13b0-e5bd-4665-a8f3-0c21253230e0 admin admin] PATH_INFO: `/v3/users/11706fa538d04262a31a90e75b6ff75c` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:56.016066 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58e13b0-e5bd-4665-a8f3-0c21253230e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11706fa538d04262a31a90e75b6ff75c)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:56.018048 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58e13b0-e5bd-4665-a8f3-0c21253230e0 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:56.071322 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-a58e13b0-e5bd-4665-a8f3-0c21253230e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11706fa538d04262a31a90e75b6ff75c'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:56.085859 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-a58e13b0-e5bd-4665-a8f3-0c21253230e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11706fa538d04262a31a90e75b6ff75c'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:56.093907 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-a58e13b0-e5bd-4665-a8f3-0c21253230e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11706fa538d04262a31a90e75b6ff75c'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:56.094672 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-a58e13b0-e5bd-4665-a8f3-0c21253230e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11706fa538d04262a31a90e75b6ff75c'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:56.101819 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-a58e13b0-e5bd-4665-a8f3-0c21253230e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11706fa538d04262a31a90e75b6ff75c'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:56.109023 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1103/2212] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:29:55 2022] DELETE /identity/v3/users/11706fa538d04262a31a90e75b6ff75c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:29:56.113187 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1fba58-8ce7-4719-91d7-6658441f1c87 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:56.113691 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1fba58-8ce7-4719-91d7-6658441f1c87 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:56.113768 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1fba58-8ce7-4719-91d7-6658441f1c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:56.135515 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-ea1fba58-8ce7-4719-91d7-6658441f1c87 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:29:56.136814 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-ea1fba58-8ce7-4719-91d7-6658441f1c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:56.202768 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1110/2213] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:29:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:29:56.212858 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58e13b0-e5bd-4665-a8f3-0c21253230e0 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:56.214383 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-a58e13b0-e5bd-4665-a8f3-0c21253230e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:56.272201 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58e13b0-e5bd-4665-a8f3-0c21253230e0 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:56.277311 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a9325-395f-48fb-a43c-0fdb2136695e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:56.277966 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a9325-395f-48fb-a43c-0fdb2136695e service neutron] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:56.278253 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a9325-395f-48fb-a43c-0fdb2136695e service neutron] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:56.278558 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a9325-395f-48fb-a43c-0fdb2136695e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:56.288551 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1a9325-395f-48fb-a43c-0fdb2136695e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:56.289969 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1a9325-395f-48fb-a43c-0fdb2136695e service neutron] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:56.300032 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1104/2214] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:29:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:29:56.580121 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1fba58-8ce7-4719-91d7-6658441f1c87 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:56.582052 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-ea1fba58-8ce7-4719-91d7-6658441f1c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:56.626931 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1fba58-8ce7-4719-91d7-6658441f1c87 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:56.634227 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506696b9-70a4-4aa3-a464-233932373c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:56.635368 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506696b9-70a4-4aa3-a464-233932373c1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:56.635846 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506696b9-70a4-4aa3-a464-233932373c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:56.636367 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506696b9-70a4-4aa3-a464-233932373c1c admin admin] PATH_INFO: `/v3/projects/bf416da554734eada769e304b4e0c9fe` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:56.638606 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506696b9-70a4-4aa3-a464-233932373c1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf416da554734eada769e304b4e0c9fe)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:56.640771 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506696b9-70a4-4aa3-a464-233932373c1c admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:56.753011 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-506696b9-70a4-4aa3-a464-233932373c1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf416da554734eada769e304b4e0c9fe', 'request_id': 'req-506696b9-70a4-4aa3-a464-233932373c1c'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:56.761417 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-506696b9-70a4-4aa3-a464-233932373c1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf416da554734eada769e304b4e0c9fe', 'request_id': 'req-506696b9-70a4-4aa3-a464-233932373c1c'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:56.780954 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-506696b9-70a4-4aa3-a464-233932373c1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf416da554734eada769e304b4e0c9fe', 'request_id': 'req-506696b9-70a4-4aa3-a464-233932373c1c'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:56.794204 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-506696b9-70a4-4aa3-a464-233932373c1c admin admin] The token cache is being invalidate because project bf416da554734eada769e304b4e0c9fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:29:56.794510 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-506696b9-70a4-4aa3-a464-233932373c1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:56.795210 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-506696b9-70a4-4aa3-a464-233932373c1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:29:56.800206 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1111/2215] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:29:56 2022] DELETE /identity/v3/projects/bf416da554734eada769e304b4e0c9fe => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:29:56.803325 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77544a7-4d9c-42fa-9717-65f74896caf3 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:56.803775 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77544a7-4d9c-42fa-9717-65f74896caf3 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:56.803912 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77544a7-4d9c-42fa-9717-65f74896caf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:56.838137 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-f77544a7-4d9c-42fa-9717-65f74896caf3 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:29:56.839895 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-f77544a7-4d9c-42fa-9717-65f74896caf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:56.908006 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1105/2216] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:29:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:29:56.916626 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa5d3a-9b2d-40b2-9466-5d58415a2966 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:56.916626 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa5d3a-9b2d-40b2-9466-5d58415a2966 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:56.917091 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa5d3a-9b2d-40b2-9466-5d58415a2966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:56.936942 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-1cfa5d3a-9b2d-40b2-9466-5d58415a2966 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:29:56.938234 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-1cfa5d3a-9b2d-40b2-9466-5d58415a2966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:56.950131 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1112/2217] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:29:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:29:56.952455 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77544a7-4d9c-42fa-9717-65f74896caf3 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:56.963582 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77544a7-4d9c-42fa-9717-65f74896caf3 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:56.968466 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9e020a-0cb9-4d8a-93ec-fb1118f26a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:56.969143 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e020a-0cb9-4d8a-93ec-fb1118f26a6e admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:56.969739 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e020a-0cb9-4d8a-93ec-fb1118f26a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:56.969999 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e020a-0cb9-4d8a-93ec-fb1118f26a6e admin admin] PATH_INFO: `/v3/domains` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:56.970769 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9e020a-0cb9-4d8a-93ec-fb1118f26a6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:29:56.971080 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9e020a-0cb9-4d8a-93ec-fb1118f26a6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:56.972676 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9e020a-0cb9-4d8a-93ec-fb1118f26a6e admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:56.988359 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1106/2218] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Mar 30 01:29:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:29:56.989827 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa5d3a-9b2d-40b2-9466-5d58415a2966 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:57.001537 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa5d3a-9b2d-40b2-9466-5d58415a2966 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:57.006145 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb77f9-533c-4d96-9c39-7180520ab951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:57.006956 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb77f9-533c-4d96-9c39-7180520ab951 admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:57.007238 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb77f9-533c-4d96-9c39-7180520ab951 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:57.007511 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb77f9-533c-4d96-9c39-7180520ab951 admin admin] PATH_INFO: `/v3/projects` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:57.008210 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cb77f9-533c-4d96-9c39-7180520ab951 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:57.010853 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cb77f9-533c-4d96-9c39-7180520ab951 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:57.038016 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1113/2219] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:29:56 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:29:57.042357 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9e020a-0cb9-4d8a-93ec-fb1118f26a6e admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:57.053220 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9e020a-0cb9-4d8a-93ec-fb1118f26a6e admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:57.115535 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef1499b-d0a9-4c20-9a46-2295062db5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:57.116250 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef1499b-d0a9-4c20-9a46-2295062db5bb admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:57.116538 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef1499b-d0a9-4c20-9a46-2295062db5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:57.116825 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef1499b-d0a9-4c20-9a46-2295062db5bb admin admin] PATH_INFO: `/v3/users` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:57.117674 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef1499b-d0a9-4c20-9a46-2295062db5bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:57.120510 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef1499b-d0a9-4c20-9a46-2295062db5bb admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:57.146142 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1107/2220] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:29:57 2022] POST /identity/v3/users => generated 290 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:29:57.149175 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb77f9-533c-4d96-9c39-7180520ab951 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:57.159812 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb77f9-533c-4d96-9c39-7180520ab951 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:57.165667 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed6bdc-7498-4b50-ad00-81f892c949f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:57.166372 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed6bdc-7498-4b50-ad00-81f892c949f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:57.166657 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed6bdc-7498-4b50-ad00-81f892c949f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:57.166966 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed6bdc-7498-4b50-ad00-81f892c949f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:57.167696 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ed6bdc-7498-4b50-ad00-81f892c949f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:57.169298 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ed6bdc-7498-4b50-ad00-81f892c949f0 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:57.179969 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1114/2221] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:29:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:29:57.184668 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef1499b-d0a9-4c20-9a46-2295062db5bb admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:57.199434 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef1499b-d0a9-4c20-9a46-2295062db5bb admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:57.204329 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3818042-9ac6-4d5f-b5c5-5ee21a7c936e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:57.204997 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3818042-9ac6-4d5f-b5c5-5ee21a7c936e admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:57.205281 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3818042-9ac6-4d5f-b5c5-5ee21a7c936e admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:57.205561 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3818042-9ac6-4d5f-b5c5-5ee21a7c936e admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:57.206610 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3818042-9ac6-4d5f-b5c5-5ee21a7c936e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:57.208947 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3818042-9ac6-4d5f-b5c5-5ee21a7c936e admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:57.223260 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1108/2222] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:29:57 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:29:57.224699 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed6bdc-7498-4b50-ad00-81f892c949f0 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:57.239277 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed6bdc-7498-4b50-ad00-81f892c949f0 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:57.245447 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e653f3f-f1c5-4267-b855-7352aa6fb9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:57.246341 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e653f3f-f1c5-4267-b855-7352aa6fb9b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:57.246855 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e653f3f-f1c5-4267-b855-7352aa6fb9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:57.247313 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e653f3f-f1c5-4267-b855-7352aa6fb9b3 admin admin] PATH_INFO: `/v3/projects/e85d97e5ef8a4dc3a0fed53b8b299a52/users/35958469e64e490f919742685700caa9/roles/7185d0cfbcd44502b1613bcfe1b42f6f` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:57.267937 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e653f3f-f1c5-4267-b855-7352aa6fb9b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e85d97e5ef8a4dc3a0fed53b8b299a52, user_id=35958469e64e490f919742685700caa9, role_id=7185d0cfbcd44502b1613bcfe1b42f6f)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:57.271500 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e653f3f-f1c5-4267-b855-7352aa6fb9b3 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:57.287189 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1115/2223] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:29:57 2022] PUT /identity/v3/projects/e85d97e5ef8a4dc3a0fed53b8b299a52/users/35958469e64e490f919742685700caa9/roles/7185d0cfbcd44502b1613bcfe1b42f6f => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:29:57.292577 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62d930-f565-4e16-a286-4ab2bdb8b548 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:57.292865 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62d930-f565-4e16-a286-4ab2bdb8b548 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:57.293284 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62d930-f565-4e16-a286-4ab2bdb8b548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:57.321374 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-2c62d930-f565-4e16-a286-4ab2bdb8b548 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:29:57.323302 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-2c62d930-f565-4e16-a286-4ab2bdb8b548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:57.406637 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1109/2224] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:29:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:29:57.426230 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e653f3f-f1c5-4267-b855-7352aa6fb9b3 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:29:57.428052 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-8e653f3f-f1c5-4267-b855-7352aa6fb9b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:29:57.512337 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e653f3f-f1c5-4267-b855-7352aa6fb9b3 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:29:57.519582 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0297f4ae-3840-460e-af56-60d285e81ddc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:29:57.520649 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0297f4ae-3840-460e-af56-60d285e81ddc service neutron] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:29:57.520931 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0297f4ae-3840-460e-af56-60d285e81ddc service neutron] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:29:57.521208 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0297f4ae-3840-460e-af56-60d285e81ddc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:29:57.533235 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0297f4ae-3840-460e-af56-60d285e81ddc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:29:57.535010 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0297f4ae-3840-460e-af56-60d285e81ddc service neutron] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:29:57.546986 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1116/2225] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:29:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:30:03.110082 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829d0f7-e23b-4e2d-a691-60d82c4bc680 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:03.110622 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829d0f7-e23b-4e2d-a691-60d82c4bc680 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:03.110622 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829d0f7-e23b-4e2d-a691-60d82c4bc680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:03.152401 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-f829d0f7-e23b-4e2d-a691-60d82c4bc680 None None] MFA Rules not processed for user `35958469e64e490f919742685700caa9`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:30:03.153622 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-f829d0f7-e23b-4e2d-a691-60d82c4bc680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:30:03.263943 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1110/2226] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:30:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:30:03.268393 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0297f4ae-3840-460e-af56-60d285e81ddc service neutron] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:30:03.286900 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0297f4ae-3840-460e-af56-60d285e81ddc service neutron] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:30:03.292298 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f55446-c2d0-4163-b6dd-c1bd7b8fa33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:30:03.293310 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f55446-c2d0-4163-b6dd-c1bd7b8fa33d admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:03.293819 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f55446-c2d0-4163-b6dd-c1bd7b8fa33d admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:03.294600 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f55446-c2d0-4163-b6dd-c1bd7b8fa33d admin admin] PATH_INFO: `/v3/projects` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:03.295702 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f55446-c2d0-4163-b6dd-c1bd7b8fa33d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:30:03.298275 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f55446-c2d0-4163-b6dd-c1bd7b8fa33d admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:30:03.355900 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f829d0f7-e23b-4e2d-a691-60d82c4bc680 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:30:03.356557 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1117/2227] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:30:03 2022] POST /identity/v3/projects => generated 377 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:30:03.381266 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f829d0f7-e23b-4e2d-a691-60d82c4bc680 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:30:03.489113 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd2e7cb-3a8a-4793-95b2-01b691d1f352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:30:03.490088 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd2e7cb-3a8a-4793-95b2-01b691d1f352 admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:03.490541 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd2e7cb-3a8a-4793-95b2-01b691d1f352 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:03.490886 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd2e7cb-3a8a-4793-95b2-01b691d1f352 admin admin] PATH_INFO: `/v3/users` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:03.491590 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd2e7cb-3a8a-4793-95b2-01b691d1f352 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:30:03.494094 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd2e7cb-3a8a-4793-95b2-01b691d1f352 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:30:03.520348 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1111/2228] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:30:03 2022] POST /identity/v3/users => generated 295 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 01:30:03.524394 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f55446-c2d0-4163-b6dd-c1bd7b8fa33d admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:30:03.536104 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f55446-c2d0-4163-b6dd-c1bd7b8fa33d admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:30:03.541707 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd3c97-84ab-484b-b334-08be2bcd96ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:30:03.542274 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd3c97-84ab-484b-b334-08be2bcd96ab admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:03.542559 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd3c97-84ab-484b-b334-08be2bcd96ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:03.542929 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd3c97-84ab-484b-b334-08be2bcd96ab admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:03.543656 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcd3c97-84ab-484b-b334-08be2bcd96ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:30:03.545439 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcd3c97-84ab-484b-b334-08be2bcd96ab admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:30:03.562829 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1118/2229] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:30:03 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:30:03.568311 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd2e7cb-3a8a-4793-95b2-01b691d1f352 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:30:03.579824 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd2e7cb-3a8a-4793-95b2-01b691d1f352 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:30:03.584949 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad62e5d0-caaf-497f-83d4-48194adc2f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:30:03.586003 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62e5d0-caaf-497f-83d4-48194adc2f36 admin admin] REQUEST_METHOD: `PUT` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:03.586358 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62e5d0-caaf-497f-83d4-48194adc2f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:03.586576 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62e5d0-caaf-497f-83d4-48194adc2f36 admin admin] PATH_INFO: `/v3/projects/e8d04ccbb0464a5d9c3bc1835e4d48b0/users/388f989915d543eb950e29989d491854/roles/36909bbf31d04993bb2a9fe587b572dc` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:03.602594 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad62e5d0-caaf-497f-83d4-48194adc2f36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8d04ccbb0464a5d9c3bc1835e4d48b0, user_id=388f989915d543eb950e29989d491854, role_id=36909bbf31d04993bb2a9fe587b572dc)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:30:03.605583 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad62e5d0-caaf-497f-83d4-48194adc2f36 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:30:03.627166 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1112/2230] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:30:03 2022] PUT /identity/v3/projects/e8d04ccbb0464a5d9c3bc1835e4d48b0/users/388f989915d543eb950e29989d491854/roles/36909bbf31d04993bb2a9fe587b572dc => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:30:03.631128 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd3c97-84ab-484b-b334-08be2bcd96ab admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:30:03.642257 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd3c97-84ab-484b-b334-08be2bcd96ab admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:30:03.703644 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a85cf8-6a6f-4d8e-a41a-fe4b2afb58ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:30:03.704328 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a85cf8-6a6f-4d8e-a41a-fe4b2afb58ec admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:03.704614 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a85cf8-6a6f-4d8e-a41a-fe4b2afb58ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:03.704891 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a85cf8-6a6f-4d8e-a41a-fe4b2afb58ec admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:03.705649 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a85cf8-6a6f-4d8e-a41a-fe4b2afb58ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:30:03.709647 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a85cf8-6a6f-4d8e-a41a-fe4b2afb58ec admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:30:03.719673 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1119/2231] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:30:03 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:30:03.724666 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad62e5d0-caaf-497f-83d4-48194adc2f36 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:30:03.735822 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad62e5d0-caaf-497f-83d4-48194adc2f36 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:30:03.740684 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f363d-9330-4741-a478-5fa2dfe72ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:30:03.741496 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f363d-9330-4741-a478-5fa2dfe72ab7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:03.741775 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f363d-9330-4741-a478-5fa2dfe72ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:03.742046 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f363d-9330-4741-a478-5fa2dfe72ab7 admin admin] PATH_INFO: `/v3/projects/e8d04ccbb0464a5d9c3bc1835e4d48b0/users/388f989915d543eb950e29989d491854/roles/36909bbf31d04993bb2a9fe587b572dc` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:03.745042 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6f363d-9330-4741-a478-5fa2dfe72ab7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8d04ccbb0464a5d9c3bc1835e4d48b0, user_id=388f989915d543eb950e29989d491854, role_id=36909bbf31d04993bb2a9fe587b572dc)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:30:03.747710 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6f363d-9330-4741-a478-5fa2dfe72ab7 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:30:03.757891 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1113/2232] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:30:03 2022] PUT /identity/v3/projects/e8d04ccbb0464a5d9c3bc1835e4d48b0/users/388f989915d543eb950e29989d491854/roles/36909bbf31d04993bb2a9fe587b572dc => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:30:10.329153 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e40519-10d4-4b7f-a8ca-2c3af908c41c None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:10.329609 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e40519-10d4-4b7f-a8ca-2c3af908c41c None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:10.329715 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e40519-10d4-4b7f-a8ca-2c3af908c41c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:10.370824 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-d2e40519-10d4-4b7f-a8ca-2c3af908c41c None None] MFA Rules not processed for user `388f989915d543eb950e29989d491854`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:30:10.372491 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-d2e40519-10d4-4b7f-a8ca-2c3af908c41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:30:10.518688 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1120/2233] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:30:10 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:30:10.528123 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f363d-9330-4741-a478-5fa2dfe72ab7 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:30:10.530169 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-dd6f363d-9330-4741-a478-5fa2dfe72ab7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:30:10.694187 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f363d-9330-4741-a478-5fa2dfe72ab7 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:30:10.719924 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942b4149-db36-46a6-9f99-214a4137ee97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140c6d1a20e94192bde06e72040f162d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:30:10.720586 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b4149-db36-46a6-9f99-214a4137ee97 service nova] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:10.720872 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b4149-db36-46a6-9f99-214a4137ee97 service nova] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:10.721151 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b4149-db36-46a6-9f99-214a4137ee97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:10.814865 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942b4149-db36-46a6-9f99-214a4137ee97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:30:10.816821 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942b4149-db36-46a6-9f99-214a4137ee97 service nova] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:30:10.838083 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1114/2234] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:30:10 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:30:21.385283 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e40519-10d4-4b7f-a8ca-2c3af908c41c None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:30:21.386913 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-d2e40519-10d4-4b7f-a8ca-2c3af908c41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:30:21.491006 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e40519-10d4-4b7f-a8ca-2c3af908c41c None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:30:21.496497 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7762eb96-ee25-4fc1-b6a2-290478d2ca85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:30:21.497502 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7762eb96-ee25-4fc1-b6a2-290478d2ca85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:21.497787 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7762eb96-ee25-4fc1-b6a2-290478d2ca85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:21.498060 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7762eb96-ee25-4fc1-b6a2-290478d2ca85 admin admin] PATH_INFO: `/v3/users/23585756d4bc4e30b29322c09e5e5235` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:21.503382 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7762eb96-ee25-4fc1-b6a2-290478d2ca85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23585756d4bc4e30b29322c09e5e5235)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:30:21.505632 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7762eb96-ee25-4fc1-b6a2-290478d2ca85 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:30:21.559594 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-7762eb96-ee25-4fc1-b6a2-290478d2ca85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23585756d4bc4e30b29322c09e5e5235'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:30:21.569021 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-7762eb96-ee25-4fc1-b6a2-290478d2ca85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23585756d4bc4e30b29322c09e5e5235'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:30:21.569679 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-7762eb96-ee25-4fc1-b6a2-290478d2ca85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23585756d4bc4e30b29322c09e5e5235'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:30:21.587215 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-7762eb96-ee25-4fc1-b6a2-290478d2ca85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23585756d4bc4e30b29322c09e5e5235'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:30:21.604726 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-7762eb96-ee25-4fc1-b6a2-290478d2ca85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23585756d4bc4e30b29322c09e5e5235'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:30:21.611863 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1121/2235] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:30:21 2022] DELETE /identity/v3/users/23585756d4bc4e30b29322c09e5e5235 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:30:21.617174 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d7d22-cd9a-4490-ba35-330eb3deafc7 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:21.618300 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d7d22-cd9a-4490-ba35-330eb3deafc7 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:21.618849 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d7d22-cd9a-4490-ba35-330eb3deafc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:21.644864 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-c72d7d22-cd9a-4490-ba35-330eb3deafc7 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:30:21.646025 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-c72d7d22-cd9a-4490-ba35-330eb3deafc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:30:21.720063 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1115/2236] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:30:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:30:21.729159 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7762eb96-ee25-4fc1-b6a2-290478d2ca85 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:30:21.730556 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-7762eb96-ee25-4fc1-b6a2-290478d2ca85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:30:21.790306 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7762eb96-ee25-4fc1-b6a2-290478d2ca85 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:30:21.795476 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377eb2d1-f778-4686-bd4c-55ede4ef2450 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:30:21.796611 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377eb2d1-f778-4686-bd4c-55ede4ef2450 service neutron] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:21.797124 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377eb2d1-f778-4686-bd4c-55ede4ef2450 service neutron] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:21.797481 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377eb2d1-f778-4686-bd4c-55ede4ef2450 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:21.810373 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377eb2d1-f778-4686-bd4c-55ede4ef2450 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:30:21.811952 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377eb2d1-f778-4686-bd4c-55ede4ef2450 service neutron] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:30:21.822166 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1122/2237] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:30:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:30:22.099135 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72d7d22-cd9a-4490-ba35-330eb3deafc7 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:30:22.100816 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-c72d7d22-cd9a-4490-ba35-330eb3deafc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:30:22.120190 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72d7d22-cd9a-4490-ba35-330eb3deafc7 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:30:22.125126 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e941d702-e30e-4e83-9719-a5e07da7b708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:30:22.126379 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941d702-e30e-4e83-9719-a5e07da7b708 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:22.127026 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941d702-e30e-4e83-9719-a5e07da7b708 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:22.129590 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941d702-e30e-4e83-9719-a5e07da7b708 admin admin] PATH_INFO: `/v3/projects/d77e3304ee204d41996c14196317046c` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:22.131149 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e941d702-e30e-4e83-9719-a5e07da7b708 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d77e3304ee204d41996c14196317046c)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:30:22.133047 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e941d702-e30e-4e83-9719-a5e07da7b708 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:30:22.183123 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-e941d702-e30e-4e83-9719-a5e07da7b708 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd77e3304ee204d41996c14196317046c', 'request_id': 'req-e941d702-e30e-4e83-9719-a5e07da7b708'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:30:22.192292 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-e941d702-e30e-4e83-9719-a5e07da7b708 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd77e3304ee204d41996c14196317046c', 'request_id': 'req-e941d702-e30e-4e83-9719-a5e07da7b708'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:30:22.198414 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-e941d702-e30e-4e83-9719-a5e07da7b708 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd77e3304ee204d41996c14196317046c', 'request_id': 'req-e941d702-e30e-4e83-9719-a5e07da7b708'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:30:22.210194 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-e941d702-e30e-4e83-9719-a5e07da7b708 admin admin] The token cache is being invalidate because project d77e3304ee204d41996c14196317046c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:30:22.210731 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-e941d702-e30e-4e83-9719-a5e07da7b708 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:30:22.211502 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-e941d702-e30e-4e83-9719-a5e07da7b708 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:30:22.213304 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1116/2238] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:30:22 2022] DELETE /identity/v3/projects/d77e3304ee204d41996c14196317046c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:30:22.217346 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377eb2d1-f778-4686-bd4c-55ede4ef2450 service neutron] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:30:22.227081 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377eb2d1-f778-4686-bd4c-55ede4ef2450 service neutron] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:30:22.301540 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fbbdca-b165-4c02-81e1-ae01481bbafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:30:22.302450 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fbbdca-b165-4c02-81e1-ae01481bbafe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:22.302768 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fbbdca-b165-4c02-81e1-ae01481bbafe admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:22.303048 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fbbdca-b165-4c02-81e1-ae01481bbafe admin admin] PATH_INFO: `/v3/users/6e7ee5f494e64696bf6cdb03da25f5ce` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:22.304246 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fbbdca-b165-4c02-81e1-ae01481bbafe admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e7ee5f494e64696bf6cdb03da25f5ce)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:30:22.306156 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fbbdca-b165-4c02-81e1-ae01481bbafe admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:30:22.351682 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-51fbbdca-b165-4c02-81e1-ae01481bbafe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e7ee5f494e64696bf6cdb03da25f5ce'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:30:22.358674 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-51fbbdca-b165-4c02-81e1-ae01481bbafe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e7ee5f494e64696bf6cdb03da25f5ce'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:30:22.359330 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-51fbbdca-b165-4c02-81e1-ae01481bbafe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e7ee5f494e64696bf6cdb03da25f5ce'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:30:22.366636 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-51fbbdca-b165-4c02-81e1-ae01481bbafe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e7ee5f494e64696bf6cdb03da25f5ce'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:30:22.378537 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-51fbbdca-b165-4c02-81e1-ae01481bbafe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e7ee5f494e64696bf6cdb03da25f5ce'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:30:22.384574 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1123/2239] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:30:22 2022] DELETE /identity/v3/users/6e7ee5f494e64696bf6cdb03da25f5ce => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:30:22.663555 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e941d702-e30e-4e83-9719-a5e07da7b708 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:30:22.665175 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-e941d702-e30e-4e83-9719-a5e07da7b708 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:30:22.680873 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e941d702-e30e-4e83-9719-a5e07da7b708 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:30:22.756106 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f331b4-88ed-4dc8-81a1-d97cb082e44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:30:22.756819 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f331b4-88ed-4dc8-81a1-d97cb082e44d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:22.757105 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f331b4-88ed-4dc8-81a1-d97cb082e44d admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:22.757376 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f331b4-88ed-4dc8-81a1-d97cb082e44d admin admin] PATH_INFO: `/v3/projects/eb4ea19517ec48eeb5aba23620c2ef2a` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:22.758721 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f331b4-88ed-4dc8-81a1-d97cb082e44d admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb4ea19517ec48eeb5aba23620c2ef2a)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:30:22.761494 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f331b4-88ed-4dc8-81a1-d97cb082e44d admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:30:22.807770 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-11f331b4-88ed-4dc8-81a1-d97cb082e44d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb4ea19517ec48eeb5aba23620c2ef2a', 'request_id': 'req-11f331b4-88ed-4dc8-81a1-d97cb082e44d'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:30:22.815185 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-11f331b4-88ed-4dc8-81a1-d97cb082e44d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb4ea19517ec48eeb5aba23620c2ef2a', 'request_id': 'req-11f331b4-88ed-4dc8-81a1-d97cb082e44d'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:30:22.821009 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-11f331b4-88ed-4dc8-81a1-d97cb082e44d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb4ea19517ec48eeb5aba23620c2ef2a', 'request_id': 'req-11f331b4-88ed-4dc8-81a1-d97cb082e44d'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:30:22.832160 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-11f331b4-88ed-4dc8-81a1-d97cb082e44d admin admin] The token cache is being invalidate because project eb4ea19517ec48eeb5aba23620c2ef2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:30:22.832430 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-11f331b4-88ed-4dc8-81a1-d97cb082e44d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:30:22.833091 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-11f331b4-88ed-4dc8-81a1-d97cb082e44d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:30:22.838451 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1117/2240] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:30:22 2022] DELETE /identity/v3/projects/eb4ea19517ec48eeb5aba23620c2ef2a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:30:22.841427 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bbeb21-631a-4e03-98a1-09a927537257 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:22.844014 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bbeb21-631a-4e03-98a1-09a927537257 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:22.844685 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bbeb21-631a-4e03-98a1-09a927537257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:22.864286 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-22bbeb21-631a-4e03-98a1-09a927537257 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:30:22.865500 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-22bbeb21-631a-4e03-98a1-09a927537257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:30:22.957634 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1124/2241] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:30:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:30:22.965082 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721da57b-5a07-44b8-8995-5b38769130e2 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:22.965393 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721da57b-5a07-44b8-8995-5b38769130e2 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:22.965672 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721da57b-5a07-44b8-8995-5b38769130e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:22.992597 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-721da57b-5a07-44b8-8995-5b38769130e2 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:30:22.993963 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-721da57b-5a07-44b8-8995-5b38769130e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:30:23.004412 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1118/2242] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:30:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:30:23.009378 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bbeb21-631a-4e03-98a1-09a927537257 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:30:23.019892 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bbeb21-631a-4e03-98a1-09a927537257 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:30:23.024561 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d747c-7ae7-459a-9d20-1e694502bba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:30:23.025218 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d747c-7ae7-459a-9d20-1e694502bba9 admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:23.025537 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d747c-7ae7-459a-9d20-1e694502bba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:23.025925 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d747c-7ae7-459a-9d20-1e694502bba9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:23.026651 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483d747c-7ae7-459a-9d20-1e694502bba9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:30:23.026994 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483d747c-7ae7-459a-9d20-1e694502bba9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:30:23.028638 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483d747c-7ae7-459a-9d20-1e694502bba9 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:30:23.042590 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1125/2243] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Mar 30 01:30:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:30:23.047230 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721da57b-5a07-44b8-8995-5b38769130e2 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:30:23.058076 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721da57b-5a07-44b8-8995-5b38769130e2 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:30:23.063041 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c4910c-345c-4d5c-a65d-15fc79cd13f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:30:23.063700 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c4910c-345c-4d5c-a65d-15fc79cd13f1 admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:23.063983 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c4910c-345c-4d5c-a65d-15fc79cd13f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:23.064261 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c4910c-345c-4d5c-a65d-15fc79cd13f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:23.064948 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c4910c-345c-4d5c-a65d-15fc79cd13f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:30:23.066876 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c4910c-345c-4d5c-a65d-15fc79cd13f1 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:30:23.091735 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1119/2244] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:30:23 2022] POST /identity/v3/projects => generated 357 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:30:23.096019 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d747c-7ae7-459a-9d20-1e694502bba9 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:30:23.106897 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d747c-7ae7-459a-9d20-1e694502bba9 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:30:23.162307 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f189667a-aa8e-43e4-a3f9-715f84c708ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:30:23.163011 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189667a-aa8e-43e4-a3f9-715f84c708ff admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:23.163292 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189667a-aa8e-43e4-a3f9-715f84c708ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:23.163563 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189667a-aa8e-43e4-a3f9-715f84c708ff admin admin] PATH_INFO: `/v3/users` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:23.164261 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f189667a-aa8e-43e4-a3f9-715f84c708ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:30:23.166804 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f189667a-aa8e-43e4-a3f9-715f84c708ff admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:30:23.188811 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1126/2245] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:30:23 2022] POST /identity/v3/users => generated 279 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:30:23.189996 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c4910c-345c-4d5c-a65d-15fc79cd13f1 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:30:23.200230 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c4910c-345c-4d5c-a65d-15fc79cd13f1 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:30:23.204747 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec672c-aa70-448b-91c4-66249a1dd04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:30:23.205391 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec672c-aa70-448b-91c4-66249a1dd04b admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:23.205671 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec672c-aa70-448b-91c4-66249a1dd04b admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:23.205945 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec672c-aa70-448b-91c4-66249a1dd04b admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:23.206660 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ec672c-aa70-448b-91c4-66249a1dd04b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:30:23.208270 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ec672c-aa70-448b-91c4-66249a1dd04b admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:30:23.219146 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1120/2246] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:30:23.223222 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f189667a-aa8e-43e4-a3f9-715f84c708ff admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:30:23.234162 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f189667a-aa8e-43e4-a3f9-715f84c708ff admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:30:23.238646 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e1b9b8-f7a3-4c54-aab5-27969151cab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:30:23.239309 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1b9b8-f7a3-4c54-aab5-27969151cab8 admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:23.239595 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1b9b8-f7a3-4c54-aab5-27969151cab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:23.239890 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1b9b8-f7a3-4c54-aab5-27969151cab8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:23.240611 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e1b9b8-f7a3-4c54-aab5-27969151cab8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:30:23.242185 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e1b9b8-f7a3-4c54-aab5-27969151cab8 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:30:23.251812 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1127/2247] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:30:23.255735 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec672c-aa70-448b-91c4-66249a1dd04b admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:30:23.265206 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec672c-aa70-448b-91c4-66249a1dd04b admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:30:23.270042 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69ec6c0-47ba-49d3-b80e-0950022d1fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:30:23.270963 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ec6c0-47ba-49d3-b80e-0950022d1fe7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:23.271249 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ec6c0-47ba-49d3-b80e-0950022d1fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:23.271642 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ec6c0-47ba-49d3-b80e-0950022d1fe7 admin admin] PATH_INFO: `/v3/projects/d6beb27be9264aa7956c3b789571ab4d/users/142b6f33cf6e4674affe800ef6578da7/roles/7185d0cfbcd44502b1613bcfe1b42f6f` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:23.288385 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69ec6c0-47ba-49d3-b80e-0950022d1fe7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6beb27be9264aa7956c3b789571ab4d, user_id=142b6f33cf6e4674affe800ef6578da7, role_id=7185d0cfbcd44502b1613bcfe1b42f6f)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:30:23.291221 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69ec6c0-47ba-49d3-b80e-0950022d1fe7 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:30:23.303935 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1121/2248] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:30:23 2022] PUT /identity/v3/projects/d6beb27be9264aa7956c3b789571ab4d/users/142b6f33cf6e4674affe800ef6578da7/roles/7185d0cfbcd44502b1613bcfe1b42f6f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:30:23.317026 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26773f-4cec-41f3-8454-52ec2d2069ed None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:23.317719 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26773f-4cec-41f3-8454-52ec2d2069ed None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:23.317719 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26773f-4cec-41f3-8454-52ec2d2069ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:23.351059 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-3e26773f-4cec-41f3-8454-52ec2d2069ed None None] MFA Rules not processed for user `142b6f33cf6e4674affe800ef6578da7`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:30:23.352277 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-3e26773f-4cec-41f3-8454-52ec2d2069ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:30:23.420702 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1128/2249] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:30:23 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:30:23.425127 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69ec6c0-47ba-49d3-b80e-0950022d1fe7 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:30:23.488614 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69ec6c0-47ba-49d3-b80e-0950022d1fe7 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:30:23.495570 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92b1810-5c33-4ae9-ae09-905a08bcdcb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:30:23.496245 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92b1810-5c33-4ae9-ae09-905a08bcdcb2 admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:23.496529 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92b1810-5c33-4ae9-ae09-905a08bcdcb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:23.496807 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92b1810-5c33-4ae9-ae09-905a08bcdcb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:23.497517 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92b1810-5c33-4ae9-ae09-905a08bcdcb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:30:23.499465 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92b1810-5c33-4ae9-ae09-905a08bcdcb2 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:30:23.528740 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1122/2250] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:30:23 2022] POST /identity/v3/projects => generated 357 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 01:30:23.534955 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e26773f-4cec-41f3-8454-52ec2d2069ed None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:30:23.546090 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e26773f-4cec-41f3-8454-52ec2d2069ed None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:30:23.602308 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb77fb-d325-425c-ba73-302d2c49e1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:30:23.603019 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb77fb-d325-425c-ba73-302d2c49e1f2 admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:23.603378 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb77fb-d325-425c-ba73-302d2c49e1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:23.604167 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb77fb-d325-425c-ba73-302d2c49e1f2 admin admin] PATH_INFO: `/v3/users` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:23.604840 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eb77fb-d325-425c-ba73-302d2c49e1f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:30:23.606791 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eb77fb-d325-425c-ba73-302d2c49e1f2 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:30:23.627211 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1129/2251] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:30:23 2022] POST /identity/v3/users => generated 285 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:30:23.631146 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92b1810-5c33-4ae9-ae09-905a08bcdcb2 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:30:23.641721 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92b1810-5c33-4ae9-ae09-905a08bcdcb2 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:30:23.646480 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39df6c16-8e83-442a-99f4-8e3b7bf1f50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:30:23.647180 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df6c16-8e83-442a-99f4-8e3b7bf1f50e admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:23.647467 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df6c16-8e83-442a-99f4-8e3b7bf1f50e admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:23.647747 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df6c16-8e83-442a-99f4-8e3b7bf1f50e admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:23.648472 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39df6c16-8e83-442a-99f4-8e3b7bf1f50e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:30:23.650099 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39df6c16-8e83-442a-99f4-8e3b7bf1f50e admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:30:23.661046 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1123/2252] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:30:23.665277 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb77fb-d325-425c-ba73-302d2c49e1f2 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:30:23.675894 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb77fb-d325-425c-ba73-302d2c49e1f2 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:30:23.680444 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a900e63f-6aee-40b0-b1fe-64ee0b5a7bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:30:23.681303 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900e63f-6aee-40b0-b1fe-64ee0b5a7bb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:23.682469 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900e63f-6aee-40b0-b1fe-64ee0b5a7bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:23.682793 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900e63f-6aee-40b0-b1fe-64ee0b5a7bb0 admin admin] PATH_INFO: `/v3/projects/f133c1966f80411c806439b9be1559f8/users/535e95e0e2c54be7b5ac291e4d197044/roles/36909bbf31d04993bb2a9fe587b572dc` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:23.697974 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a900e63f-6aee-40b0-b1fe-64ee0b5a7bb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f133c1966f80411c806439b9be1559f8, user_id=535e95e0e2c54be7b5ac291e4d197044, role_id=36909bbf31d04993bb2a9fe587b572dc)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:30:23.701000 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a900e63f-6aee-40b0-b1fe-64ee0b5a7bb0 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:30:23.714902 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1130/2253] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:30:23 2022] PUT /identity/v3/projects/f133c1966f80411c806439b9be1559f8/users/535e95e0e2c54be7b5ac291e4d197044/roles/36909bbf31d04993bb2a9fe587b572dc => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:30:23.718988 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39df6c16-8e83-442a-99f4-8e3b7bf1f50e admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:30:23.729762 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39df6c16-8e83-442a-99f4-8e3b7bf1f50e admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:30:23.786095 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ceb7d3-db33-430e-b384-9648db99e0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:30:23.786786 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ceb7d3-db33-430e-b384-9648db99e0f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:23.787068 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ceb7d3-db33-430e-b384-9648db99e0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:23.787365 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ceb7d3-db33-430e-b384-9648db99e0f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:23.788080 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ceb7d3-db33-430e-b384-9648db99e0f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:30:23.789640 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ceb7d3-db33-430e-b384-9648db99e0f4 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:30:23.800177 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1124/2254] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:30:23.804126 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a900e63f-6aee-40b0-b1fe-64ee0b5a7bb0 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:30:23.816136 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a900e63f-6aee-40b0-b1fe-64ee0b5a7bb0 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:30:23.821148 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b45a374-b037-4068-af59-1574838f4a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:30:23.822039 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45a374-b037-4068-af59-1574838f4a57 admin admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:23.822392 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45a374-b037-4068-af59-1574838f4a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:23.822710 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45a374-b037-4068-af59-1574838f4a57 admin admin] PATH_INFO: `/v3/projects/f133c1966f80411c806439b9be1559f8/users/535e95e0e2c54be7b5ac291e4d197044/roles/36909bbf31d04993bb2a9fe587b572dc` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:23.824825 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b45a374-b037-4068-af59-1574838f4a57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f133c1966f80411c806439b9be1559f8, user_id=535e95e0e2c54be7b5ac291e4d197044, role_id=36909bbf31d04993bb2a9fe587b572dc)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:30:23.827547 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b45a374-b037-4068-af59-1574838f4a57 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:30:23.838241 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1131/2255] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:30:23 2022] PUT /identity/v3/projects/f133c1966f80411c806439b9be1559f8/users/535e95e0e2c54be7b5ac291e4d197044/roles/36909bbf31d04993bb2a9fe587b572dc => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:30:23.848351 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d6b78-174d-4281-a669-ae1247bad51e None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:23.848635 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d6b78-174d-4281-a669-ae1247bad51e None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:23.848936 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d6b78-174d-4281-a669-ae1247bad51e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:23.875922 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-f87d6b78-174d-4281-a669-ae1247bad51e None None] MFA Rules not processed for user `535e95e0e2c54be7b5ac291e4d197044`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:30:23.877115 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-f87d6b78-174d-4281-a669-ae1247bad51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:30:23.948526 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1125/2256] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:30:23 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:30:23.959466 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b45a374-b037-4068-af59-1574838f4a57 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:30:23.961164 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-0b45a374-b037-4068-af59-1574838f4a57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:30:24.016648 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b45a374-b037-4068-af59-1574838f4a57 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:30:24.020897 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d634533c-8734-4884-9a64-5502096e1334 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45219f386f0147b6bd380efe4ab62812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:30:24.021472 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634533c-8734-4884-9a64-5502096e1334 service cinder] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:24.021763 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634533c-8734-4884-9a64-5502096e1334 service cinder] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:24.022179 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634533c-8734-4884-9a64-5502096e1334 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:24.036603 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d634533c-8734-4884-9a64-5502096e1334 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:30:24.038040 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d634533c-8734-4884-9a64-5502096e1334 service cinder] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:30:24.047879 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1132/2257] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:30:23 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:30:24.125631 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87d6b78-174d-4281-a669-ae1247bad51e None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:30:24.138531 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87d6b78-174d-4281-a669-ae1247bad51e None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:30:24.142426 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942344f3-5b61-427c-a6f8-7f5fdc0ac6d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45219f386f0147b6bd380efe4ab62812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:30:24.143137 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942344f3-5b61-427c-a6f8-7f5fdc0ac6d6 service cinder] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:24.143424 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942344f3-5b61-427c-a6f8-7f5fdc0ac6d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:24.143703 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942344f3-5b61-427c-a6f8-7f5fdc0ac6d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:24.199806 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942344f3-5b61-427c-a6f8-7f5fdc0ac6d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:30:24.201282 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942344f3-5b61-427c-a6f8-7f5fdc0ac6d6 service cinder] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:30:24.210976 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1126/2258] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:30:24 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:30:27.786863 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9936411-50a2-455b-9017-70cbed520792 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:27.787340 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9936411-50a2-455b-9017-70cbed520792 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:27.787811 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9936411-50a2-455b-9017-70cbed520792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:27.819331 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-e9936411-50a2-455b-9017-70cbed520792 None None] MFA Rules not processed for user `0503fdca7f834ef0a81422804dc74812`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:30:27.822256 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-e9936411-50a2-455b-9017-70cbed520792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:30:27.901503 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1133/2259] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Mar 30 01:30:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:30:27.969735 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942344f3-5b61-427c-a6f8-7f5fdc0ac6d6 service cinder] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:30:27.972371 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-942344f3-5b61-427c-a6f8-7f5fdc0ac6d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:30:28.072536 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942344f3-5b61-427c-a6f8-7f5fdc0ac6d6 service cinder] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:30:28.078098 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b273d6a3-9907-405b-9617-cf3622877e67 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f16de81dfb4c14b027cd6cd1e6ff2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:30:28.078751 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b273d6a3-9907-405b-9617-cf3622877e67 service swift] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:28.079018 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b273d6a3-9907-405b-9617-cf3622877e67 service swift] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:28.079301 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b273d6a3-9907-405b-9617-cf3622877e67 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:28.091437 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b273d6a3-9907-405b-9617-cf3622877e67 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:30:28.093219 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b273d6a3-9907-405b-9617-cf3622877e67 service swift] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:30:28.102294 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1127/2260] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Mar 30 01:30:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 30 01:30:37.334377 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9936411-50a2-455b-9017-70cbed520792 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:30:37.339455 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-e9936411-50a2-455b-9017-70cbed520792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:30:37.450526 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9936411-50a2-455b-9017-70cbed520792 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:30:37.458220 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbb42e2-1ca6-4c32-b3e2-58873922f930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:30:37.460145 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb42e2-1ca6-4c32-b3e2-58873922f930 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:37.460694 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb42e2-1ca6-4c32-b3e2-58873922f930 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:37.461069 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb42e2-1ca6-4c32-b3e2-58873922f930 admin admin] PATH_INFO: `/v3/users/5744e235f4d947a28c71fb084b3322eb` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:37.462899 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbb42e2-1ca6-4c32-b3e2-58873922f930 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5744e235f4d947a28c71fb084b3322eb)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:30:37.465633 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbb42e2-1ca6-4c32-b3e2-58873922f930 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:30:37.580529 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-cbbb42e2-1ca6-4c32-b3e2-58873922f930 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5744e235f4d947a28c71fb084b3322eb'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:30:37.589680 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-cbbb42e2-1ca6-4c32-b3e2-58873922f930 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5744e235f4d947a28c71fb084b3322eb'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:30:37.590828 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-cbbb42e2-1ca6-4c32-b3e2-58873922f930 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5744e235f4d947a28c71fb084b3322eb'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:30:37.609766 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-cbbb42e2-1ca6-4c32-b3e2-58873922f930 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5744e235f4d947a28c71fb084b3322eb'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:30:37.647977 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-cbbb42e2-1ca6-4c32-b3e2-58873922f930 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5744e235f4d947a28c71fb084b3322eb'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:30:37.683385 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1134/2261] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:30:37 2022] DELETE /identity/v3/users/5744e235f4d947a28c71fb084b3322eb => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:30:37.688760 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45093b-f8f1-4278-9c7c-766e868aa1c1 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:37.689313 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45093b-f8f1-4278-9c7c-766e868aa1c1 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:37.689313 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45093b-f8f1-4278-9c7c-766e868aa1c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:37.722577 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-de45093b-f8f1-4278-9c7c-766e868aa1c1 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:30:37.723879 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-de45093b-f8f1-4278-9c7c-766e868aa1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:30:37.880678 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1128/2262] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:30:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 01:30:37.898128 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbb42e2-1ca6-4c32-b3e2-58873922f930 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:30:37.899820 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-cbbb42e2-1ca6-4c32-b3e2-58873922f930 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:30:38.041702 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbb42e2-1ca6-4c32-b3e2-58873922f930 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:30:38.055347 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708eecf1-96f6-4db2-a722-b90ad0d66fbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:30:38.056185 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708eecf1-96f6-4db2-a722-b90ad0d66fbf service neutron] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:38.056496 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708eecf1-96f6-4db2-a722-b90ad0d66fbf service neutron] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:38.056985 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708eecf1-96f6-4db2-a722-b90ad0d66fbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:38.077808 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708eecf1-96f6-4db2-a722-b90ad0d66fbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:30:38.093272 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708eecf1-96f6-4db2-a722-b90ad0d66fbf service neutron] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:30:38.142406 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1135/2263] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:30:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:30:38.495810 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1023d1ea-2f9f-4ceb-be7a-1d43201c0c25 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:38.496089 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1023d1ea-2f9f-4ceb-be7a-1d43201c0c25 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:38.496900 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1023d1ea-2f9f-4ceb-be7a-1d43201c0c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:38.520567 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-1023d1ea-2f9f-4ceb-be7a-1d43201c0c25 None None] MFA Rules not processed for user `c610ebdafc22479a8a47892591caaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:30:38.522266 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-1023d1ea-2f9f-4ceb-be7a-1d43201c0c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:30:38.583131 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1129/2264] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:30:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:30:39.181620 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708eecf1-96f6-4db2-a722-b90ad0d66fbf service neutron] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:30:39.186061 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-708eecf1-96f6-4db2-a722-b90ad0d66fbf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:30:39.292080 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708eecf1-96f6-4db2-a722-b90ad0d66fbf service neutron] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:30:39.342739 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c7c64d-87b3-466a-a25e-c16a5586ada9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:30:39.349710 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7c64d-87b3-466a-a25e-c16a5586ada9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:39.351730 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7c64d-87b3-466a-a25e-c16a5586ada9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:39.352161 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7c64d-87b3-466a-a25e-c16a5586ada9 admin admin] PATH_INFO: `/v3/projects/5391d7975b744ef2ae7881382b05c486` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:39.371492 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c7c64d-87b3-466a-a25e-c16a5586ada9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5391d7975b744ef2ae7881382b05c486)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:30:39.391853 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c7c64d-87b3-466a-a25e-c16a5586ada9 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:30:39.537993 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-a9c7c64d-87b3-466a-a25e-c16a5586ada9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5391d7975b744ef2ae7881382b05c486', 'request_id': 'req-a9c7c64d-87b3-466a-a25e-c16a5586ada9'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:30:39.553337 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-a9c7c64d-87b3-466a-a25e-c16a5586ada9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5391d7975b744ef2ae7881382b05c486', 'request_id': 'req-a9c7c64d-87b3-466a-a25e-c16a5586ada9'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:30:39.601495 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-a9c7c64d-87b3-466a-a25e-c16a5586ada9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5391d7975b744ef2ae7881382b05c486', 'request_id': 'req-a9c7c64d-87b3-466a-a25e-c16a5586ada9'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:30:39.627555 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-a9c7c64d-87b3-466a-a25e-c16a5586ada9 admin admin] The token cache is being invalidate because project 5391d7975b744ef2ae7881382b05c486 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:30:39.627847 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-a9c7c64d-87b3-466a-a25e-c16a5586ada9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:30:39.630225 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-a9c7c64d-87b3-466a-a25e-c16a5586ada9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:30:39.632411 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1136/2265] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:30:39 2022] DELETE /identity/v3/projects/5391d7975b744ef2ae7881382b05c486 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:30:39.638328 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf97ed4-130c-40ad-b85c-5e1d022b4da5 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:39.638874 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf97ed4-130c-40ad-b85c-5e1d022b4da5 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:39.638987 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf97ed4-130c-40ad-b85c-5e1d022b4da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:39.690462 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-fdf97ed4-130c-40ad-b85c-5e1d022b4da5 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:30:39.694930 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-fdf97ed4-130c-40ad-b85c-5e1d022b4da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:30:39.855570 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1130/2266] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:30:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:30:39.864919 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296d7453-776a-42a4-84a3-f0a79d9cae31 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:39.865265 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296d7453-776a-42a4-84a3-f0a79d9cae31 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:39.865608 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296d7453-776a-42a4-84a3-f0a79d9cae31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:39.912038 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea33347-62d2-4fab-893d-08c3b736f3e3 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:39.913349 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea33347-62d2-4fab-893d-08c3b736f3e3 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:39.913870 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea33347-62d2-4fab-893d-08c3b736f3e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:39.920841 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-296d7453-776a-42a4-84a3-f0a79d9cae31 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:30:39.922186 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-296d7453-776a-42a4-84a3-f0a79d9cae31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:30:39.945423 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1137/2267] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:30:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:30:39.950093 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296d7453-776a-42a4-84a3-f0a79d9cae31 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:30:39.959714 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296d7453-776a-42a4-84a3-f0a79d9cae31 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:30:39.960061 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-aea33347-62d2-4fab-893d-08c3b736f3e3 None None] MFA Rules not processed for user `0503fdca7f834ef0a81422804dc74812`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:30:39.961746 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-aea33347-62d2-4fab-893d-08c3b736f3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:30:39.966149 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2269c476-5c13-4775-8e76-7be8f1c7b26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:30:39.967016 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269c476-5c13-4775-8e76-7be8f1c7b26b admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:39.967544 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269c476-5c13-4775-8e76-7be8f1c7b26b admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:39.967873 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269c476-5c13-4775-8e76-7be8f1c7b26b admin admin] PATH_INFO: `/v3/domains` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:39.968700 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2269c476-5c13-4775-8e76-7be8f1c7b26b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:30:39.969101 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2269c476-5c13-4775-8e76-7be8f1c7b26b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:30:39.970821 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2269c476-5c13-4775-8e76-7be8f1c7b26b admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:30:39.990289 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1138/2268] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Mar 30 01:30:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:30:39.996224 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2269c476-5c13-4775-8e76-7be8f1c7b26b admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:30:40.021739 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2269c476-5c13-4775-8e76-7be8f1c7b26b admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:30:40.037121 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c2c191-d9f7-4f6b-9d62-01060386dfbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:30:40.037804 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c2c191-d9f7-4f6b-9d62-01060386dfbf admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:40.038088 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c2c191-d9f7-4f6b-9d62-01060386dfbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:40.038365 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c2c191-d9f7-4f6b-9d62-01060386dfbf admin admin] PATH_INFO: `/v3/projects` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:40.039584 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c2c191-d9f7-4f6b-9d62-01060386dfbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:30:40.041677 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c2c191-d9f7-4f6b-9d62-01060386dfbf admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:30:40.070935 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1131/2269] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Mar 30 01:30:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 01:30:40.104344 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea33347-62d2-4fab-893d-08c3b736f3e3 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:30:40.106320 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-aea33347-62d2-4fab-893d-08c3b736f3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:30:40.109996 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1139/2270] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:30:39 2022] POST /identity/v3/projects => generated 375 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:30:40.114921 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c2c191-d9f7-4f6b-9d62-01060386dfbf admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:30:40.268191 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c2c191-d9f7-4f6b-9d62-01060386dfbf admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:30:40.282180 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c279d-04b8-41c1-b584-414d037a452e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:30:40.283387 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c279d-04b8-41c1-b584-414d037a452e admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:40.283834 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c279d-04b8-41c1-b584-414d037a452e admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:40.284264 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c279d-04b8-41c1-b584-414d037a452e admin admin] PATH_INFO: `/v3/users` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:40.285257 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7c279d-04b8-41c1-b584-414d037a452e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:30:40.287399 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7c279d-04b8-41c1-b584-414d037a452e admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:30:40.332469 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea33347-62d2-4fab-893d-08c3b736f3e3 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:30:40.341768 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1140/2271] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:30:40 2022] POST /identity/v3/users => generated 288 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:30:40.347785 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c279d-04b8-41c1-b584-414d037a452e admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:30:40.375411 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c279d-04b8-41c1-b584-414d037a452e admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:30:40.389824 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04adb7cf-6c0a-4f06-9899-7777ae740b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:30:40.390798 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04adb7cf-6c0a-4f06-9899-7777ae740b54 admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:40.391087 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04adb7cf-6c0a-4f06-9899-7777ae740b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:40.391368 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04adb7cf-6c0a-4f06-9899-7777ae740b54 admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:40.392183 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04adb7cf-6c0a-4f06-9899-7777ae740b54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:30:40.393855 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04adb7cf-6c0a-4f06-9899-7777ae740b54 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:30:40.426016 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1141/2272] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:30:40 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:30:40.435385 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04adb7cf-6c0a-4f06-9899-7777ae740b54 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:30:40.450232 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04adb7cf-6c0a-4f06-9899-7777ae740b54 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:30:40.464564 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1099081-c7a3-4da0-ad0b-6dd1505ef13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:30:40.465494 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1099081-c7a3-4da0-ad0b-6dd1505ef13c admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:40.467010 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1099081-c7a3-4da0-ad0b-6dd1505ef13c admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:40.467441 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1099081-c7a3-4da0-ad0b-6dd1505ef13c admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:40.468349 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1099081-c7a3-4da0-ad0b-6dd1505ef13c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:30:40.470115 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1099081-c7a3-4da0-ad0b-6dd1505ef13c admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:30:40.483544 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1142/2273] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:30:40 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:30:40.487906 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3173c42-f381-435f-b1b2-060286c9c66e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f16de81dfb4c14b027cd6cd1e6ff2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:30:40.488238 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1099081-c7a3-4da0-ad0b-6dd1505ef13c admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:30:40.490670 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3173c42-f381-435f-b1b2-060286c9c66e service swift] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:40.491299 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3173c42-f381-435f-b1b2-060286c9c66e service swift] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:40.492270 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3173c42-f381-435f-b1b2-060286c9c66e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:40.508981 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1099081-c7a3-4da0-ad0b-6dd1505ef13c admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:30:40.522440 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ecd06d-87ca-430a-9ea2-449e5a7a9d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:30:40.524471 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ecd06d-87ca-430a-9ea2-449e5a7a9d4e admin admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:40.529814 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ecd06d-87ca-430a-9ea2-449e5a7a9d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:40.530618 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ecd06d-87ca-430a-9ea2-449e5a7a9d4e admin admin] PATH_INFO: `/v3/projects/91e31c910b0048a8a5633d5382e4cdeb/users/7b70bb23eaa348c89ca04282636066b7/roles/7185d0cfbcd44502b1613bcfe1b42f6f` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:40.560534 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ecd06d-87ca-430a-9ea2-449e5a7a9d4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=91e31c910b0048a8a5633d5382e4cdeb, user_id=7b70bb23eaa348c89ca04282636066b7, role_id=7185d0cfbcd44502b1613bcfe1b42f6f)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:30:40.567224 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ecd06d-87ca-430a-9ea2-449e5a7a9d4e admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:30:40.642786 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1143/2274] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:30:40 2022] PUT /identity/v3/projects/91e31c910b0048a8a5633d5382e4cdeb/users/7b70bb23eaa348c89ca04282636066b7/roles/7185d0cfbcd44502b1613bcfe1b42f6f => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:30:40.647597 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94634bb-7584-44cb-bd74-466b886f399a None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:40.651584 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94634bb-7584-44cb-bd74-466b886f399a None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:40.653023 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94634bb-7584-44cb-bd74-466b886f399a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:40.744122 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3173c42-f381-435f-b1b2-060286c9c66e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:30:40.745930 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-e94634bb-7584-44cb-bd74-466b886f399a None None] MFA Rules not processed for user `7b70bb23eaa348c89ca04282636066b7`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:30:40.747741 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3173c42-f381-435f-b1b2-060286c9c66e service swift] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:30:40.748492 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-e94634bb-7584-44cb-bd74-466b886f399a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:30:40.776179 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1132/2275] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Mar 30 01:30:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 673 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Mar 30 01:30:40.942191 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1144/2276] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:30:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:30:41.008785 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3173c42-f381-435f-b1b2-060286c9c66e service swift] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:30:41.011321 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-e3173c42-f381-435f-b1b2-060286c9c66e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:30:41.147268 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3173c42-f381-435f-b1b2-060286c9c66e service swift] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:30:41.261514 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2340791-9a07-4e42-9cd7-7284f1a9a7b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45219f386f0147b6bd380efe4ab62812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:30:41.262418 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2340791-9a07-4e42-9cd7-7284f1a9a7b3 service cinder] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:41.265693 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2340791-9a07-4e42-9cd7-7284f1a9a7b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:41.266147 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2340791-9a07-4e42-9cd7-7284f1a9a7b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:41.285381 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2340791-9a07-4e42-9cd7-7284f1a9a7b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:30:41.295635 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2340791-9a07-4e42-9cd7-7284f1a9a7b3 service cinder] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:30:41.317679 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1133/2277] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:30:41 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:30:43.558800 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94634bb-7584-44cb-bd74-466b886f399a None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:30:43.561824 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-e94634bb-7584-44cb-bd74-466b886f399a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:30:43.846280 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94634bb-7584-44cb-bd74-466b886f399a None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:30:43.871436 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d1f8b6-c3c6-407b-a016-225d2b31d2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:30:43.872641 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1f8b6-c3c6-407b-a016-225d2b31d2cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:43.872641 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1f8b6-c3c6-407b-a016-225d2b31d2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:43.872876 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1f8b6-c3c6-407b-a016-225d2b31d2cd admin admin] PATH_INFO: `/v3/users/142b6f33cf6e4674affe800ef6578da7` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:43.875957 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d1f8b6-c3c6-407b-a016-225d2b31d2cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=142b6f33cf6e4674affe800ef6578da7)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:30:43.877123 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d1f8b6-c3c6-407b-a016-225d2b31d2cd admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:30:44.006954 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-66d1f8b6-c3c6-407b-a016-225d2b31d2cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '142b6f33cf6e4674affe800ef6578da7'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:30:44.026198 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-66d1f8b6-c3c6-407b-a016-225d2b31d2cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '142b6f33cf6e4674affe800ef6578da7'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:30:44.028025 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-66d1f8b6-c3c6-407b-a016-225d2b31d2cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '142b6f33cf6e4674affe800ef6578da7'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:30:44.045674 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-66d1f8b6-c3c6-407b-a016-225d2b31d2cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '142b6f33cf6e4674affe800ef6578da7'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:30:44.070976 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-66d1f8b6-c3c6-407b-a016-225d2b31d2cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '142b6f33cf6e4674affe800ef6578da7'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:30:44.089631 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1145/2278] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:30:43 2022] DELETE /identity/v3/users/142b6f33cf6e4674affe800ef6578da7 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:30:44.094225 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ffa071-00fe-4914-a678-098d32fd8951 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:44.094807 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ffa071-00fe-4914-a678-098d32fd8951 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:44.095031 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ffa071-00fe-4914-a678-098d32fd8951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:44.154158 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-30ffa071-00fe-4914-a678-098d32fd8951 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:30:44.155430 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-30ffa071-00fe-4914-a678-098d32fd8951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:30:44.310318 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1134/2279] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:30:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:30:44.321277 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d1f8b6-c3c6-407b-a016-225d2b31d2cd admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:30:44.324344 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-66d1f8b6-c3c6-407b-a016-225d2b31d2cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:30:44.418578 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d1f8b6-c3c6-407b-a016-225d2b31d2cd admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:30:44.422344 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324765e7-7a88-4319-9ee5-a6a2fb68509f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:30:44.423021 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324765e7-7a88-4319-9ee5-a6a2fb68509f service neutron] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:44.423446 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324765e7-7a88-4319-9ee5-a6a2fb68509f service neutron] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:44.423817 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324765e7-7a88-4319-9ee5-a6a2fb68509f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:44.439770 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324765e7-7a88-4319-9ee5-a6a2fb68509f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:30:44.442997 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324765e7-7a88-4319-9ee5-a6a2fb68509f service neutron] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:30:44.455944 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1146/2280] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:30:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:30:44.862031 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ffa071-00fe-4914-a678-098d32fd8951 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:30:44.863585 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-30ffa071-00fe-4914-a678-098d32fd8951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:30:44.877092 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ffa071-00fe-4914-a678-098d32fd8951 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:30:44.885304 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1766f753-ed69-4649-b4b4-1a025843a7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:30:44.886299 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1766f753-ed69-4649-b4b4-1a025843a7ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:44.886692 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1766f753-ed69-4649-b4b4-1a025843a7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:44.887074 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1766f753-ed69-4649-b4b4-1a025843a7ef admin admin] PATH_INFO: `/v3/projects/d6beb27be9264aa7956c3b789571ab4d` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:44.888423 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1766f753-ed69-4649-b4b4-1a025843a7ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6beb27be9264aa7956c3b789571ab4d)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:30:44.890797 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1766f753-ed69-4649-b4b4-1a025843a7ef admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:30:44.950265 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-1766f753-ed69-4649-b4b4-1a025843a7ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6beb27be9264aa7956c3b789571ab4d', 'request_id': 'req-1766f753-ed69-4649-b4b4-1a025843a7ef'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:30:44.958283 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-1766f753-ed69-4649-b4b4-1a025843a7ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6beb27be9264aa7956c3b789571ab4d', 'request_id': 'req-1766f753-ed69-4649-b4b4-1a025843a7ef'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:30:44.964562 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-1766f753-ed69-4649-b4b4-1a025843a7ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6beb27be9264aa7956c3b789571ab4d', 'request_id': 'req-1766f753-ed69-4649-b4b4-1a025843a7ef'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:30:44.977652 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-1766f753-ed69-4649-b4b4-1a025843a7ef admin admin] The token cache is being invalidate because project d6beb27be9264aa7956c3b789571ab4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:30:44.978195 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-1766f753-ed69-4649-b4b4-1a025843a7ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:30:44.979131 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-1766f753-ed69-4649-b4b4-1a025843a7ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:30:44.981116 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1135/2281] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:30:44 2022] DELETE /identity/v3/projects/d6beb27be9264aa7956c3b789571ab4d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:30:44.984870 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324765e7-7a88-4319-9ee5-a6a2fb68509f service neutron] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:30:44.996636 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324765e7-7a88-4319-9ee5-a6a2fb68509f service neutron] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:30:45.071440 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75b4266-79e0-4669-93b3-bc899bd5281f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:30:45.072486 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b4266-79e0-4669-93b3-bc899bd5281f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:45.073006 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b4266-79e0-4669-93b3-bc899bd5281f admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:45.073499 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b4266-79e0-4669-93b3-bc899bd5281f admin admin] PATH_INFO: `/v3/users/535e95e0e2c54be7b5ac291e4d197044` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:45.074903 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75b4266-79e0-4669-93b3-bc899bd5281f admin admin] RBAC: Authorizing `identity:delete_user(user_id=535e95e0e2c54be7b5ac291e4d197044)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:30:45.076963 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75b4266-79e0-4669-93b3-bc899bd5281f admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:30:45.135398 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-d75b4266-79e0-4669-93b3-bc899bd5281f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '535e95e0e2c54be7b5ac291e4d197044'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:30:45.146562 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-d75b4266-79e0-4669-93b3-bc899bd5281f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '535e95e0e2c54be7b5ac291e4d197044'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:30:45.147638 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-d75b4266-79e0-4669-93b3-bc899bd5281f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '535e95e0e2c54be7b5ac291e4d197044'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:30:45.156971 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-d75b4266-79e0-4669-93b3-bc899bd5281f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '535e95e0e2c54be7b5ac291e4d197044'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:30:45.171828 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-d75b4266-79e0-4669-93b3-bc899bd5281f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '535e95e0e2c54be7b5ac291e4d197044'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:30:45.180380 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1147/2282] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:30:44 2022] DELETE /identity/v3/users/535e95e0e2c54be7b5ac291e4d197044 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:30:45.713719 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1766f753-ed69-4649-b4b4-1a025843a7ef admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:30:45.715779 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-1766f753-ed69-4649-b4b4-1a025843a7ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:30:45.735532 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1766f753-ed69-4649-b4b4-1a025843a7ef admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:30:45.849194 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36abf1d-7af6-45ff-9a92-6533c2c2e783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:30:45.850466 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36abf1d-7af6-45ff-9a92-6533c2c2e783 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:45.850851 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36abf1d-7af6-45ff-9a92-6533c2c2e783 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:45.851367 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36abf1d-7af6-45ff-9a92-6533c2c2e783 admin admin] PATH_INFO: `/v3/projects/f133c1966f80411c806439b9be1559f8` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:45.853802 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36abf1d-7af6-45ff-9a92-6533c2c2e783 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f133c1966f80411c806439b9be1559f8)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:30:45.864469 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36abf1d-7af6-45ff-9a92-6533c2c2e783 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:30:45.984055 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-e36abf1d-7af6-45ff-9a92-6533c2c2e783 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f133c1966f80411c806439b9be1559f8', 'request_id': 'req-e36abf1d-7af6-45ff-9a92-6533c2c2e783'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:30:46.014059 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-e36abf1d-7af6-45ff-9a92-6533c2c2e783 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f133c1966f80411c806439b9be1559f8', 'request_id': 'req-e36abf1d-7af6-45ff-9a92-6533c2c2e783'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:30:46.026373 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-e36abf1d-7af6-45ff-9a92-6533c2c2e783 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f133c1966f80411c806439b9be1559f8', 'request_id': 'req-e36abf1d-7af6-45ff-9a92-6533c2c2e783'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:30:46.046275 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-e36abf1d-7af6-45ff-9a92-6533c2c2e783 admin admin] The token cache is being invalidate because project f133c1966f80411c806439b9be1559f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:30:46.046632 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-e36abf1d-7af6-45ff-9a92-6533c2c2e783 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:30:46.057786 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-e36abf1d-7af6-45ff-9a92-6533c2c2e783 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:30:46.058010 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c1a8ef-da74-4e4f-bb56-9b40e8dd4ca6 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:46.058010 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c1a8ef-da74-4e4f-bb56-9b40e8dd4ca6 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:46.058010 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c1a8ef-da74-4e4f-bb56-9b40e8dd4ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:46.059533 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1136/2283] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:30:45 2022] DELETE /identity/v3/projects/f133c1966f80411c806439b9be1559f8 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:30:46.139368 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-42c1a8ef-da74-4e4f-bb56-9b40e8dd4ca6 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:30:46.148122 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-42c1a8ef-da74-4e4f-bb56-9b40e8dd4ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:30:46.266637 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ae283-56eb-4152-82d9-ad9691a1f08c None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:46.266637 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ae283-56eb-4152-82d9-ad9691a1f08c None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:46.267213 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ae283-56eb-4152-82d9-ad9691a1f08c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:46.268989 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1148/2284] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:30:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:30:46.300449 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-f19ae283-56eb-4152-82d9-ad9691a1f08c None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:30:46.301614 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-f19ae283-56eb-4152-82d9-ad9691a1f08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:30:46.312113 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1137/2285] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:30:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:30:46.316422 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c1a8ef-da74-4e4f-bb56-9b40e8dd4ca6 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:30:46.340277 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c1a8ef-da74-4e4f-bb56-9b40e8dd4ca6 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:30:46.350981 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aea7ea-fceb-4488-affc-3de090245fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:30:46.351972 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aea7ea-fceb-4488-affc-3de090245fb1 admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:46.356300 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aea7ea-fceb-4488-affc-3de090245fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:46.357076 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aea7ea-fceb-4488-affc-3de090245fb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:46.358254 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aea7ea-fceb-4488-affc-3de090245fb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:30:46.358637 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aea7ea-fceb-4488-affc-3de090245fb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:30:46.360465 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aea7ea-fceb-4488-affc-3de090245fb1 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:30:46.381396 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1149/2286] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Mar 30 01:30:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:30:46.383086 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19ae283-56eb-4152-82d9-ad9691a1f08c None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:30:46.396563 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19ae283-56eb-4152-82d9-ad9691a1f08c None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:30:46.412755 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5213745c-ac3b-4bb2-b973-42acf8f16360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:30:46.413529 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5213745c-ac3b-4bb2-b973-42acf8f16360 admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:46.413831 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5213745c-ac3b-4bb2-b973-42acf8f16360 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:46.414046 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5213745c-ac3b-4bb2-b973-42acf8f16360 admin admin] PATH_INFO: `/v3/projects` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:46.414776 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5213745c-ac3b-4bb2-b973-42acf8f16360 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:30:46.417403 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5213745c-ac3b-4bb2-b973-42acf8f16360 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:30:46.504531 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1138/2287] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:30:46 2022] POST /identity/v3/projects => generated 385 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:30:46.508905 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aea7ea-fceb-4488-affc-3de090245fb1 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:30:46.537536 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aea7ea-fceb-4488-affc-3de090245fb1 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:30:46.699863 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac74cb-05ef-48c7-928b-7be1b488fed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:30:46.702275 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac74cb-05ef-48c7-928b-7be1b488fed0 admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:46.702567 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac74cb-05ef-48c7-928b-7be1b488fed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:46.704256 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac74cb-05ef-48c7-928b-7be1b488fed0 admin admin] PATH_INFO: `/v3/users` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:46.704997 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ac74cb-05ef-48c7-928b-7be1b488fed0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:30:46.714266 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ac74cb-05ef-48c7-928b-7be1b488fed0 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:30:46.781974 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1150/2288] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:30:46 2022] POST /identity/v3/users => generated 293 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:30:46.783582 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5213745c-ac3b-4bb2-b973-42acf8f16360 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:30:46.799258 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5213745c-ac3b-4bb2-b973-42acf8f16360 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:30:46.815204 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c864f0af-96fa-4905-a361-495709821caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:30:46.815968 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c864f0af-96fa-4905-a361-495709821caf admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:46.816325 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c864f0af-96fa-4905-a361-495709821caf admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:46.816682 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c864f0af-96fa-4905-a361-495709821caf admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:46.817517 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c864f0af-96fa-4905-a361-495709821caf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:30:46.819466 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c864f0af-96fa-4905-a361-495709821caf admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:30:46.864431 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1139/2289] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:30:46 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:30:46.869055 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac74cb-05ef-48c7-928b-7be1b488fed0 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:30:46.889846 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac74cb-05ef-48c7-928b-7be1b488fed0 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:30:46.917754 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a8a5e-8b84-4dd0-9770-94c213675257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:30:46.918523 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a8a5e-8b84-4dd0-9770-94c213675257 admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:46.918855 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a8a5e-8b84-4dd0-9770-94c213675257 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:46.919147 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a8a5e-8b84-4dd0-9770-94c213675257 admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:46.919915 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843a8a5e-8b84-4dd0-9770-94c213675257 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:30:46.923004 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843a8a5e-8b84-4dd0-9770-94c213675257 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:30:46.954168 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1151/2290] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:30:46 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 01:30:46.958665 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c864f0af-96fa-4905-a361-495709821caf admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:30:46.978233 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c864f0af-96fa-4905-a361-495709821caf admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:30:46.989375 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5585025-a886-4833-8050-37ec808c107e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:30:46.990940 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5585025-a886-4833-8050-37ec808c107e admin admin] REQUEST_METHOD: `PUT` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:46.991244 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5585025-a886-4833-8050-37ec808c107e admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:46.991522 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5585025-a886-4833-8050-37ec808c107e admin admin] PATH_INFO: `/v3/projects/638477ee2e014cdea58932f9cbb0650d/users/04c2368430714be4950d58cbd9ae794e/roles/7185d0cfbcd44502b1613bcfe1b42f6f` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:47.049021 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5585025-a886-4833-8050-37ec808c107e admin admin] RBAC: Authorizing `identity:create_grant(project_id=638477ee2e014cdea58932f9cbb0650d, user_id=04c2368430714be4950d58cbd9ae794e, role_id=7185d0cfbcd44502b1613bcfe1b42f6f)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:30:47.053106 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5585025-a886-4833-8050-37ec808c107e admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:30:47.112527 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1140/2291] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:30:46 2022] PUT /identity/v3/projects/638477ee2e014cdea58932f9cbb0650d/users/04c2368430714be4950d58cbd9ae794e/roles/7185d0cfbcd44502b1613bcfe1b42f6f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:30:47.126959 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf4ea7-2322-4b62-8359-fc603e730d73 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:47.127451 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf4ea7-2322-4b62-8359-fc603e730d73 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:47.127562 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf4ea7-2322-4b62-8359-fc603e730d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:47.200881 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-deaf4ea7-2322-4b62-8359-fc603e730d73 None None] MFA Rules not processed for user `04c2368430714be4950d58cbd9ae794e`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:30:47.202229 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-deaf4ea7-2322-4b62-8359-fc603e730d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:30:47.303599 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1152/2292] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:30:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:30:47.318123 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5585025-a886-4833-8050-37ec808c107e admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:30:47.320270 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-d5585025-a886-4833-8050-37ec808c107e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:30:47.429043 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5585025-a886-4833-8050-37ec808c107e admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:30:47.444066 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642b9def-e81a-4252-8273-6c0d8268ce40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45219f386f0147b6bd380efe4ab62812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:30:47.445006 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b9def-e81a-4252-8273-6c0d8268ce40 service cinder] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:47.445357 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b9def-e81a-4252-8273-6c0d8268ce40 service cinder] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:47.445787 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b9def-e81a-4252-8273-6c0d8268ce40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:47.473051 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642b9def-e81a-4252-8273-6c0d8268ce40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:30:47.477835 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642b9def-e81a-4252-8273-6c0d8268ce40 service cinder] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:30:47.513958 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1141/2293] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:30:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:30:47.560477 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaf4ea7-2322-4b62-8359-fc603e730d73 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:30:47.805185 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaf4ea7-2322-4b62-8359-fc603e730d73 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:30:47.805414 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dccbba-213e-498c-8a74-934beccb5288 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:47.806445 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dccbba-213e-498c-8a74-934beccb5288 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:47.806565 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dccbba-213e-498c-8a74-934beccb5288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:47.814622 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec08b8-61c2-45cf-860e-96a0ac0976a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:30:47.815852 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec08b8-61c2-45cf-860e-96a0ac0976a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:47.816360 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec08b8-61c2-45cf-860e-96a0ac0976a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:47.816869 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec08b8-61c2-45cf-860e-96a0ac0976a3 admin admin] PATH_INFO: `/v3/users/04c2368430714be4950d58cbd9ae794e` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:47.818442 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ec08b8-61c2-45cf-860e-96a0ac0976a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04c2368430714be4950d58cbd9ae794e)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:30:47.822318 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ec08b8-61c2-45cf-860e-96a0ac0976a3 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:30:47.855909 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-55dccbba-213e-498c-8a74-934beccb5288 None None] MFA Rules not processed for user `35958469e64e490f919742685700caa9`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:30:47.857165 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-55dccbba-213e-498c-8a74-934beccb5288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:30:47.929195 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-39ec08b8-61c2-45cf-860e-96a0ac0976a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04c2368430714be4950d58cbd9ae794e'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:30:47.948498 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-39ec08b8-61c2-45cf-860e-96a0ac0976a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04c2368430714be4950d58cbd9ae794e'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:30:47.949508 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-39ec08b8-61c2-45cf-860e-96a0ac0976a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04c2368430714be4950d58cbd9ae794e'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:30:47.958587 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-39ec08b8-61c2-45cf-860e-96a0ac0976a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04c2368430714be4950d58cbd9ae794e'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:30:47.976693 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1142/2294] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:30:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 01:30:48.001327 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-39ec08b8-61c2-45cf-860e-96a0ac0976a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04c2368430714be4950d58cbd9ae794e'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:30:48.026649 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1153/2295] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:30:47 2022] DELETE /identity/v3/users/04c2368430714be4950d58cbd9ae794e => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:30:48.031303 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c47e32c-c0d6-4b2a-a7ec-dc92c90094e4 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:48.031850 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c47e32c-c0d6-4b2a-a7ec-dc92c90094e4 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:48.032483 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c47e32c-c0d6-4b2a-a7ec-dc92c90094e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:48.070850 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-8c47e32c-c0d6-4b2a-a7ec-dc92c90094e4 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:30:48.072229 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-8c47e32c-c0d6-4b2a-a7ec-dc92c90094e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:30:48.217590 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1143/2296] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:30:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:30:48.230211 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec08b8-61c2-45cf-860e-96a0ac0976a3 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:30:48.232444 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-39ec08b8-61c2-45cf-860e-96a0ac0976a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:30:48.328966 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec08b8-61c2-45cf-860e-96a0ac0976a3 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:30:48.333633 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b87f4ad-0142-4b2e-92be-a1b18afe93ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:30:48.334675 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b87f4ad-0142-4b2e-92be-a1b18afe93ac service neutron] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:48.335555 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b87f4ad-0142-4b2e-92be-a1b18afe93ac service neutron] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:48.336060 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b87f4ad-0142-4b2e-92be-a1b18afe93ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:48.358616 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b87f4ad-0142-4b2e-92be-a1b18afe93ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:30:48.361246 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b87f4ad-0142-4b2e-92be-a1b18afe93ac service neutron] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:30:48.377919 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1154/2297] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:30:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 30 01:30:49.380861 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c47e32c-c0d6-4b2a-a7ec-dc92c90094e4 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:30:49.382362 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-8c47e32c-c0d6-4b2a-a7ec-dc92c90094e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:30:49.416315 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c47e32c-c0d6-4b2a-a7ec-dc92c90094e4 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:30:49.432286 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f568706c-6fe8-4119-853d-30aedaabdc06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:30:49.433508 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568706c-6fe8-4119-853d-30aedaabdc06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:49.433912 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568706c-6fe8-4119-853d-30aedaabdc06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:49.434387 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568706c-6fe8-4119-853d-30aedaabdc06 admin admin] PATH_INFO: `/v3/projects/638477ee2e014cdea58932f9cbb0650d` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:49.437418 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f568706c-6fe8-4119-853d-30aedaabdc06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=638477ee2e014cdea58932f9cbb0650d)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:30:49.439473 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f568706c-6fe8-4119-853d-30aedaabdc06 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:30:49.519358 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-f568706c-6fe8-4119-853d-30aedaabdc06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '638477ee2e014cdea58932f9cbb0650d', 'request_id': 'req-f568706c-6fe8-4119-853d-30aedaabdc06'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:30:49.532295 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-f568706c-6fe8-4119-853d-30aedaabdc06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '638477ee2e014cdea58932f9cbb0650d', 'request_id': 'req-f568706c-6fe8-4119-853d-30aedaabdc06'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:30:49.547113 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-f568706c-6fe8-4119-853d-30aedaabdc06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '638477ee2e014cdea58932f9cbb0650d', 'request_id': 'req-f568706c-6fe8-4119-853d-30aedaabdc06'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:30:49.574981 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-f568706c-6fe8-4119-853d-30aedaabdc06 admin admin] The token cache is being invalidate because project 638477ee2e014cdea58932f9cbb0650d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:30:49.575552 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-f568706c-6fe8-4119-853d-30aedaabdc06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:30:49.577820 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-f568706c-6fe8-4119-853d-30aedaabdc06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:30:49.580058 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1144/2298] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:30:49 2022] DELETE /identity/v3/projects/638477ee2e014cdea58932f9cbb0650d => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:30:49.584588 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f862fc0-3793-49ad-98bd-ed373daa8f01 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:49.585123 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f862fc0-3793-49ad-98bd-ed373daa8f01 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:49.585545 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f862fc0-3793-49ad-98bd-ed373daa8f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:49.611891 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-7f862fc0-3793-49ad-98bd-ed373daa8f01 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:30:49.613322 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-7f862fc0-3793-49ad-98bd-ed373daa8f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:30:49.726890 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1155/2299] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:30:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:30:49.735033 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817cf8a8-2b38-4cd2-8a9c-762980683f2d None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:49.735574 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817cf8a8-2b38-4cd2-8a9c-762980683f2d None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:49.736012 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817cf8a8-2b38-4cd2-8a9c-762980683f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:49.781877 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-817cf8a8-2b38-4cd2-8a9c-762980683f2d None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:30:49.792835 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-817cf8a8-2b38-4cd2-8a9c-762980683f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:30:49.812935 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1145/2300] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:30:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:30:49.817173 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f862fc0-3793-49ad-98bd-ed373daa8f01 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:30:49.837537 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f862fc0-3793-49ad-98bd-ed373daa8f01 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:30:49.848884 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b216b5fc-0d87-46b5-b9de-97aaa6d3792c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:30:49.849567 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216b5fc-0d87-46b5-b9de-97aaa6d3792c admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:49.849842 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216b5fc-0d87-46b5-b9de-97aaa6d3792c admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:49.850832 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216b5fc-0d87-46b5-b9de-97aaa6d3792c admin admin] PATH_INFO: `/v3/domains` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:49.851593 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b216b5fc-0d87-46b5-b9de-97aaa6d3792c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:30:49.851900 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b216b5fc-0d87-46b5-b9de-97aaa6d3792c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:30:49.860156 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b216b5fc-0d87-46b5-b9de-97aaa6d3792c admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:30:49.891486 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1156/2301] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Mar 30 01:30:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:30:49.896200 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817cf8a8-2b38-4cd2-8a9c-762980683f2d None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:30:49.908765 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817cf8a8-2b38-4cd2-8a9c-762980683f2d None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:30:49.915318 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3108c098-b8af-4620-b640-1c96f3525ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:30:49.916860 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3108c098-b8af-4620-b640-1c96f3525ced admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:49.917389 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3108c098-b8af-4620-b640-1c96f3525ced admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:49.918491 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3108c098-b8af-4620-b640-1c96f3525ced admin admin] PATH_INFO: `/v3/projects` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:49.918928 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3108c098-b8af-4620-b640-1c96f3525ced admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:30:49.921879 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3108c098-b8af-4620-b640-1c96f3525ced admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:30:49.975695 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1146/2302] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:30:49 2022] POST /identity/v3/projects => generated 375 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:30:49.980051 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b216b5fc-0d87-46b5-b9de-97aaa6d3792c admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:30:49.992992 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b216b5fc-0d87-46b5-b9de-97aaa6d3792c admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:30:50.114337 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7313279-0ae8-4297-9b9b-8847a2b593ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:30:50.115081 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7313279-0ae8-4297-9b9b-8847a2b593ce admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:50.115369 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7313279-0ae8-4297-9b9b-8847a2b593ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:50.115671 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7313279-0ae8-4297-9b9b-8847a2b593ce admin admin] PATH_INFO: `/v3/users` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:50.116398 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7313279-0ae8-4297-9b9b-8847a2b593ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:30:50.118553 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7313279-0ae8-4297-9b9b-8847a2b593ce admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:30:50.157093 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1157/2303] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:30:49 2022] POST /identity/v3/users => generated 288 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 01:30:50.160439 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3108c098-b8af-4620-b640-1c96f3525ced admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:30:50.174742 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3108c098-b8af-4620-b640-1c96f3525ced admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:30:50.188332 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea76545-817f-4c39-aa8f-a940a2467d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:30:50.189022 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea76545-817f-4c39-aa8f-a940a2467d9a admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:50.189308 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea76545-817f-4c39-aa8f-a940a2467d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:50.189586 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea76545-817f-4c39-aa8f-a940a2467d9a admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:50.190321 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea76545-817f-4c39-aa8f-a940a2467d9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:30:50.191962 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea76545-817f-4c39-aa8f-a940a2467d9a admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:30:50.212961 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1147/2304] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:30:50 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:30:50.216906 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7313279-0ae8-4297-9b9b-8847a2b593ce admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:30:50.229988 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7313279-0ae8-4297-9b9b-8847a2b593ce admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:30:50.236090 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f49ad9-cf92-4914-a9ad-bc82472168d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:30:50.236768 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f49ad9-cf92-4914-a9ad-bc82472168d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:50.237108 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f49ad9-cf92-4914-a9ad-bc82472168d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:50.237455 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f49ad9-cf92-4914-a9ad-bc82472168d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:50.238377 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f49ad9-cf92-4914-a9ad-bc82472168d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:30:50.240241 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f49ad9-cf92-4914-a9ad-bc82472168d2 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:30:50.269716 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea76545-817f-4c39-aa8f-a940a2467d9a admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:30:50.270079 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1158/2305] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:30:50 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:30:50.294322 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea76545-817f-4c39-aa8f-a940a2467d9a admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:30:50.301880 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1365ab7-658a-4073-9b92-4183255308c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:30:50.302878 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1365ab7-658a-4073-9b92-4183255308c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:50.308599 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1365ab7-658a-4073-9b92-4183255308c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:50.308908 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1365ab7-658a-4073-9b92-4183255308c8 admin admin] PATH_INFO: `/v3/projects/5c582d943f9c4bb8aa31eb008abfafa4/users/8da4b14916644153a93218ba4b2319ea/roles/7185d0cfbcd44502b1613bcfe1b42f6f` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:50.347341 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1365ab7-658a-4073-9b92-4183255308c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c582d943f9c4bb8aa31eb008abfafa4, user_id=8da4b14916644153a93218ba4b2319ea, role_id=7185d0cfbcd44502b1613bcfe1b42f6f)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:30:50.366548 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1365ab7-658a-4073-9b92-4183255308c8 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:30:50.396457 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1148/2306] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:30:50 2022] PUT /identity/v3/projects/5c582d943f9c4bb8aa31eb008abfafa4/users/8da4b14916644153a93218ba4b2319ea/roles/7185d0cfbcd44502b1613bcfe1b42f6f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:30:50.444796 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5edd4fd-f01e-4373-8720-f4ee289629d3 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:50.445254 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5edd4fd-f01e-4373-8720-f4ee289629d3 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:50.445581 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5edd4fd-f01e-4373-8720-f4ee289629d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:50.546720 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-c5edd4fd-f01e-4373-8720-f4ee289629d3 None None] MFA Rules not processed for user `8da4b14916644153a93218ba4b2319ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:30:50.551209 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-c5edd4fd-f01e-4373-8720-f4ee289629d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:30:50.807158 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1159/2307] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:30:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:30:57.104937 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1365ab7-658a-4073-9b92-4183255308c8 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:30:57.107022 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-b1365ab7-658a-4073-9b92-4183255308c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:30:57.235361 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1365ab7-658a-4073-9b92-4183255308c8 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:30:57.251115 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a45bd8-8614-4e96-ab67-c88053a92645 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf28c0ec3d94fb99bcd573dd8dd0e30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:30:57.251289 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a45bd8-8614-4e96-ab67-c88053a92645 service glance] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:57.251570 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a45bd8-8614-4e96-ab67-c88053a92645 service glance] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:57.251871 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a45bd8-8614-4e96-ab67-c88053a92645 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:57.284453 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a45bd8-8614-4e96-ab67-c88053a92645 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:30:57.285921 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a45bd8-8614-4e96-ab67-c88053a92645 service glance] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:30:57.296750 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1149/2308] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:30:57 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:30:59.204577 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5edd4fd-f01e-4373-8720-f4ee289629d3 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:30:59.206018 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-c5edd4fd-f01e-4373-8720-f4ee289629d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:30:59.346783 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5edd4fd-f01e-4373-8720-f4ee289629d3 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:30:59.352515 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f28526d-9ca6-47b0-b555-6302ab1442a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:30:59.353631 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f28526d-9ca6-47b0-b555-6302ab1442a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:59.354107 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f28526d-9ca6-47b0-b555-6302ab1442a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:59.354549 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f28526d-9ca6-47b0-b555-6302ab1442a3 admin admin] PATH_INFO: `/v3/users/7b70bb23eaa348c89ca04282636066b7` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:59.356249 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f28526d-9ca6-47b0-b555-6302ab1442a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b70bb23eaa348c89ca04282636066b7)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:30:59.358580 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f28526d-9ca6-47b0-b555-6302ab1442a3 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:30:59.412286 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-6f28526d-9ca6-47b0-b555-6302ab1442a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b70bb23eaa348c89ca04282636066b7'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:30:59.422115 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-6f28526d-9ca6-47b0-b555-6302ab1442a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b70bb23eaa348c89ca04282636066b7'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:30:59.423449 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-6f28526d-9ca6-47b0-b555-6302ab1442a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b70bb23eaa348c89ca04282636066b7'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:30:59.436080 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-6f28526d-9ca6-47b0-b555-6302ab1442a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b70bb23eaa348c89ca04282636066b7'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:30:59.452756 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-6f28526d-9ca6-47b0-b555-6302ab1442a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b70bb23eaa348c89ca04282636066b7'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:30:59.458931 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1160/2309] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:30:59 2022] DELETE /identity/v3/users/7b70bb23eaa348c89ca04282636066b7 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:30:59.464318 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149466b-61c0-4e1c-a39a-8f76bef92b03 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:59.465844 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149466b-61c0-4e1c-a39a-8f76bef92b03 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:59.466362 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149466b-61c0-4e1c-a39a-8f76bef92b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:59.498249 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-6149466b-61c0-4e1c-a39a-8f76bef92b03 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:30:59.499637 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-6149466b-61c0-4e1c-a39a-8f76bef92b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:30:59.573204 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1150/2310] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:30:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:30:59.582990 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f28526d-9ca6-47b0-b555-6302ab1442a3 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:30:59.584792 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-6f28526d-9ca6-47b0-b555-6302ab1442a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:30:59.694196 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f28526d-9ca6-47b0-b555-6302ab1442a3 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:30:59.701213 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddef054-cf8c-4f36-a4d4-9142a370f9ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:30:59.701964 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddef054-cf8c-4f36-a4d4-9142a370f9ee service neutron] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:30:59.702253 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddef054-cf8c-4f36-a4d4-9142a370f9ee service neutron] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:30:59.702540 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddef054-cf8c-4f36-a4d4-9142a370f9ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:30:59.713693 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddef054-cf8c-4f36-a4d4-9142a370f9ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:30:59.715232 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddef054-cf8c-4f36-a4d4-9142a370f9ee service neutron] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:30:59.732684 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1161/2311] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:30:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:31:00.188556 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6149466b-61c0-4e1c-a39a-8f76bef92b03 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:31:00.189758 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-6149466b-61c0-4e1c-a39a-8f76bef92b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:31:00.213838 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6149466b-61c0-4e1c-a39a-8f76bef92b03 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:31:00.220893 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce818b2-890f-463e-a619-f7f6295a6b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:31:00.222089 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce818b2-890f-463e-a619-f7f6295a6b66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:31:00.222375 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce818b2-890f-463e-a619-f7f6295a6b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:31:00.222775 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce818b2-890f-463e-a619-f7f6295a6b66 admin admin] PATH_INFO: `/v3/projects/91e31c910b0048a8a5633d5382e4cdeb` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:31:00.226694 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce818b2-890f-463e-a619-f7f6295a6b66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91e31c910b0048a8a5633d5382e4cdeb)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:31:00.238376 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce818b2-890f-463e-a619-f7f6295a6b66 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:31:00.312805 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-fce818b2-890f-463e-a619-f7f6295a6b66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91e31c910b0048a8a5633d5382e4cdeb', 'request_id': 'req-fce818b2-890f-463e-a619-f7f6295a6b66'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:31:00.322801 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-fce818b2-890f-463e-a619-f7f6295a6b66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91e31c910b0048a8a5633d5382e4cdeb', 'request_id': 'req-fce818b2-890f-463e-a619-f7f6295a6b66'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:31:00.329411 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-fce818b2-890f-463e-a619-f7f6295a6b66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91e31c910b0048a8a5633d5382e4cdeb', 'request_id': 'req-fce818b2-890f-463e-a619-f7f6295a6b66'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:31:00.347656 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-fce818b2-890f-463e-a619-f7f6295a6b66 admin admin] The token cache is being invalidate because project 91e31c910b0048a8a5633d5382e4cdeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:31:00.348141 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-fce818b2-890f-463e-a619-f7f6295a6b66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:31:00.349489 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-fce818b2-890f-463e-a619-f7f6295a6b66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:31:00.351453 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1151/2312] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:31:00 2022] DELETE /identity/v3/projects/91e31c910b0048a8a5633d5382e4cdeb => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:31:02.806542 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f416d1-cf96-4fb0-8bd8-1ba100885117 None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:31:02.807166 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f416d1-cf96-4fb0-8bd8-1ba100885117 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:31:02.807293 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f416d1-cf96-4fb0-8bd8-1ba100885117 None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:31:02.809494 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1162/2313] 10.222.0.30 () {54 vars in 921 bytes} [Wed Mar 30 01:31:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:31:02.821407 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6271165e-cb6a-4c11-9b03-b0c08aea27e0 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:31:02.822005 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6271165e-cb6a-4c11-9b03-b0c08aea27e0 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:31:02.822193 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6271165e-cb6a-4c11-9b03-b0c08aea27e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:31:02.843161 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-6271165e-cb6a-4c11-9b03-b0c08aea27e0 None None] MFA Rules not processed for user `140c6d1a20e94192bde06e72040f162d`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:31:02.844642 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-6271165e-cb6a-4c11-9b03-b0c08aea27e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:31:02.917634 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1152/2314] 10.222.0.30 () {58 vars in 1018 bytes} [Wed Mar 30 01:31:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 01:31:02.930381 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f416d1-cf96-4fb0-8bd8-1ba100885117 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:31:02.932096 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-b1f416d1-cf96-4fb0-8bd8-1ba100885117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:31:02.993180 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f416d1-cf96-4fb0-8bd8-1ba100885117 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:31:02.997793 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e2f87d-667d-427e-9b45-e420ea257592 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf28c0ec3d94fb99bcd573dd8dd0e30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:31:02.998520 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e2f87d-667d-427e-9b45-e420ea257592 service glance] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:31:02.998911 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e2f87d-667d-427e-9b45-e420ea257592 service glance] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:31:02.999258 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e2f87d-667d-427e-9b45-e420ea257592 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:31:03.010218 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e2f87d-667d-427e-9b45-e420ea257592 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:31:03.012426 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e2f87d-667d-427e-9b45-e420ea257592 service glance] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:31:03.023838 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1163/2315] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:31:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:31:03.092006 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf2b75f-b996-496f-a830-ece31fb1faa8 None None] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:31:03.092305 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf2b75f-b996-496f-a830-ece31fb1faa8 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:31:03.092690 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf2b75f-b996-496f-a830-ece31fb1faa8 None None] PATH_INFO: `/` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:31:03.094540 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1153/2316] 10.222.0.30 () {54 vars in 921 bytes} [Wed Mar 30 01:31:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:31:03.099596 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e589af25-16b8-40ce-bc17-523b31a0c343 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:31:03.099883 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e589af25-16b8-40ce-bc17-523b31a0c343 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:31:03.100276 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e589af25-16b8-40ce-bc17-523b31a0c343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:31:03.118948 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-e589af25-16b8-40ce-bc17-523b31a0c343 None None] MFA Rules not processed for user `41745b7f8a804e75b490a0a34977b23b`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:31:03.120685 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-e589af25-16b8-40ce-bc17-523b31a0c343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:31:03.171646 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1164/2317] 10.222.0.30 () {58 vars in 1018 bytes} [Wed Mar 30 01:31:03 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:31:03.183843 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf2b75f-b996-496f-a830-ece31fb1faa8 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:31:03.185532 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-1cf2b75f-b996-496f-a830-ece31fb1faa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:31:03.200073 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf2b75f-b996-496f-a830-ece31fb1faa8 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:31:03.203761 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1c1d05-3d79-4142-bd7a-d018009f2f69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:31:03.204404 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c1d05-3d79-4142-bd7a-d018009f2f69 service neutron] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:31:03.204688 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c1d05-3d79-4142-bd7a-d018009f2f69 service neutron] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:31:03.204966 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c1d05-3d79-4142-bd7a-d018009f2f69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:31:03.211930 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1c1d05-3d79-4142-bd7a-d018009f2f69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:31:03.213616 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1c1d05-3d79-4142-bd7a-d018009f2f69 service neutron] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:31:03.221826 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1154/2318] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:31:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:31:03.316207 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc18b1-16cd-4fb4-b75e-10050e8e377a None None] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:31:03.316573 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc18b1-16cd-4fb4-b75e-10050e8e377a None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:31:03.316935 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc18b1-16cd-4fb4-b75e-10050e8e377a None None] PATH_INFO: `/` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:31:03.318918 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1165/2319] 10.222.0.30 () {54 vars in 921 bytes} [Wed Mar 30 01:31:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 01:31:03.324771 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be20f896-bdbf-4b57-aa90-da5252b0d889 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:31:03.325121 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be20f896-bdbf-4b57-aa90-da5252b0d889 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:31:03.325398 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be20f896-bdbf-4b57-aa90-da5252b0d889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:31:03.343156 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-be20f896-bdbf-4b57-aa90-da5252b0d889 None None] MFA Rules not processed for user `140c6d1a20e94192bde06e72040f162d`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:31:03.344331 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-be20f896-bdbf-4b57-aa90-da5252b0d889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:31:03.353526 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1155/2320] 10.222.0.30 () {58 vars in 1018 bytes} [Wed Mar 30 01:31:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:31:03.364798 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dc18b1-16cd-4fb4-b75e-10050e8e377a None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:31:03.366508 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-19dc18b1-16cd-4fb4-b75e-10050e8e377a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:31:03.380142 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dc18b1-16cd-4fb4-b75e-10050e8e377a None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:31:03.383789 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b372dc-547a-4714-a87d-a7a8e1a5dc63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:31:03.384419 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b372dc-547a-4714-a87d-a7a8e1a5dc63 service neutron] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:31:03.384704 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b372dc-547a-4714-a87d-a7a8e1a5dc63 service neutron] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:31:03.384981 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b372dc-547a-4714-a87d-a7a8e1a5dc63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:31:03.395369 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b372dc-547a-4714-a87d-a7a8e1a5dc63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:31:03.396835 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b372dc-547a-4714-a87d-a7a8e1a5dc63 service neutron] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:31:03.408236 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1166/2321] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:31:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:31:03.525103 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc06e37a-958a-428c-a6ed-75aa42fb212b None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:31:03.525390 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc06e37a-958a-428c-a6ed-75aa42fb212b None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:31:03.525717 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc06e37a-958a-428c-a6ed-75aa42fb212b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:31:03.547308 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-bc06e37a-958a-428c-a6ed-75aa42fb212b None None] MFA Rules not processed for user `0503fdca7f834ef0a81422804dc74812`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:31:03.548502 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-bc06e37a-958a-428c-a6ed-75aa42fb212b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:31:03.605141 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1156/2322] 10.222.0.30 () {58 vars in 967 bytes} [Wed Mar 30 01:31:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:31:03.623812 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b372dc-547a-4714-a87d-a7a8e1a5dc63 service neutron] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:31:03.625300 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-c6b372dc-547a-4714-a87d-a7a8e1a5dc63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:31:03.703228 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b372dc-547a-4714-a87d-a7a8e1a5dc63 service neutron] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:31:03.708923 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb87d57-56af-4d2a-8181-16ceaa2109d3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f16de81dfb4c14b027cd6cd1e6ff2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:31:03.709584 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb87d57-56af-4d2a-8181-16ceaa2109d3 service swift] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:31:03.709934 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb87d57-56af-4d2a-8181-16ceaa2109d3 service swift] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:31:03.710312 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb87d57-56af-4d2a-8181-16ceaa2109d3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:31:03.720924 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb87d57-56af-4d2a-8181-16ceaa2109d3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:31:03.722554 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb87d57-56af-4d2a-8181-16ceaa2109d3 service swift] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:31:03.731670 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1167/2323] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Mar 30 01:31:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 30 01:31:06.131637 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc06e37a-958a-428c-a6ed-75aa42fb212b None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:31:06.133353 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-bc06e37a-958a-428c-a6ed-75aa42fb212b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:31:06.244751 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc06e37a-958a-428c-a6ed-75aa42fb212b None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:31:06.251891 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55e22c7-beef-4d1d-a1f6-800bf6761293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:31:06.253210 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e22c7-beef-4d1d-a1f6-800bf6761293 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:31:06.253493 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e22c7-beef-4d1d-a1f6-800bf6761293 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:31:06.254175 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e22c7-beef-4d1d-a1f6-800bf6761293 admin admin] PATH_INFO: `/v3/users/a0d44eb4367940a8b21f99fc063939e4` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:31:06.255825 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55e22c7-beef-4d1d-a1f6-800bf6761293 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0d44eb4367940a8b21f99fc063939e4)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:31:06.257067 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55e22c7-beef-4d1d-a1f6-800bf6761293 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:31:06.324769 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-a55e22c7-beef-4d1d-a1f6-800bf6761293 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0d44eb4367940a8b21f99fc063939e4'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:31:06.337953 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-a55e22c7-beef-4d1d-a1f6-800bf6761293 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0d44eb4367940a8b21f99fc063939e4'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:31:06.357885 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-a55e22c7-beef-4d1d-a1f6-800bf6761293 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0d44eb4367940a8b21f99fc063939e4'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:31:06.358942 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-a55e22c7-beef-4d1d-a1f6-800bf6761293 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0d44eb4367940a8b21f99fc063939e4'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:31:06.370072 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-a55e22c7-beef-4d1d-a1f6-800bf6761293 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0d44eb4367940a8b21f99fc063939e4'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:31:06.386079 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1157/2324] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:31:06 2022] DELETE /identity/v3/users/a0d44eb4367940a8b21f99fc063939e4 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:31:06.757850 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a8d03-426a-42b0-afb9-dfd794cf3599 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:31:06.758921 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a8d03-426a-42b0-afb9-dfd794cf3599 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:31:06.759426 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a8d03-426a-42b0-afb9-dfd794cf3599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:31:06.782218 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55e22c7-beef-4d1d-a1f6-800bf6761293 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:31:06.784467 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-a55e22c7-beef-4d1d-a1f6-800bf6761293 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:31:06.813859 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-4c1a8d03-426a-42b0-afb9-dfd794cf3599 None None] MFA Rules not processed for user `0503fdca7f834ef0a81422804dc74812`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:31:06.815851 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-4c1a8d03-426a-42b0-afb9-dfd794cf3599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:31:06.885094 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55e22c7-beef-4d1d-a1f6-800bf6761293 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:31:06.886941 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1168/2325] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Mar 30 01:31:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:31:06.891393 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b879e0e0-e8ac-4427-82fc-bf5f1eb414ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:31:06.892382 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b879e0e0-e8ac-4427-82fc-bf5f1eb414ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:31:06.892675 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b879e0e0-e8ac-4427-82fc-bf5f1eb414ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:31:06.892954 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b879e0e0-e8ac-4427-82fc-bf5f1eb414ba admin admin] PATH_INFO: `/v3/projects/babc9d0bca444ad7b1360d64894ac37c` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:31:06.895444 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b879e0e0-e8ac-4427-82fc-bf5f1eb414ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=babc9d0bca444ad7b1360d64894ac37c)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:31:06.897449 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b879e0e0-e8ac-4427-82fc-bf5f1eb414ba admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:31:06.901156 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1a8d03-426a-42b0-afb9-dfd794cf3599 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:31:06.903186 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-4c1a8d03-426a-42b0-afb9-dfd794cf3599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:31:06.960120 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-b879e0e0-e8ac-4427-82fc-bf5f1eb414ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'babc9d0bca444ad7b1360d64894ac37c', 'request_id': 'req-b879e0e0-e8ac-4427-82fc-bf5f1eb414ba'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:31:06.970508 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-b879e0e0-e8ac-4427-82fc-bf5f1eb414ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'babc9d0bca444ad7b1360d64894ac37c', 'request_id': 'req-b879e0e0-e8ac-4427-82fc-bf5f1eb414ba'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:31:06.976979 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-b879e0e0-e8ac-4427-82fc-bf5f1eb414ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'babc9d0bca444ad7b1360d64894ac37c', 'request_id': 'req-b879e0e0-e8ac-4427-82fc-bf5f1eb414ba'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:31:06.988304 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1a8d03-426a-42b0-afb9-dfd794cf3599 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:31:06.991190 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-b879e0e0-e8ac-4427-82fc-bf5f1eb414ba admin admin] The token cache is being invalidate because project babc9d0bca444ad7b1360d64894ac37c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:31:06.991481 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-b879e0e0-e8ac-4427-82fc-bf5f1eb414ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:31:06.992231 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-b879e0e0-e8ac-4427-82fc-bf5f1eb414ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:31:06.995565 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1158/2326] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:31:06 2022] DELETE /identity/v3/projects/babc9d0bca444ad7b1360d64894ac37c => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:31:07.001417 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00789777-f923-4096-8795-4cf316899e65 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:31:07.001595 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00789777-f923-4096-8795-4cf316899e65 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:31:07.001776 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00789777-f923-4096-8795-4cf316899e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:31:07.060293 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-00789777-f923-4096-8795-4cf316899e65 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:31:07.061526 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-00789777-f923-4096-8795-4cf316899e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:31:07.061883 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab36d26-166f-46b3-acea-0203d9083132 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f16de81dfb4c14b027cd6cd1e6ff2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:31:07.063325 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab36d26-166f-46b3-acea-0203d9083132 service swift] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:31:07.063778 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab36d26-166f-46b3-acea-0203d9083132 service swift] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:31:07.064130 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab36d26-166f-46b3-acea-0203d9083132 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:31:07.066460 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-cab36d26-166f-46b3-acea-0203d9083132 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:31:07.137790 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1159/2327] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:31:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:31:07.146301 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3544b64-7861-4d4c-b5f3-6ffc597f0d3b None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:31:07.146608 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3544b64-7861-4d4c-b5f3-6ffc597f0d3b None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:31:07.146923 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3544b64-7861-4d4c-b5f3-6ffc597f0d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:31:07.187572 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab36d26-166f-46b3-acea-0203d9083132 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:31:07.187572 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab36d26-166f-46b3-acea-0203d9083132 service swift] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:31:07.188055 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-d3544b64-7861-4d4c-b5f3-6ffc597f0d3b None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:31:07.188055 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-d3544b64-7861-4d4c-b5f3-6ffc597f0d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:31:07.195231 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1169/2328] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Mar 30 01:31:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Mar 30 01:31:07.200896 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1160/2329] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:31:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:31:07.205602 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab36d26-166f-46b3-acea-0203d9083132 service swift] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:31:07.220362 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab36d26-166f-46b3-acea-0203d9083132 service swift] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:31:07.226372 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917bd90d-b5e6-41af-8ce8-0f50513ccea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:31:07.227401 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917bd90d-b5e6-41af-8ce8-0f50513ccea4 admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:31:07.227577 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917bd90d-b5e6-41af-8ce8-0f50513ccea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:31:07.227858 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917bd90d-b5e6-41af-8ce8-0f50513ccea4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:31:07.228813 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917bd90d-b5e6-41af-8ce8-0f50513ccea4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:31:07.229400 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917bd90d-b5e6-41af-8ce8-0f50513ccea4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:31:07.232126 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917bd90d-b5e6-41af-8ce8-0f50513ccea4 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:31:07.246971 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1170/2330] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Mar 30 01:31:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:31:07.251798 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3544b64-7861-4d4c-b5f3-6ffc597f0d3b None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:31:07.263537 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3544b64-7861-4d4c-b5f3-6ffc597f0d3b None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:31:07.278788 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f80c40-4d0c-42de-9fe2-b7a036a2a321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:31:07.279468 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f80c40-4d0c-42de-9fe2-b7a036a2a321 admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:31:07.279928 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f80c40-4d0c-42de-9fe2-b7a036a2a321 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:31:07.280357 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f80c40-4d0c-42de-9fe2-b7a036a2a321 admin admin] PATH_INFO: `/v3/projects` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:31:07.281210 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f80c40-4d0c-42de-9fe2-b7a036a2a321 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:31:07.286334 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f80c40-4d0c-42de-9fe2-b7a036a2a321 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:31:07.344372 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1161/2331] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:31:07 2022] POST /identity/v3/projects => generated 369 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:31:07.350954 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917bd90d-b5e6-41af-8ce8-0f50513ccea4 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:31:07.366423 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917bd90d-b5e6-41af-8ce8-0f50513ccea4 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:31:07.455446 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a8333e-30ec-42d4-b189-77e97ee79308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:31:07.456466 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8333e-30ec-42d4-b189-77e97ee79308 admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:31:07.456854 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8333e-30ec-42d4-b189-77e97ee79308 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:31:07.457163 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8333e-30ec-42d4-b189-77e97ee79308 admin admin] PATH_INFO: `/v3/users` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:31:07.457931 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a8333e-30ec-42d4-b189-77e97ee79308 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:31:07.460966 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a8333e-30ec-42d4-b189-77e97ee79308 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:31:07.511254 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1171/2332] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:31:07 2022] POST /identity/v3/users => generated 285 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:31:07.515863 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f80c40-4d0c-42de-9fe2-b7a036a2a321 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:31:07.531020 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f80c40-4d0c-42de-9fe2-b7a036a2a321 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:31:07.559199 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395cf45f-e337-403f-ba67-79c443dfaa75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:31:07.560201 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395cf45f-e337-403f-ba67-79c443dfaa75 admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:31:07.560700 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395cf45f-e337-403f-ba67-79c443dfaa75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:31:07.561160 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395cf45f-e337-403f-ba67-79c443dfaa75 admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:31:07.562561 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395cf45f-e337-403f-ba67-79c443dfaa75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:31:07.578592 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395cf45f-e337-403f-ba67-79c443dfaa75 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:31:07.595803 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1162/2333] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:31:07 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:31:07.596975 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a8333e-30ec-42d4-b189-77e97ee79308 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:31:07.611292 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a8333e-30ec-42d4-b189-77e97ee79308 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:31:07.638092 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ef3349-8ce5-451c-84e3-4756c974aa3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:31:07.638928 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef3349-8ce5-451c-84e3-4756c974aa3b admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:31:07.639332 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef3349-8ce5-451c-84e3-4756c974aa3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:31:07.639709 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef3349-8ce5-451c-84e3-4756c974aa3b admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:31:07.640586 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ef3349-8ce5-451c-84e3-4756c974aa3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:31:07.642308 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ef3349-8ce5-451c-84e3-4756c974aa3b admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:31:07.674604 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1172/2334] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:31:07 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:31:07.676327 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395cf45f-e337-403f-ba67-79c443dfaa75 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:31:07.707627 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395cf45f-e337-403f-ba67-79c443dfaa75 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:31:07.723652 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e6026-0321-4958-91a7-d281bc40a331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:31:07.724614 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e6026-0321-4958-91a7-d281bc40a331 admin admin] REQUEST_METHOD: `PUT` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:31:07.724900 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e6026-0321-4958-91a7-d281bc40a331 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:31:07.725179 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e6026-0321-4958-91a7-d281bc40a331 admin admin] PATH_INFO: `/v3/projects/8373f3f3a2ef45aca0b065ad16ac0761/users/23a63cf4cdf24b2a9d30d570d3a3c725/roles/7185d0cfbcd44502b1613bcfe1b42f6f` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:31:07.756673 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4e6026-0321-4958-91a7-d281bc40a331 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8373f3f3a2ef45aca0b065ad16ac0761, user_id=23a63cf4cdf24b2a9d30d570d3a3c725, role_id=7185d0cfbcd44502b1613bcfe1b42f6f)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:31:07.760178 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4e6026-0321-4958-91a7-d281bc40a331 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:31:07.797811 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1163/2335] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:31:07 2022] PUT /identity/v3/projects/8373f3f3a2ef45aca0b065ad16ac0761/users/23a63cf4cdf24b2a9d30d570d3a3c725/roles/7185d0cfbcd44502b1613bcfe1b42f6f => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:31:07.809667 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c56b28a-6d3d-4563-b07a-8ab8c6e3de37 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:31:07.811300 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c56b28a-6d3d-4563-b07a-8ab8c6e3de37 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:31:07.811796 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c56b28a-6d3d-4563-b07a-8ab8c6e3de37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:31:07.872477 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-6c56b28a-6d3d-4563-b07a-8ab8c6e3de37 None None] MFA Rules not processed for user `23a63cf4cdf24b2a9d30d570d3a3c725`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:31:07.873988 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-6c56b28a-6d3d-4563-b07a-8ab8c6e3de37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:31:08.102370 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1173/2336] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:31:07 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:31:13.074811 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e6026-0321-4958-91a7-d281bc40a331 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:31:13.076548 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-ec4e6026-0321-4958-91a7-d281bc40a331 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:31:13.141543 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e6026-0321-4958-91a7-d281bc40a331 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:31:13.146147 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd36548-31d7-4059-a517-7f14c3fc5c2a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf28c0ec3d94fb99bcd573dd8dd0e30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:31:13.146858 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd36548-31d7-4059-a517-7f14c3fc5c2a service glance] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:31:13.147145 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd36548-31d7-4059-a517-7f14c3fc5c2a service glance] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:31:13.147422 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd36548-31d7-4059-a517-7f14c3fc5c2a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:31:13.157919 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd36548-31d7-4059-a517-7f14c3fc5c2a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:31:13.159653 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd36548-31d7-4059-a517-7f14c3fc5c2a service glance] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:31:13.169832 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1164/2337] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:31:13 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:31:17.898285 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e56d6e-a3c5-4254-9fa3-a81723fc1756 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:31:17.898885 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e56d6e-a3c5-4254-9fa3-a81723fc1756 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:31:17.898885 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e56d6e-a3c5-4254-9fa3-a81723fc1756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:31:17.917036 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-e9e56d6e-a3c5-4254-9fa3-a81723fc1756 None None] MFA Rules not processed for user `6d93afdf3a67428e8b712c00ca84277b`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:31:17.918830 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-e9e56d6e-a3c5-4254-9fa3-a81723fc1756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:31:17.975879 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1174/2338] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:31:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:31:20.570864 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd36548-31d7-4059-a517-7f14c3fc5c2a service glance] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:31:20.572348 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-7fd36548-31d7-4059-a517-7f14c3fc5c2a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:31:20.640785 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd36548-31d7-4059-a517-7f14c3fc5c2a service glance] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:31:20.644510 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c765b6-35ad-43a7-b038-02fac37179c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:31:20.645159 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c765b6-35ad-43a7-b038-02fac37179c4 service neutron] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:31:20.645446 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c765b6-35ad-43a7-b038-02fac37179c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:31:20.645727 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c765b6-35ad-43a7-b038-02fac37179c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:31:20.647527 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-90c765b6-35ad-43a7-b038-02fac37179c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:31:20.726151 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c765b6-35ad-43a7-b038-02fac37179c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:31:20.727741 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c765b6-35ad-43a7-b038-02fac37179c4 service neutron] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:31:20.739144 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1165/2339] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:31:20 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:31:23.811459 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e56d6e-a3c5-4254-9fa3-a81723fc1756 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:31:23.812997 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-e9e56d6e-a3c5-4254-9fa3-a81723fc1756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:31:23.896477 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e56d6e-a3c5-4254-9fa3-a81723fc1756 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:31:23.901839 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cb340d-91cb-4bd2-a3c4-18c1da078aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:31:23.902789 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb340d-91cb-4bd2-a3c4-18c1da078aea admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:31:23.903073 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb340d-91cb-4bd2-a3c4-18c1da078aea admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:31:23.903363 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb340d-91cb-4bd2-a3c4-18c1da078aea admin admin] PATH_INFO: `/v3/users/8da4b14916644153a93218ba4b2319ea` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:31:23.904862 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cb340d-91cb-4bd2-a3c4-18c1da078aea admin admin] RBAC: Authorizing `identity:delete_user(user_id=8da4b14916644153a93218ba4b2319ea)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:31:23.907589 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cb340d-91cb-4bd2-a3c4-18c1da078aea admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:31:23.976603 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-30cb340d-91cb-4bd2-a3c4-18c1da078aea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8da4b14916644153a93218ba4b2319ea'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:31:23.988833 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-30cb340d-91cb-4bd2-a3c4-18c1da078aea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8da4b14916644153a93218ba4b2319ea'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:31:23.989586 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-30cb340d-91cb-4bd2-a3c4-18c1da078aea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8da4b14916644153a93218ba4b2319ea'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:31:23.997452 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-30cb340d-91cb-4bd2-a3c4-18c1da078aea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8da4b14916644153a93218ba4b2319ea'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:31:24.019292 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-30cb340d-91cb-4bd2-a3c4-18c1da078aea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8da4b14916644153a93218ba4b2319ea'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:31:24.030684 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0290816-14de-4191-8a8f-5816f220a0e0 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:31:24.031549 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0290816-14de-4191-8a8f-5816f220a0e0 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:31:24.031549 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0290816-14de-4191-8a8f-5816f220a0e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:31:24.032809 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1175/2340] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:31:23 2022] DELETE /identity/v3/users/8da4b14916644153a93218ba4b2319ea => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:31:24.050794 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-a0290816-14de-4191-8a8f-5816f220a0e0 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:31:24.052036 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-a0290816-14de-4191-8a8f-5816f220a0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:31:24.114832 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1166/2341] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:31:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:31:24.125824 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cb340d-91cb-4bd2-a3c4-18c1da078aea admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:31:24.127485 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-30cb340d-91cb-4bd2-a3c4-18c1da078aea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:31:24.188134 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cb340d-91cb-4bd2-a3c4-18c1da078aea admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:31:24.191864 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881949df-9620-422b-ae59-9e2abe7a029d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:31:24.192525 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881949df-9620-422b-ae59-9e2abe7a029d service neutron] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:31:24.192807 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881949df-9620-422b-ae59-9e2abe7a029d service neutron] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:31:24.193086 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881949df-9620-422b-ae59-9e2abe7a029d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:31:24.202961 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881949df-9620-422b-ae59-9e2abe7a029d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:31:24.204412 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881949df-9620-422b-ae59-9e2abe7a029d service neutron] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:31:24.215772 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1176/2342] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:31:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:31:24.511414 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0290816-14de-4191-8a8f-5816f220a0e0 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:31:24.513597 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-a0290816-14de-4191-8a8f-5816f220a0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:31:24.526493 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0290816-14de-4191-8a8f-5816f220a0e0 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:31:24.531790 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4386328a-99d0-4fe4-8033-f1f1746b6da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:31:24.532645 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386328a-99d0-4fe4-8033-f1f1746b6da4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:31:24.532929 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386328a-99d0-4fe4-8033-f1f1746b6da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:31:24.533203 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386328a-99d0-4fe4-8033-f1f1746b6da4 admin admin] PATH_INFO: `/v3/projects/5c582d943f9c4bb8aa31eb008abfafa4` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:31:24.534405 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4386328a-99d0-4fe4-8033-f1f1746b6da4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c582d943f9c4bb8aa31eb008abfafa4)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:31:24.536436 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4386328a-99d0-4fe4-8033-f1f1746b6da4 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:31:24.585026 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-4386328a-99d0-4fe4-8033-f1f1746b6da4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c582d943f9c4bb8aa31eb008abfafa4', 'request_id': 'req-4386328a-99d0-4fe4-8033-f1f1746b6da4'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:31:24.592037 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-4386328a-99d0-4fe4-8033-f1f1746b6da4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c582d943f9c4bb8aa31eb008abfafa4', 'request_id': 'req-4386328a-99d0-4fe4-8033-f1f1746b6da4'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:31:24.597313 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-4386328a-99d0-4fe4-8033-f1f1746b6da4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c582d943f9c4bb8aa31eb008abfafa4', 'request_id': 'req-4386328a-99d0-4fe4-8033-f1f1746b6da4'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:31:24.609382 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-4386328a-99d0-4fe4-8033-f1f1746b6da4 admin admin] The token cache is being invalidate because project 5c582d943f9c4bb8aa31eb008abfafa4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:31:24.609665 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-4386328a-99d0-4fe4-8033-f1f1746b6da4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:31:24.610682 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-4386328a-99d0-4fe4-8033-f1f1746b6da4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:31:24.611977 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1167/2343] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:31:24 2022] DELETE /identity/v3/projects/5c582d943f9c4bb8aa31eb008abfafa4 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:31:24.617475 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e7b6d5-552f-44e1-9ab3-c4f58521d94e None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:31:24.617869 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e7b6d5-552f-44e1-9ab3-c4f58521d94e None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:31:24.618161 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e7b6d5-552f-44e1-9ab3-c4f58521d94e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:31:24.636536 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-c7e7b6d5-552f-44e1-9ab3-c4f58521d94e None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:31:24.637878 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-c7e7b6d5-552f-44e1-9ab3-c4f58521d94e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:31:24.703205 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1177/2344] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:31:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 01:31:24.710940 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa8a01-e1b6-4b80-9edb-d829185fbd67 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:31:24.711260 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa8a01-e1b6-4b80-9edb-d829185fbd67 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:31:24.711535 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa8a01-e1b6-4b80-9edb-d829185fbd67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:31:24.729403 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-12fa8a01-e1b6-4b80-9edb-d829185fbd67 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:31:24.730587 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-12fa8a01-e1b6-4b80-9edb-d829185fbd67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:31:24.738877 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1168/2345] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:31:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:31:24.742962 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e7b6d5-552f-44e1-9ab3-c4f58521d94e None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:31:24.753045 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e7b6d5-552f-44e1-9ab3-c4f58521d94e None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:31:24.759265 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2830d5-42b4-4a7b-9225-4c03e0b627b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:31:24.759265 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2830d5-42b4-4a7b-9225-4c03e0b627b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:31:24.759265 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2830d5-42b4-4a7b-9225-4c03e0b627b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:31:24.759265 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2830d5-42b4-4a7b-9225-4c03e0b627b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:31:24.759761 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2830d5-42b4-4a7b-9225-4c03e0b627b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:31:24.760011 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2830d5-42b4-4a7b-9225-4c03e0b627b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:31:24.761621 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2830d5-42b4-4a7b-9225-4c03e0b627b1 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:31:24.776805 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1178/2346] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Mar 30 01:31:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:31:24.778257 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fa8a01-e1b6-4b80-9edb-d829185fbd67 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:31:24.787602 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fa8a01-e1b6-4b80-9edb-d829185fbd67 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:31:24.792227 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2be965-c247-4164-9d9e-880dfc6d4dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:31:24.792879 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2be965-c247-4164-9d9e-880dfc6d4dd3 admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:31:24.793157 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2be965-c247-4164-9d9e-880dfc6d4dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:31:24.793954 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2be965-c247-4164-9d9e-880dfc6d4dd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:31:24.794639 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2be965-c247-4164-9d9e-880dfc6d4dd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:31:24.798491 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2be965-c247-4164-9d9e-880dfc6d4dd3 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:31:24.823783 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1169/2347] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:31:24 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:31:24.828377 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2830d5-42b4-4a7b-9225-4c03e0b627b1 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:31:24.838541 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2830d5-42b4-4a7b-9225-4c03e0b627b1 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:31:24.900176 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8007929-3370-45e5-8724-1afd706439bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:31:24.900851 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8007929-3370-45e5-8724-1afd706439bb admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:31:24.901164 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8007929-3370-45e5-8724-1afd706439bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:31:24.901448 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8007929-3370-45e5-8724-1afd706439bb admin admin] PATH_INFO: `/v3/users` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:31:24.902147 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8007929-3370-45e5-8724-1afd706439bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:31:24.904145 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8007929-3370-45e5-8724-1afd706439bb admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:31:24.925253 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1179/2348] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:31:24 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 01:31:24.929340 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2be965-c247-4164-9d9e-880dfc6d4dd3 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:31:24.941006 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2be965-c247-4164-9d9e-880dfc6d4dd3 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:31:24.945819 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20ed8fc-2805-4dbb-bfb5-bc4a27b7a78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:31:24.946491 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ed8fc-2805-4dbb-bfb5-bc4a27b7a78d admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:31:24.946817 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ed8fc-2805-4dbb-bfb5-bc4a27b7a78d admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:31:24.947097 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ed8fc-2805-4dbb-bfb5-bc4a27b7a78d admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:31:24.947826 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20ed8fc-2805-4dbb-bfb5-bc4a27b7a78d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:31:24.949501 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20ed8fc-2805-4dbb-bfb5-bc4a27b7a78d admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:31:24.960999 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1170/2349] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:31:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:31:24.965591 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8007929-3370-45e5-8724-1afd706439bb admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:31:24.975433 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8007929-3370-45e5-8724-1afd706439bb admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:31:24.980002 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b42759d-18eb-4442-9d40-f981a7c64740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:31:24.980647 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42759d-18eb-4442-9d40-f981a7c64740 admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:31:24.981512 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42759d-18eb-4442-9d40-f981a7c64740 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:31:24.981793 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42759d-18eb-4442-9d40-f981a7c64740 admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:31:24.982613 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b42759d-18eb-4442-9d40-f981a7c64740 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:31:24.984421 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b42759d-18eb-4442-9d40-f981a7c64740 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:31:24.998733 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1180/2350] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:31:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:31:25.003007 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20ed8fc-2805-4dbb-bfb5-bc4a27b7a78d admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:31:25.015035 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20ed8fc-2805-4dbb-bfb5-bc4a27b7a78d admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:31:25.023696 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2743dfda-bd21-4849-b3a9-78a7047e02c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:31:25.024612 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743dfda-bd21-4849-b3a9-78a7047e02c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:31:25.024894 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743dfda-bd21-4849-b3a9-78a7047e02c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:31:25.025166 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743dfda-bd21-4849-b3a9-78a7047e02c7 admin admin] PATH_INFO: `/v3/projects/f0e3da5f182341c6a6c2b48d5ef79ec8/users/18eb392c26de46b5ac34eebf78ecd403/roles/7185d0cfbcd44502b1613bcfe1b42f6f` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:31:25.051270 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2743dfda-bd21-4849-b3a9-78a7047e02c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0e3da5f182341c6a6c2b48d5ef79ec8, user_id=18eb392c26de46b5ac34eebf78ecd403, role_id=7185d0cfbcd44502b1613bcfe1b42f6f)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:31:25.054263 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2743dfda-bd21-4849-b3a9-78a7047e02c7 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:31:25.097890 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1171/2351] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:31:25 2022] PUT /identity/v3/projects/f0e3da5f182341c6a6c2b48d5ef79ec8/users/18eb392c26de46b5ac34eebf78ecd403/roles/7185d0cfbcd44502b1613bcfe1b42f6f => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:31:25.110253 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a86b9a-3011-40ae-9e1b-78613bf7e91b None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:31:25.110544 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a86b9a-3011-40ae-9e1b-78613bf7e91b None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:31:25.110865 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a86b9a-3011-40ae-9e1b-78613bf7e91b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:31:25.137954 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-d0a86b9a-3011-40ae-9e1b-78613bf7e91b None None] MFA Rules not processed for user `18eb392c26de46b5ac34eebf78ecd403`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:31:25.139198 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-d0a86b9a-3011-40ae-9e1b-78613bf7e91b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:31:25.208130 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1181/2352] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:31:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:31:25.212838 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2743dfda-bd21-4849-b3a9-78a7047e02c7 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:31:25.280741 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2743dfda-bd21-4849-b3a9-78a7047e02c7 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:31:25.285624 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d1df20-c2c4-464b-b42e-febfb04865ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:31:25.286283 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d1df20-c2c4-464b-b42e-febfb04865ff admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:31:25.286574 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d1df20-c2c4-464b-b42e-febfb04865ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:31:25.286886 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d1df20-c2c4-464b-b42e-febfb04865ff admin admin] PATH_INFO: `/v3/projects` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:31:25.287580 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d1df20-c2c4-464b-b42e-febfb04865ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:31:25.289470 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d1df20-c2c4-464b-b42e-febfb04865ff admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:31:25.316691 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1172/2353] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:31:25 2022] POST /identity/v3/projects => generated 377 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:31:25.320445 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a86b9a-3011-40ae-9e1b-78613bf7e91b None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:31:25.331992 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a86b9a-3011-40ae-9e1b-78613bf7e91b None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:31:25.387833 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cb6148-d745-4444-98a1-b34080177236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:31:25.388496 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb6148-d745-4444-98a1-b34080177236 admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:31:25.388776 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb6148-d745-4444-98a1-b34080177236 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:31:25.389050 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb6148-d745-4444-98a1-b34080177236 admin admin] PATH_INFO: `/v3/users` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:31:25.389770 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cb6148-d745-4444-98a1-b34080177236 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:31:25.391774 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cb6148-d745-4444-98a1-b34080177236 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:31:25.411673 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1182/2354] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:31:25 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 01:31:25.416205 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d1df20-c2c4-464b-b42e-febfb04865ff admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:31:25.426515 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d1df20-c2c4-464b-b42e-febfb04865ff admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:31:25.431145 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f1fa25-8657-4eed-bcd9-d4eb30084c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:31:25.431798 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f1fa25-8657-4eed-bcd9-d4eb30084c20 admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:31:25.432080 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f1fa25-8657-4eed-bcd9-d4eb30084c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:31:25.432351 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f1fa25-8657-4eed-bcd9-d4eb30084c20 admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:31:25.433074 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f1fa25-8657-4eed-bcd9-d4eb30084c20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:31:25.434840 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f1fa25-8657-4eed-bcd9-d4eb30084c20 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:31:25.445113 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1173/2355] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:31:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:31:25.449062 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cb6148-d745-4444-98a1-b34080177236 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:31:25.459432 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cb6148-d745-4444-98a1-b34080177236 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:31:25.464348 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5209fdf0-48a2-45c7-9b8b-57f74a0c6fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:31:25.464938 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5209fdf0-48a2-45c7-9b8b-57f74a0c6fd9 admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:31:25.465370 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5209fdf0-48a2-45c7-9b8b-57f74a0c6fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:31:25.465649 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5209fdf0-48a2-45c7-9b8b-57f74a0c6fd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:31:25.466378 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5209fdf0-48a2-45c7-9b8b-57f74a0c6fd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:31:25.467999 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5209fdf0-48a2-45c7-9b8b-57f74a0c6fd9 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:31:25.477872 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1183/2356] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:31:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:31:25.482600 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f1fa25-8657-4eed-bcd9-d4eb30084c20 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:31:25.492822 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f1fa25-8657-4eed-bcd9-d4eb30084c20 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:31:25.498046 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348f2fdd-e16d-4b4e-8b7c-9555e4747166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:31:25.498946 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348f2fdd-e16d-4b4e-8b7c-9555e4747166 admin admin] REQUEST_METHOD: `PUT` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:31:25.499229 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348f2fdd-e16d-4b4e-8b7c-9555e4747166 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:31:25.499505 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348f2fdd-e16d-4b4e-8b7c-9555e4747166 admin admin] PATH_INFO: `/v3/projects/41aa29bc75fe4a8f8a2781713f6a777f/users/8a8c262bdd844d009c348a2d1db1a25c/roles/7185d0cfbcd44502b1613bcfe1b42f6f` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:31:25.513762 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348f2fdd-e16d-4b4e-8b7c-9555e4747166 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41aa29bc75fe4a8f8a2781713f6a777f, user_id=8a8c262bdd844d009c348a2d1db1a25c, role_id=7185d0cfbcd44502b1613bcfe1b42f6f)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:31:25.516451 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348f2fdd-e16d-4b4e-8b7c-9555e4747166 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:31:25.529052 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1174/2357] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:31:25 2022] PUT /identity/v3/projects/41aa29bc75fe4a8f8a2781713f6a777f/users/8a8c262bdd844d009c348a2d1db1a25c/roles/7185d0cfbcd44502b1613bcfe1b42f6f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:31:25.539243 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a008e-b9c9-4356-82b9-c37550b6b002 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:31:25.539535 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a008e-b9c9-4356-82b9-c37550b6b002 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:31:25.539815 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a008e-b9c9-4356-82b9-c37550b6b002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:31:25.566979 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-9e0a008e-b9c9-4356-82b9-c37550b6b002 None None] MFA Rules not processed for user `8a8c262bdd844d009c348a2d1db1a25c`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:31:25.568199 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-9e0a008e-b9c9-4356-82b9-c37550b6b002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:31:25.638322 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1184/2358] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:31:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:31:25.642756 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348f2fdd-e16d-4b4e-8b7c-9555e4747166 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:31:25.706093 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348f2fdd-e16d-4b4e-8b7c-9555e4747166 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:31:25.710783 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894a491b-bc0a-4265-b71a-6279c9feb012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:31:25.711454 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a491b-bc0a-4265-b71a-6279c9feb012 admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:31:25.711712 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a491b-bc0a-4265-b71a-6279c9feb012 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:31:25.711985 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a491b-bc0a-4265-b71a-6279c9feb012 admin admin] PATH_INFO: `/v3/projects` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:31:25.712676 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894a491b-bc0a-4265-b71a-6279c9feb012 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:31:25.714881 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894a491b-bc0a-4265-b71a-6279c9feb012 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:31:25.740723 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1175/2359] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:31:25 2022] POST /identity/v3/projects => generated 375 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:31:25.744704 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0a008e-b9c9-4356-82b9-c37550b6b002 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:31:25.755716 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0a008e-b9c9-4356-82b9-c37550b6b002 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:31:25.815667 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c96623f-c495-4aad-90c7-a4f867100414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:31:25.816336 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96623f-c495-4aad-90c7-a4f867100414 admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:31:25.816619 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96623f-c495-4aad-90c7-a4f867100414 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:31:25.816895 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96623f-c495-4aad-90c7-a4f867100414 admin admin] PATH_INFO: `/v3/users` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:31:25.817584 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c96623f-c495-4aad-90c7-a4f867100414 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:31:25.819549 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c96623f-c495-4aad-90c7-a4f867100414 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:31:25.843955 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1185/2360] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:31:25 2022] POST /identity/v3/users => generated 294 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:31:25.846679 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894a491b-bc0a-4265-b71a-6279c9feb012 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:31:25.858669 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894a491b-bc0a-4265-b71a-6279c9feb012 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:31:25.863957 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b46e0-8a3a-4e52-9c59-a6a0e63905d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:31:25.864788 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b46e0-8a3a-4e52-9c59-a6a0e63905d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:31:25.865077 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b46e0-8a3a-4e52-9c59-a6a0e63905d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:31:25.865519 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b46e0-8a3a-4e52-9c59-a6a0e63905d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:31:25.866350 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b46e0-8a3a-4e52-9c59-a6a0e63905d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:31:25.868195 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b46e0-8a3a-4e52-9c59-a6a0e63905d9 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:31:25.880535 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1176/2361] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:31:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:31:25.884600 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c96623f-c495-4aad-90c7-a4f867100414 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:31:25.898401 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c96623f-c495-4aad-90c7-a4f867100414 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:31:25.903817 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b4f37f-bb8f-488e-9393-2040619325e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:31:25.904872 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b4f37f-bb8f-488e-9393-2040619325e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:31:25.905262 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b4f37f-bb8f-488e-9393-2040619325e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:31:25.905625 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b4f37f-bb8f-488e-9393-2040619325e4 admin admin] PATH_INFO: `/v3/projects/c6e7ef2ab1cf41bf8a52e52b9e58ec7c/users/571eb349cb7145329414786522a4abba/roles/36909bbf31d04993bb2a9fe587b572dc` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:31:25.922307 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b4f37f-bb8f-488e-9393-2040619325e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6e7ef2ab1cf41bf8a52e52b9e58ec7c, user_id=571eb349cb7145329414786522a4abba, role_id=36909bbf31d04993bb2a9fe587b572dc)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:31:25.925695 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b4f37f-bb8f-488e-9393-2040619325e4 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:31:25.942674 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1186/2362] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:31:25 2022] PUT /identity/v3/projects/c6e7ef2ab1cf41bf8a52e52b9e58ec7c/users/571eb349cb7145329414786522a4abba/roles/36909bbf31d04993bb2a9fe587b572dc => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:31:25.945747 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b46e0-8a3a-4e52-9c59-a6a0e63905d9 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:31:25.962396 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b46e0-8a3a-4e52-9c59-a6a0e63905d9 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:31:26.034086 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67566a64-4445-493e-8b6e-c584c444ce9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:31:26.034856 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67566a64-4445-493e-8b6e-c584c444ce9f admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:31:26.035136 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67566a64-4445-493e-8b6e-c584c444ce9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:31:26.035408 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67566a64-4445-493e-8b6e-c584c444ce9f admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:31:26.036190 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67566a64-4445-493e-8b6e-c584c444ce9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:31:26.037871 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67566a64-4445-493e-8b6e-c584c444ce9f admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:31:26.048686 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1177/2363] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:31:25 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:31:26.052811 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b4f37f-bb8f-488e-9393-2040619325e4 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:31:26.063204 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b4f37f-bb8f-488e-9393-2040619325e4 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:31:26.072556 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba22d785-2236-4ffa-8710-e9b3688597b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:31:26.073267 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba22d785-2236-4ffa-8710-e9b3688597b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:31:26.073555 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba22d785-2236-4ffa-8710-e9b3688597b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:31:26.073830 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba22d785-2236-4ffa-8710-e9b3688597b7 admin admin] PATH_INFO: `/v3/projects/c6e7ef2ab1cf41bf8a52e52b9e58ec7c/users/571eb349cb7145329414786522a4abba/roles/36909bbf31d04993bb2a9fe587b572dc` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:31:26.077672 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba22d785-2236-4ffa-8710-e9b3688597b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6e7ef2ab1cf41bf8a52e52b9e58ec7c, user_id=571eb349cb7145329414786522a4abba, role_id=36909bbf31d04993bb2a9fe587b572dc)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:31:26.080354 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba22d785-2236-4ffa-8710-e9b3688597b7 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:31:26.095154 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1187/2364] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:31:26 2022] PUT /identity/v3/projects/c6e7ef2ab1cf41bf8a52e52b9e58ec7c/users/571eb349cb7145329414786522a4abba/roles/36909bbf31d04993bb2a9fe587b572dc => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:31:26.107906 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9ea16-bd8a-43f7-abf7-a766e0cf85f4 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:31:26.108422 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9ea16-bd8a-43f7-abf7-a766e0cf85f4 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:31:26.109048 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9ea16-bd8a-43f7-abf7-a766e0cf85f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:31:26.152102 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-61f9ea16-bd8a-43f7-abf7-a766e0cf85f4 None None] MFA Rules not processed for user `571eb349cb7145329414786522a4abba`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:31:26.153389 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-61f9ea16-bd8a-43f7-abf7-a766e0cf85f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:31:26.220700 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1178/2365] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:31:26 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:31:26.232583 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba22d785-2236-4ffa-8710-e9b3688597b7 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:31:26.234312 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-ba22d785-2236-4ffa-8710-e9b3688597b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:31:26.313643 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba22d785-2236-4ffa-8710-e9b3688597b7 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:31:26.317370 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ace4ae-c51d-417e-aa33-94b96f08e265 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45219f386f0147b6bd380efe4ab62812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:31:26.318039 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ace4ae-c51d-417e-aa33-94b96f08e265 service cinder] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:31:26.318321 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ace4ae-c51d-417e-aa33-94b96f08e265 service cinder] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:31:26.318598 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ace4ae-c51d-417e-aa33-94b96f08e265 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:31:26.386642 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ace4ae-c51d-417e-aa33-94b96f08e265 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:31:26.388362 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ace4ae-c51d-417e-aa33-94b96f08e265 service cinder] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:31:26.397343 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1188/2366] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:31:26 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 30 01:31:27.911754 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f9ea16-bd8a-43f7-abf7-a766e0cf85f4 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:31:27.921698 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f9ea16-bd8a-43f7-abf7-a766e0cf85f4 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:31:27.925714 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27815490-fa47-48a2-9f83-385f74a90884 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45219f386f0147b6bd380efe4ab62812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:31:27.926369 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27815490-fa47-48a2-9f83-385f74a90884 service cinder] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:31:27.926650 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27815490-fa47-48a2-9f83-385f74a90884 service cinder] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:31:27.926972 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27815490-fa47-48a2-9f83-385f74a90884 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:31:28.009895 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27815490-fa47-48a2-9f83-385f74a90884 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:31:28.011444 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27815490-fa47-48a2-9f83-385f74a90884 service cinder] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:31:28.021838 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1179/2367] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:31:27 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:31:28.569557 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ace4ae-c51d-417e-aa33-94b96f08e265 service cinder] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:31:28.578090 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ace4ae-c51d-417e-aa33-94b96f08e265 service cinder] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:31:28.581919 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3f352e-86a3-4d60-9897-39616dd43ef9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45219f386f0147b6bd380efe4ab62812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:31:28.582554 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3f352e-86a3-4d60-9897-39616dd43ef9 service cinder] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:31:28.582880 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3f352e-86a3-4d60-9897-39616dd43ef9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:31:28.583156 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3f352e-86a3-4d60-9897-39616dd43ef9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:31:28.592202 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3f352e-86a3-4d60-9897-39616dd43ef9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:31:28.593617 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3f352e-86a3-4d60-9897-39616dd43ef9 service cinder] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:31:28.603006 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1189/2368] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:31:28 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:31:32.507928 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27815490-fa47-48a2-9f83-385f74a90884 service cinder] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:31:32.586304 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27815490-fa47-48a2-9f83-385f74a90884 service cinder] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:31:32.591577 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f126679a-b978-4825-b1d1-25745b59a5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:31:32.592471 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126679a-b978-4825-b1d1-25745b59a5d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:31:32.592780 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126679a-b978-4825-b1d1-25745b59a5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:31:32.593054 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126679a-b978-4825-b1d1-25745b59a5d5 admin admin] PATH_INFO: `/v3/users/18eb392c26de46b5ac34eebf78ecd403` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:31:32.594253 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f126679a-b978-4825-b1d1-25745b59a5d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18eb392c26de46b5ac34eebf78ecd403)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:31:32.596212 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f126679a-b978-4825-b1d1-25745b59a5d5 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:31:32.642511 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-f126679a-b978-4825-b1d1-25745b59a5d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18eb392c26de46b5ac34eebf78ecd403'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:31:32.660048 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-f126679a-b978-4825-b1d1-25745b59a5d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18eb392c26de46b5ac34eebf78ecd403'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:31:32.667810 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-f126679a-b978-4825-b1d1-25745b59a5d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18eb392c26de46b5ac34eebf78ecd403'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:31:32.668433 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-f126679a-b978-4825-b1d1-25745b59a5d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18eb392c26de46b5ac34eebf78ecd403'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:31:32.671058 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b2d7ae-0e1e-4bf6-aea5-d81967f45c75 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:31:32.671550 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b2d7ae-0e1e-4bf6-aea5-d81967f45c75 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:31:32.671773 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b2d7ae-0e1e-4bf6-aea5-d81967f45c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:31:32.676518 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-f126679a-b978-4825-b1d1-25745b59a5d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18eb392c26de46b5ac34eebf78ecd403'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:31:32.682361 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1180/2369] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:31:32 2022] DELETE /identity/v3/users/18eb392c26de46b5ac34eebf78ecd403 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:31:32.687196 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be16e1c-649a-4208-b108-1689f95f258b None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:31:32.687484 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be16e1c-649a-4208-b108-1689f95f258b None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:31:32.687763 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be16e1c-649a-4208-b108-1689f95f258b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:31:32.690011 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-d3b2d7ae-0e1e-4bf6-aea5-d81967f45c75 None None] MFA Rules not processed for user `0503fdca7f834ef0a81422804dc74812`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:31:32.691244 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-d3b2d7ae-0e1e-4bf6-aea5-d81967f45c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:31:32.705155 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-8be16e1c-649a-4208-b108-1689f95f258b None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:31:32.706346 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-8be16e1c-649a-4208-b108-1689f95f258b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:31:32.758843 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1190/2370] 10.222.0.30 () {58 vars in 967 bytes} [Wed Mar 30 01:31:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:31:32.771049 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1181/2371] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:31:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 01:31:32.782462 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b2d7ae-0e1e-4bf6-aea5-d81967f45c75 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:31:32.783084 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be16e1c-649a-4208-b108-1689f95f258b None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:31:32.784053 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-d3b2d7ae-0e1e-4bf6-aea5-d81967f45c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:31:32.784451 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-8be16e1c-649a-4208-b108-1689f95f258b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:31:32.844415 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b2d7ae-0e1e-4bf6-aea5-d81967f45c75 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:31:32.848113 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb073d37-6295-40cf-92a7-b64c43049a62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:31:32.848789 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb073d37-6295-40cf-92a7-b64c43049a62 service neutron] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:31:32.849073 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb073d37-6295-40cf-92a7-b64c43049a62 service neutron] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:31:32.849346 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb073d37-6295-40cf-92a7-b64c43049a62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:31:32.858159 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be16e1c-649a-4208-b108-1689f95f258b None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:31:32.860155 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb073d37-6295-40cf-92a7-b64c43049a62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:31:32.861894 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb073d37-6295-40cf-92a7-b64c43049a62 service neutron] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:31:32.862097 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82698ea-2b54-4da4-88d1-39ff01b7ae61 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f16de81dfb4c14b027cd6cd1e6ff2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:31:32.862784 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82698ea-2b54-4da4-88d1-39ff01b7ae61 service swift] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:31:32.863076 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82698ea-2b54-4da4-88d1-39ff01b7ae61 service swift] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:31:32.863359 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82698ea-2b54-4da4-88d1-39ff01b7ae61 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:31:32.873104 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82698ea-2b54-4da4-88d1-39ff01b7ae61 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:31:32.873285 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1191/2372] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:31:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:31:32.874727 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82698ea-2b54-4da4-88d1-39ff01b7ae61 service swift] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:31:32.883741 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1182/2373] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Mar 30 01:31:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Mar 30 01:31:33.152276 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb073d37-6295-40cf-92a7-b64c43049a62 service neutron] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:31:33.154025 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-cb073d37-6295-40cf-92a7-b64c43049a62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:31:33.169158 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb073d37-6295-40cf-92a7-b64c43049a62 service neutron] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:31:33.175410 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c63b4d-7994-48d6-92bf-23545ce38915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:31:33.176443 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c63b4d-7994-48d6-92bf-23545ce38915 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:31:33.177068 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c63b4d-7994-48d6-92bf-23545ce38915 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:31:33.177068 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c63b4d-7994-48d6-92bf-23545ce38915 admin admin] PATH_INFO: `/v3/projects/f0e3da5f182341c6a6c2b48d5ef79ec8` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:31:33.178324 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c63b4d-7994-48d6-92bf-23545ce38915 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0e3da5f182341c6a6c2b48d5ef79ec8)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:31:33.180520 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c63b4d-7994-48d6-92bf-23545ce38915 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:31:33.228759 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-79c63b4d-7994-48d6-92bf-23545ce38915 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0e3da5f182341c6a6c2b48d5ef79ec8', 'request_id': 'req-79c63b4d-7994-48d6-92bf-23545ce38915'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:31:33.234741 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-79c63b4d-7994-48d6-92bf-23545ce38915 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0e3da5f182341c6a6c2b48d5ef79ec8', 'request_id': 'req-79c63b4d-7994-48d6-92bf-23545ce38915'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:31:33.242035 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-79c63b4d-7994-48d6-92bf-23545ce38915 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0e3da5f182341c6a6c2b48d5ef79ec8', 'request_id': 'req-79c63b4d-7994-48d6-92bf-23545ce38915'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:31:33.253309 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-79c63b4d-7994-48d6-92bf-23545ce38915 admin admin] The token cache is being invalidate because project f0e3da5f182341c6a6c2b48d5ef79ec8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:31:33.253682 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-79c63b4d-7994-48d6-92bf-23545ce38915 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:31:33.254358 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-79c63b4d-7994-48d6-92bf-23545ce38915 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:31:33.255921 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1192/2374] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:31:33 2022] DELETE /identity/v3/projects/f0e3da5f182341c6a6c2b48d5ef79ec8 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:31:33.259883 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82698ea-2b54-4da4-88d1-39ff01b7ae61 service swift] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:31:33.271084 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82698ea-2b54-4da4-88d1-39ff01b7ae61 service swift] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:31:33.327648 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24310422-4122-4dee-9dbe-27662d15dac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:31:33.328546 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24310422-4122-4dee-9dbe-27662d15dac3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:31:33.328827 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24310422-4122-4dee-9dbe-27662d15dac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:31:33.329104 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24310422-4122-4dee-9dbe-27662d15dac3 admin admin] PATH_INFO: `/v3/users/8a8c262bdd844d009c348a2d1db1a25c` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:31:33.330291 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24310422-4122-4dee-9dbe-27662d15dac3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a8c262bdd844d009c348a2d1db1a25c)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:31:33.332246 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24310422-4122-4dee-9dbe-27662d15dac3 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:31:33.377640 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-24310422-4122-4dee-9dbe-27662d15dac3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a8c262bdd844d009c348a2d1db1a25c'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:31:33.389111 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-24310422-4122-4dee-9dbe-27662d15dac3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a8c262bdd844d009c348a2d1db1a25c'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:31:33.396210 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-24310422-4122-4dee-9dbe-27662d15dac3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a8c262bdd844d009c348a2d1db1a25c'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:31:33.396808 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-24310422-4122-4dee-9dbe-27662d15dac3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a8c262bdd844d009c348a2d1db1a25c'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:31:33.404418 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-24310422-4122-4dee-9dbe-27662d15dac3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a8c262bdd844d009c348a2d1db1a25c'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:31:33.410481 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1183/2375] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:31:33 2022] DELETE /identity/v3/users/8a8c262bdd844d009c348a2d1db1a25c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:31:33.695681 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c63b4d-7994-48d6-92bf-23545ce38915 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:31:33.698304 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-79c63b4d-7994-48d6-92bf-23545ce38915 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:31:33.715270 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c63b4d-7994-48d6-92bf-23545ce38915 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:31:33.781174 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf9b5fd-5b31-4fcb-bb50-a09ffc228086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:31:33.782444 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf9b5fd-5b31-4fcb-bb50-a09ffc228086 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:31:33.782764 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf9b5fd-5b31-4fcb-bb50-a09ffc228086 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:31:33.782993 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf9b5fd-5b31-4fcb-bb50-a09ffc228086 admin admin] PATH_INFO: `/v3/projects/41aa29bc75fe4a8f8a2781713f6a777f` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:31:33.784163 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf9b5fd-5b31-4fcb-bb50-a09ffc228086 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41aa29bc75fe4a8f8a2781713f6a777f)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:31:33.786071 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf9b5fd-5b31-4fcb-bb50-a09ffc228086 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:31:33.832949 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-fcf9b5fd-5b31-4fcb-bb50-a09ffc228086 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41aa29bc75fe4a8f8a2781713f6a777f', 'request_id': 'req-fcf9b5fd-5b31-4fcb-bb50-a09ffc228086'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:31:33.838285 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-fcf9b5fd-5b31-4fcb-bb50-a09ffc228086 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41aa29bc75fe4a8f8a2781713f6a777f', 'request_id': 'req-fcf9b5fd-5b31-4fcb-bb50-a09ffc228086'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:31:33.846918 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-fcf9b5fd-5b31-4fcb-bb50-a09ffc228086 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41aa29bc75fe4a8f8a2781713f6a777f', 'request_id': 'req-fcf9b5fd-5b31-4fcb-bb50-a09ffc228086'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:31:33.858523 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-fcf9b5fd-5b31-4fcb-bb50-a09ffc228086 admin admin] The token cache is being invalidate because project 41aa29bc75fe4a8f8a2781713f6a777f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:31:33.858860 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-fcf9b5fd-5b31-4fcb-bb50-a09ffc228086 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:31:33.859514 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-fcf9b5fd-5b31-4fcb-bb50-a09ffc228086 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:31:33.861267 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1193/2376] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:31:33 2022] DELETE /identity/v3/projects/41aa29bc75fe4a8f8a2781713f6a777f => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:31:33.865070 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24310422-4122-4dee-9dbe-27662d15dac3 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:31:33.866463 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-24310422-4122-4dee-9dbe-27662d15dac3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:31:33.879743 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24310422-4122-4dee-9dbe-27662d15dac3 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:31:33.940898 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fad629-2e97-4fd8-81c0-6bc74cb43fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:31:33.942077 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fad629-2e97-4fd8-81c0-6bc74cb43fe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:31:33.942370 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fad629-2e97-4fd8-81c0-6bc74cb43fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:31:33.942653 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fad629-2e97-4fd8-81c0-6bc74cb43fe2 admin admin] PATH_INFO: `/v3/users/571eb349cb7145329414786522a4abba` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:31:33.944037 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fad629-2e97-4fd8-81c0-6bc74cb43fe2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=571eb349cb7145329414786522a4abba)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:31:33.945963 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fad629-2e97-4fd8-81c0-6bc74cb43fe2 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:31:33.994489 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-54fad629-2e97-4fd8-81c0-6bc74cb43fe2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '571eb349cb7145329414786522a4abba'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:31:34.007923 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-54fad629-2e97-4fd8-81c0-6bc74cb43fe2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '571eb349cb7145329414786522a4abba'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:31:34.015056 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-54fad629-2e97-4fd8-81c0-6bc74cb43fe2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '571eb349cb7145329414786522a4abba'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:31:34.015822 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-54fad629-2e97-4fd8-81c0-6bc74cb43fe2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '571eb349cb7145329414786522a4abba'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:31:34.023085 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-54fad629-2e97-4fd8-81c0-6bc74cb43fe2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '571eb349cb7145329414786522a4abba'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:31:34.029649 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1184/2377] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:31:33 2022] DELETE /identity/v3/users/571eb349cb7145329414786522a4abba => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:31:34.286927 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf9b5fd-5b31-4fcb-bb50-a09ffc228086 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:31:34.288432 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-fcf9b5fd-5b31-4fcb-bb50-a09ffc228086 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:31:34.301366 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf9b5fd-5b31-4fcb-bb50-a09ffc228086 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:31:34.357903 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455555bc-d647-4397-8ba7-fdeab8e71a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:31:34.358798 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455555bc-d647-4397-8ba7-fdeab8e71a3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:31:34.359082 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455555bc-d647-4397-8ba7-fdeab8e71a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:31:34.359359 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455555bc-d647-4397-8ba7-fdeab8e71a3b admin admin] PATH_INFO: `/v3/projects/c6e7ef2ab1cf41bf8a52e52b9e58ec7c` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:31:34.360542 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455555bc-d647-4397-8ba7-fdeab8e71a3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6e7ef2ab1cf41bf8a52e52b9e58ec7c)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:31:34.362466 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455555bc-d647-4397-8ba7-fdeab8e71a3b admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:31:34.409979 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-455555bc-d647-4397-8ba7-fdeab8e71a3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6e7ef2ab1cf41bf8a52e52b9e58ec7c', 'request_id': 'req-455555bc-d647-4397-8ba7-fdeab8e71a3b'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:31:34.415520 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-455555bc-d647-4397-8ba7-fdeab8e71a3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6e7ef2ab1cf41bf8a52e52b9e58ec7c', 'request_id': 'req-455555bc-d647-4397-8ba7-fdeab8e71a3b'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:31:34.422853 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-455555bc-d647-4397-8ba7-fdeab8e71a3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6e7ef2ab1cf41bf8a52e52b9e58ec7c', 'request_id': 'req-455555bc-d647-4397-8ba7-fdeab8e71a3b'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:31:34.433477 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-455555bc-d647-4397-8ba7-fdeab8e71a3b admin admin] The token cache is being invalidate because project c6e7ef2ab1cf41bf8a52e52b9e58ec7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:31:34.433759 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-455555bc-d647-4397-8ba7-fdeab8e71a3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:31:34.434976 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-455555bc-d647-4397-8ba7-fdeab8e71a3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:31:34.436627 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1194/2378] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:31:34 2022] DELETE /identity/v3/projects/c6e7ef2ab1cf41bf8a52e52b9e58ec7c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:31:34.441403 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df18d1-f08b-4cf4-86cf-b242ac843294 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:31:34.441689 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df18d1-f08b-4cf4-86cf-b242ac843294 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:31:34.441968 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df18d1-f08b-4cf4-86cf-b242ac843294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:31:34.460234 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-98df18d1-f08b-4cf4-86cf-b242ac843294 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:31:34.461415 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-98df18d1-f08b-4cf4-86cf-b242ac843294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:31:34.537247 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1185/2379] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:31:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:31:34.546679 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d966c2-ecc9-4fb5-972e-17e98c3c8586 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:31:34.547012 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d966c2-ecc9-4fb5-972e-17e98c3c8586 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:31:34.547310 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d966c2-ecc9-4fb5-972e-17e98c3c8586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:31:34.566746 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-f6d966c2-ecc9-4fb5-972e-17e98c3c8586 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:31:34.567993 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-f6d966c2-ecc9-4fb5-972e-17e98c3c8586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:31:34.576998 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1195/2380] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:31:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:31:34.581258 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98df18d1-f08b-4cf4-86cf-b242ac843294 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:31:34.591028 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98df18d1-f08b-4cf4-86cf-b242ac843294 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:31:34.595625 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1926d7b1-d1e4-4b0c-a0f8-a8d7802b15b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:31:34.596268 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1926d7b1-d1e4-4b0c-a0f8-a8d7802b15b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:31:34.596549 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1926d7b1-d1e4-4b0c-a0f8-a8d7802b15b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:31:34.596824 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1926d7b1-d1e4-4b0c-a0f8-a8d7802b15b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:31:34.597540 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1926d7b1-d1e4-4b0c-a0f8-a8d7802b15b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:31:34.597848 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1926d7b1-d1e4-4b0c-a0f8-a8d7802b15b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:31:34.599471 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1926d7b1-d1e4-4b0c-a0f8-a8d7802b15b2 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:31:34.611929 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1186/2381] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Mar 30 01:31:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:31:34.616145 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d966c2-ecc9-4fb5-972e-17e98c3c8586 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:31:34.626231 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d966c2-ecc9-4fb5-972e-17e98c3c8586 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:31:34.630931 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b0d191-cbcd-4da7-b657-bba342ff275b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:31:34.631585 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0d191-cbcd-4da7-b657-bba342ff275b admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:31:34.631867 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0d191-cbcd-4da7-b657-bba342ff275b admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:31:34.632142 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0d191-cbcd-4da7-b657-bba342ff275b admin admin] PATH_INFO: `/v3/projects` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:31:34.632851 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b0d191-cbcd-4da7-b657-bba342ff275b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:31:34.634760 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b0d191-cbcd-4da7-b657-bba342ff275b admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:31:34.662675 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1196/2382] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:31:34 2022] POST /identity/v3/projects => generated 389 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:31:34.666986 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1926d7b1-d1e4-4b0c-a0f8-a8d7802b15b2 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:31:34.677674 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1926d7b1-d1e4-4b0c-a0f8-a8d7802b15b2 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:31:34.736127 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d37ec98-88af-4e6d-8806-5e74fd8e0f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:31:34.736789 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37ec98-88af-4e6d-8806-5e74fd8e0f69 admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:31:34.737073 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37ec98-88af-4e6d-8806-5e74fd8e0f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:31:34.737350 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37ec98-88af-4e6d-8806-5e74fd8e0f69 admin admin] PATH_INFO: `/v3/users` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:31:34.738039 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d37ec98-88af-4e6d-8806-5e74fd8e0f69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:31:34.740117 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d37ec98-88af-4e6d-8806-5e74fd8e0f69 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:31:34.760247 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1187/2383] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:31:34 2022] POST /identity/v3/users => generated 295 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:31:34.765071 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b0d191-cbcd-4da7-b657-bba342ff275b admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:31:34.775330 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b0d191-cbcd-4da7-b657-bba342ff275b admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:31:34.780065 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e904e6cb-a4f5-4b1d-9973-9e3c6f7022c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:31:34.780717 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904e6cb-a4f5-4b1d-9973-9e3c6f7022c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:31:34.781006 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904e6cb-a4f5-4b1d-9973-9e3c6f7022c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:31:34.781554 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904e6cb-a4f5-4b1d-9973-9e3c6f7022c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:31:34.782277 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e904e6cb-a4f5-4b1d-9973-9e3c6f7022c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:31:34.783921 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e904e6cb-a4f5-4b1d-9973-9e3c6f7022c5 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:31:34.794013 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1197/2384] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:31:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:31:34.797888 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d37ec98-88af-4e6d-8806-5e74fd8e0f69 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:31:34.807490 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d37ec98-88af-4e6d-8806-5e74fd8e0f69 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:31:34.812651 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4c53d2-0257-4245-821e-f73019d34c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:31:34.813294 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c53d2-0257-4245-821e-f73019d34c52 admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:31:34.813576 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c53d2-0257-4245-821e-f73019d34c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:31:34.813850 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c53d2-0257-4245-821e-f73019d34c52 admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:31:34.814572 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4c53d2-0257-4245-821e-f73019d34c52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:31:34.816183 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4c53d2-0257-4245-821e-f73019d34c52 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:31:34.826354 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1188/2385] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:31:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:31:34.830581 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e904e6cb-a4f5-4b1d-9973-9e3c6f7022c5 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:31:34.840979 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e904e6cb-a4f5-4b1d-9973-9e3c6f7022c5 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:31:34.845651 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cd40c5-8d0a-440e-839d-b3b5372e4322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:31:34.846546 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd40c5-8d0a-440e-839d-b3b5372e4322 admin admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:31:34.846850 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd40c5-8d0a-440e-839d-b3b5372e4322 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:31:34.847130 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd40c5-8d0a-440e-839d-b3b5372e4322 admin admin] PATH_INFO: `/v3/projects/6010b5e8a97f43db995cb50585c24474/users/e987474b063c45d3aa943351a88afa04/roles/7185d0cfbcd44502b1613bcfe1b42f6f` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:31:34.862936 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cd40c5-8d0a-440e-839d-b3b5372e4322 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6010b5e8a97f43db995cb50585c24474, user_id=e987474b063c45d3aa943351a88afa04, role_id=7185d0cfbcd44502b1613bcfe1b42f6f)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:31:34.865588 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cd40c5-8d0a-440e-839d-b3b5372e4322 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:31:34.879923 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1198/2386] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:31:34 2022] PUT /identity/v3/projects/6010b5e8a97f43db995cb50585c24474/users/e987474b063c45d3aa943351a88afa04/roles/7185d0cfbcd44502b1613bcfe1b42f6f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:31:34.890945 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c391a9ea-f0c9-43fe-8d0a-47a35c058387 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:31:34.891465 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c391a9ea-f0c9-43fe-8d0a-47a35c058387 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:31:34.891561 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c391a9ea-f0c9-43fe-8d0a-47a35c058387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:31:34.917180 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-c391a9ea-f0c9-43fe-8d0a-47a35c058387 None None] MFA Rules not processed for user `e987474b063c45d3aa943351a88afa04`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:31:34.918355 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-c391a9ea-f0c9-43fe-8d0a-47a35c058387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:31:34.981015 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1189/2387] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:31:34 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:31:34.991829 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cd40c5-8d0a-440e-839d-b3b5372e4322 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:31:34.993714 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-01cd40c5-8d0a-440e-839d-b3b5372e4322 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:31:35.049367 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cd40c5-8d0a-440e-839d-b3b5372e4322 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:31:35.053063 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5932d4-4f54-46a4-b6fa-1f0b1030849a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45219f386f0147b6bd380efe4ab62812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:31:35.053703 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5932d4-4f54-46a4-b6fa-1f0b1030849a service cinder] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:31:35.053989 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5932d4-4f54-46a4-b6fa-1f0b1030849a service cinder] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:31:35.054274 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5932d4-4f54-46a4-b6fa-1f0b1030849a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:31:35.063276 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5932d4-4f54-46a4-b6fa-1f0b1030849a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:31:35.064719 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5932d4-4f54-46a4-b6fa-1f0b1030849a service cinder] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:31:35.073326 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1199/2388] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:31:34 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:32:04.533428 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c391a9ea-f0c9-43fe-8d0a-47a35c058387 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:32:04.599314 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c391a9ea-f0c9-43fe-8d0a-47a35c058387 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:32:04.604026 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351bd75b-8655-4ca1-b15e-bbfbe9ad35a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:32:04.604877 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351bd75b-8655-4ca1-b15e-bbfbe9ad35a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:32:04.605157 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351bd75b-8655-4ca1-b15e-bbfbe9ad35a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:32:04.605429 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351bd75b-8655-4ca1-b15e-bbfbe9ad35a1 admin admin] PATH_INFO: `/v3/users/e987474b063c45d3aa943351a88afa04` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:32:04.606662 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351bd75b-8655-4ca1-b15e-bbfbe9ad35a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e987474b063c45d3aa943351a88afa04)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:32:04.609104 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351bd75b-8655-4ca1-b15e-bbfbe9ad35a1 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:32:04.655649 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-351bd75b-8655-4ca1-b15e-bbfbe9ad35a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e987474b063c45d3aa943351a88afa04'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:32:04.667459 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-351bd75b-8655-4ca1-b15e-bbfbe9ad35a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e987474b063c45d3aa943351a88afa04'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:32:04.674342 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-351bd75b-8655-4ca1-b15e-bbfbe9ad35a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e987474b063c45d3aa943351a88afa04'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:32:04.674965 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-351bd75b-8655-4ca1-b15e-bbfbe9ad35a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e987474b063c45d3aa943351a88afa04'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:32:04.681907 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-351bd75b-8655-4ca1-b15e-bbfbe9ad35a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e987474b063c45d3aa943351a88afa04'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:32:04.688718 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1190/2389] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:32:04 2022] DELETE /identity/v3/users/e987474b063c45d3aa943351a88afa04 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:32:04.693104 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aac29e-75fc-47b7-8e57-0cb483f2f8bc None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:32:04.694055 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aac29e-75fc-47b7-8e57-0cb483f2f8bc None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:32:04.694413 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aac29e-75fc-47b7-8e57-0cb483f2f8bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:32:04.712992 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-81aac29e-75fc-47b7-8e57-0cb483f2f8bc None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:32:04.714192 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-81aac29e-75fc-47b7-8e57-0cb483f2f8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:32:04.771509 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1200/2390] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:32:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:32:04.782015 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351bd75b-8655-4ca1-b15e-bbfbe9ad35a1 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:32:04.783488 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-351bd75b-8655-4ca1-b15e-bbfbe9ad35a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:32:04.838474 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351bd75b-8655-4ca1-b15e-bbfbe9ad35a1 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:32:04.842483 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9c5f06-7d6d-4211-a454-1db504bdf038 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:32:04.843182 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c5f06-7d6d-4211-a454-1db504bdf038 service neutron] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:32:04.843460 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c5f06-7d6d-4211-a454-1db504bdf038 service neutron] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:32:04.843731 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c5f06-7d6d-4211-a454-1db504bdf038 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:32:04.852431 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9c5f06-7d6d-4211-a454-1db504bdf038 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:32:04.853841 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9c5f06-7d6d-4211-a454-1db504bdf038 service neutron] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:32:04.863740 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1191/2391] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:32:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:32:05.114544 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aac29e-75fc-47b7-8e57-0cb483f2f8bc None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:32:05.116163 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-81aac29e-75fc-47b7-8e57-0cb483f2f8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:32:05.133327 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aac29e-75fc-47b7-8e57-0cb483f2f8bc None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:32:05.137979 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc8f594-c6c5-40b9-9237-8efbef08828a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:32:05.139518 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc8f594-c6c5-40b9-9237-8efbef08828a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:32:05.139879 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc8f594-c6c5-40b9-9237-8efbef08828a admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:32:05.140155 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc8f594-c6c5-40b9-9237-8efbef08828a admin admin] PATH_INFO: `/v3/projects/6010b5e8a97f43db995cb50585c24474` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:32:05.141362 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc8f594-c6c5-40b9-9237-8efbef08828a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6010b5e8a97f43db995cb50585c24474)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:32:05.143321 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc8f594-c6c5-40b9-9237-8efbef08828a admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:32:05.192964 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-2dc8f594-c6c5-40b9-9237-8efbef08828a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6010b5e8a97f43db995cb50585c24474', 'request_id': 'req-2dc8f594-c6c5-40b9-9237-8efbef08828a'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:32:05.198536 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-2dc8f594-c6c5-40b9-9237-8efbef08828a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6010b5e8a97f43db995cb50585c24474', 'request_id': 'req-2dc8f594-c6c5-40b9-9237-8efbef08828a'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:32:05.206404 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-2dc8f594-c6c5-40b9-9237-8efbef08828a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6010b5e8a97f43db995cb50585c24474', 'request_id': 'req-2dc8f594-c6c5-40b9-9237-8efbef08828a'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:32:05.218145 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-2dc8f594-c6c5-40b9-9237-8efbef08828a admin admin] The token cache is being invalidate because project 6010b5e8a97f43db995cb50585c24474 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:32:05.218437 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-2dc8f594-c6c5-40b9-9237-8efbef08828a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:32:05.219079 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-2dc8f594-c6c5-40b9-9237-8efbef08828a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:32:05.220624 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1201/2392] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:32:05 2022] DELETE /identity/v3/projects/6010b5e8a97f43db995cb50585c24474 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:32:05.447744 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9c5f06-7d6d-4211-a454-1db504bdf038 service neutron] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:32:05.449143 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-0c9c5f06-7d6d-4211-a454-1db504bdf038 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:32:05.462330 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9c5f06-7d6d-4211-a454-1db504bdf038 service neutron] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:32:05.519499 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda2f9fa-5067-4c73-b537-25c309174eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:32:05.520368 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda2f9fa-5067-4c73-b537-25c309174eea admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:32:05.520649 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda2f9fa-5067-4c73-b537-25c309174eea admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:32:05.520924 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda2f9fa-5067-4c73-b537-25c309174eea admin admin] PATH_INFO: `/v3/users/23a63cf4cdf24b2a9d30d570d3a3c725` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:32:05.522127 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda2f9fa-5067-4c73-b537-25c309174eea admin admin] RBAC: Authorizing `identity:delete_user(user_id=23a63cf4cdf24b2a9d30d570d3a3c725)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:32:05.524150 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda2f9fa-5067-4c73-b537-25c309174eea admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:32:05.571929 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-dda2f9fa-5067-4c73-b537-25c309174eea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23a63cf4cdf24b2a9d30d570d3a3c725'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:32:05.583559 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-dda2f9fa-5067-4c73-b537-25c309174eea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23a63cf4cdf24b2a9d30d570d3a3c725'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:32:05.590910 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-dda2f9fa-5067-4c73-b537-25c309174eea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23a63cf4cdf24b2a9d30d570d3a3c725'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:32:05.592035 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-dda2f9fa-5067-4c73-b537-25c309174eea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23a63cf4cdf24b2a9d30d570d3a3c725'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:32:05.599069 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-dda2f9fa-5067-4c73-b537-25c309174eea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23a63cf4cdf24b2a9d30d570d3a3c725'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:32:05.609308 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1192/2393] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:32:05 2022] DELETE /identity/v3/users/23a63cf4cdf24b2a9d30d570d3a3c725 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:32:05.610304 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63600d4d-7a28-438f-825e-0b0695453905 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:32:05.610590 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63600d4d-7a28-438f-825e-0b0695453905 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:32:05.610920 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63600d4d-7a28-438f-825e-0b0695453905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:32:05.633459 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-63600d4d-7a28-438f-825e-0b0695453905 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:32:05.634741 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-63600d4d-7a28-438f-825e-0b0695453905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:32:05.696639 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1202/2394] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:32:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 01:32:05.703519 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda2f9fa-5067-4c73-b537-25c309174eea admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:32:05.705036 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-dda2f9fa-5067-4c73-b537-25c309174eea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:32:05.763968 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda2f9fa-5067-4c73-b537-25c309174eea admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:32:05.767579 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97765d3-3587-45c2-b0d0-3cb765a8ab74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:32:05.768217 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97765d3-3587-45c2-b0d0-3cb765a8ab74 service neutron] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:32:05.768498 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97765d3-3587-45c2-b0d0-3cb765a8ab74 service neutron] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:32:05.768776 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97765d3-3587-45c2-b0d0-3cb765a8ab74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:32:05.778689 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97765d3-3587-45c2-b0d0-3cb765a8ab74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:32:05.780789 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97765d3-3587-45c2-b0d0-3cb765a8ab74 service neutron] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:32:05.790790 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1193/2395] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:32:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:32:06.157620 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63600d4d-7a28-438f-825e-0b0695453905 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:32:06.159374 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-63600d4d-7a28-438f-825e-0b0695453905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:32:06.180588 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63600d4d-7a28-438f-825e-0b0695453905 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:32:06.188120 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89340546-086b-4819-be52-8853383900fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:32:06.189219 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89340546-086b-4819-be52-8853383900fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:32:06.189632 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89340546-086b-4819-be52-8853383900fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:32:06.190435 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89340546-086b-4819-be52-8853383900fb admin admin] PATH_INFO: `/v3/projects/8373f3f3a2ef45aca0b065ad16ac0761` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:32:06.192121 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89340546-086b-4819-be52-8853383900fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=8373f3f3a2ef45aca0b065ad16ac0761)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:32:06.194026 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89340546-086b-4819-be52-8853383900fb admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:32:06.241952 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-89340546-086b-4819-be52-8853383900fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8373f3f3a2ef45aca0b065ad16ac0761', 'request_id': 'req-89340546-086b-4819-be52-8853383900fb'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:32:06.243773 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97765d3-3587-45c2-b0d0-3cb765a8ab74 service neutron] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:32:06.245318 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-e97765d3-3587-45c2-b0d0-3cb765a8ab74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:32:06.247447 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-89340546-086b-4819-be52-8853383900fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8373f3f3a2ef45aca0b065ad16ac0761', 'request_id': 'req-89340546-086b-4819-be52-8853383900fb'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:32:06.255224 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-89340546-086b-4819-be52-8853383900fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8373f3f3a2ef45aca0b065ad16ac0761', 'request_id': 'req-89340546-086b-4819-be52-8853383900fb'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:32:06.267206 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-89340546-086b-4819-be52-8853383900fb admin admin] The token cache is being invalidate because project 8373f3f3a2ef45aca0b065ad16ac0761 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:32:06.267492 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-89340546-086b-4819-be52-8853383900fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:32:06.268110 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-89340546-086b-4819-be52-8853383900fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:32:06.269683 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1203/2396] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:32:06 2022] DELETE /identity/v3/projects/8373f3f3a2ef45aca0b065ad16ac0761 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:32:06.274283 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba66a5-c862-47a6-9fd0-64f2b936b87b None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:32:06.274576 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba66a5-c862-47a6-9fd0-64f2b936b87b None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:32:06.274904 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba66a5-c862-47a6-9fd0-64f2b936b87b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:32:06.293611 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-d1ba66a5-c862-47a6-9fd0-64f2b936b87b None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:32:06.295095 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-d1ba66a5-c862-47a6-9fd0-64f2b936b87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:32:06.339599 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97765d3-3587-45c2-b0d0-3cb765a8ab74 service neutron] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:32:06.352722 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1204/2397] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:32:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 01:32:06.360616 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760efb2-bae1-4b3d-8a9d-d83b00926a81 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:32:06.360912 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760efb2-bae1-4b3d-8a9d-d83b00926a81 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:32:06.361198 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760efb2-bae1-4b3d-8a9d-d83b00926a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:32:06.379256 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-8760efb2-bae1-4b3d-8a9d-d83b00926a81 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:32:06.380467 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-8760efb2-bae1-4b3d-8a9d-d83b00926a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:32:06.388416 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1205/2398] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:32:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 01:32:06.392392 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8760efb2-bae1-4b3d-8a9d-d83b00926a81 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:32:06.397001 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1ba7d1-06c6-4787-9042-e8937f1af058 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7343cd5457264dabb4c2b3a62df59431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:32:06.397650 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ba7d1-06c6-4787-9042-e8937f1af058 service placement] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:32:06.397931 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ba7d1-06c6-4787-9042-e8937f1af058 service placement] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:32:06.398205 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ba7d1-06c6-4787-9042-e8937f1af058 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:32:06.400089 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-1d1ba7d1-06c6-4787-9042-e8937f1af058 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:32:06.401073 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8760efb2-bae1-4b3d-8a9d-d83b00926a81 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:32:06.406613 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6501592f-744f-455b-af86-84e28a4c095e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:32:06.407274 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501592f-744f-455b-af86-84e28a4c095e admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:32:06.407559 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501592f-744f-455b-af86-84e28a4c095e admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:32:06.407852 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501592f-744f-455b-af86-84e28a4c095e admin admin] PATH_INFO: `/v3/domains` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:32:06.408567 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6501592f-744f-455b-af86-84e28a4c095e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:32:06.408874 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6501592f-744f-455b-af86-84e28a4c095e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:32:06.410476 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6501592f-744f-455b-af86-84e28a4c095e admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:32:06.411766 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1ba7d1-06c6-4787-9042-e8937f1af058 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:32:06.413313 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1ba7d1-06c6-4787-9042-e8937f1af058 service placement] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:32:06.424329 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1206/2399] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Mar 30 01:32:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:32:06.424512 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1194/2400] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:32:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 30 01:32:06.426122 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6501592f-744f-455b-af86-84e28a4c095e admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:32:06.436155 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6501592f-744f-455b-af86-84e28a4c095e admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:32:06.440801 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5fa99a-5a2d-49bc-960d-97c859a9f6e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:32:06.441425 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5fa99a-5a2d-49bc-960d-97c859a9f6e4 admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:32:06.441798 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5fa99a-5a2d-49bc-960d-97c859a9f6e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:32:06.441966 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5fa99a-5a2d-49bc-960d-97c859a9f6e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:32:06.442806 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5fa99a-5a2d-49bc-960d-97c859a9f6e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:32:06.444729 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5fa99a-5a2d-49bc-960d-97c859a9f6e4 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:32:06.471336 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1207/2401] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:32:06 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 01:32:06.475372 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1ba7d1-06c6-4787-9042-e8937f1af058 service placement] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:32:06.486363 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1ba7d1-06c6-4787-9042-e8937f1af058 service placement] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:32:06.543029 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e65608-9c55-4945-80ad-69a16817e20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:32:06.543702 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e65608-9c55-4945-80ad-69a16817e20e admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:32:06.543985 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e65608-9c55-4945-80ad-69a16817e20e admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:32:06.544258 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e65608-9c55-4945-80ad-69a16817e20e admin admin] PATH_INFO: `/v3/users` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:32:06.545654 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e65608-9c55-4945-80ad-69a16817e20e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:32:06.549123 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e65608-9c55-4945-80ad-69a16817e20e admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:32:06.567523 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1195/2402] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:32:06 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:32:06.571507 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5fa99a-5a2d-49bc-960d-97c859a9f6e4 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:32:06.581946 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5fa99a-5a2d-49bc-960d-97c859a9f6e4 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:32:06.586516 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a859ff-56a3-42b2-a004-e0e668c58df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:32:06.587198 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a859ff-56a3-42b2-a004-e0e668c58df4 admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:32:06.587485 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a859ff-56a3-42b2-a004-e0e668c58df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:32:06.587760 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a859ff-56a3-42b2-a004-e0e668c58df4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:32:06.588513 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a859ff-56a3-42b2-a004-e0e668c58df4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:32:06.590106 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a859ff-56a3-42b2-a004-e0e668c58df4 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:32:06.599793 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1208/2403] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:32:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:32:06.603569 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e65608-9c55-4945-80ad-69a16817e20e admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:32:06.614480 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e65608-9c55-4945-80ad-69a16817e20e admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:32:06.622418 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f5a71b-211c-4cae-9628-88dbee54c1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:32:06.623743 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f5a71b-211c-4cae-9628-88dbee54c1ec admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:32:06.624032 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f5a71b-211c-4cae-9628-88dbee54c1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:32:06.624310 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f5a71b-211c-4cae-9628-88dbee54c1ec admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:32:06.625083 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f5a71b-211c-4cae-9628-88dbee54c1ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:32:06.626685 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f5a71b-211c-4cae-9628-88dbee54c1ec admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:32:06.639847 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1196/2404] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:32:06 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:32:06.644117 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a859ff-56a3-42b2-a004-e0e668c58df4 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:32:06.653989 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a859ff-56a3-42b2-a004-e0e668c58df4 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:32:06.659154 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d7270a-661d-4285-a281-2e4d47f629e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:32:06.660036 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d7270a-661d-4285-a281-2e4d47f629e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:32:06.660322 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d7270a-661d-4285-a281-2e4d47f629e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:32:06.660601 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d7270a-661d-4285-a281-2e4d47f629e0 admin admin] PATH_INFO: `/v3/projects/256d574808e54c9aa1a0242cd5983675/users/7b027a3d344845dca12c585560b50519/roles/7185d0cfbcd44502b1613bcfe1b42f6f` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:32:06.676219 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d7270a-661d-4285-a281-2e4d47f629e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=256d574808e54c9aa1a0242cd5983675, user_id=7b027a3d344845dca12c585560b50519, role_id=7185d0cfbcd44502b1613bcfe1b42f6f)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:32:06.678910 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d7270a-661d-4285-a281-2e4d47f629e0 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:32:06.692075 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1209/2405] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:32:06 2022] PUT /identity/v3/projects/256d574808e54c9aa1a0242cd5983675/users/7b027a3d344845dca12c585560b50519/roles/7185d0cfbcd44502b1613bcfe1b42f6f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:32:06.697065 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0521a1-5706-4efd-bda2-c388bf584a25 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:32:06.697356 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0521a1-5706-4efd-bda2-c388bf584a25 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:32:06.697634 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0521a1-5706-4efd-bda2-c388bf584a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:32:06.715179 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-bb0521a1-5706-4efd-bda2-c388bf584a25 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:32:06.716384 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-bb0521a1-5706-4efd-bda2-c388bf584a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:32:06.774546 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1197/2406] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:32:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:32:06.784484 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d7270a-661d-4285-a281-2e4d47f629e0 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:32:06.786175 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-25d7270a-661d-4285-a281-2e4d47f629e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:32:06.843195 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d7270a-661d-4285-a281-2e4d47f629e0 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:32:06.846971 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b164ec44-c5aa-4708-a2f1-efaab54a2afc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:32:06.847622 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b164ec44-c5aa-4708-a2f1-efaab54a2afc service neutron] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:32:06.847908 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b164ec44-c5aa-4708-a2f1-efaab54a2afc service neutron] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:32:06.848186 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b164ec44-c5aa-4708-a2f1-efaab54a2afc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:32:06.858598 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b164ec44-c5aa-4708-a2f1-efaab54a2afc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:32:06.860143 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b164ec44-c5aa-4708-a2f1-efaab54a2afc service neutron] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:32:06.869553 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1210/2407] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:32:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:32:11.099358 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e067ff3-15b7-45c6-987a-eeb7b495823c None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:32:11.099915 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e067ff3-15b7-45c6-987a-eeb7b495823c None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:32:11.099915 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e067ff3-15b7-45c6-987a-eeb7b495823c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:32:11.130213 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-5e067ff3-15b7-45c6-987a-eeb7b495823c None None] MFA Rules not processed for user `7b027a3d344845dca12c585560b50519`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:32:11.131477 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-5e067ff3-15b7-45c6-987a-eeb7b495823c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:32:11.204089 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1198/2408] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:32:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:32:11.208567 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b164ec44-c5aa-4708-a2f1-efaab54a2afc service neutron] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:32:11.218775 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b164ec44-c5aa-4708-a2f1-efaab54a2afc service neutron] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:32:11.224262 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1838f0ab-fdf7-4158-b77e-95a4b501736e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:32:11.224928 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838f0ab-fdf7-4158-b77e-95a4b501736e admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:32:11.225209 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838f0ab-fdf7-4158-b77e-95a4b501736e admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:32:11.225483 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838f0ab-fdf7-4158-b77e-95a4b501736e admin admin] PATH_INFO: `/v3/projects` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:32:11.226176 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1838f0ab-fdf7-4158-b77e-95a4b501736e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:32:11.228132 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1838f0ab-fdf7-4158-b77e-95a4b501736e admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:32:11.256368 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1211/2409] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:32:11 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:32:11.260556 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e067ff3-15b7-45c6-987a-eeb7b495823c None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:32:11.272140 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e067ff3-15b7-45c6-987a-eeb7b495823c None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:32:11.330135 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb19165-78a8-4fbf-b641-95f9607f040f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:32:11.330934 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb19165-78a8-4fbf-b641-95f9607f040f admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:32:11.331286 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb19165-78a8-4fbf-b641-95f9607f040f admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:32:11.331628 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb19165-78a8-4fbf-b641-95f9607f040f admin admin] PATH_INFO: `/v3/users` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:32:11.332674 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb19165-78a8-4fbf-b641-95f9607f040f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:32:11.334481 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb19165-78a8-4fbf-b641-95f9607f040f admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:32:11.355628 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1199/2410] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:32:11 2022] POST /identity/v3/users => generated 299 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:32:11.359679 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1838f0ab-fdf7-4158-b77e-95a4b501736e admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:32:11.369986 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1838f0ab-fdf7-4158-b77e-95a4b501736e admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:32:11.375095 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c507d84c-65f8-480c-94ab-012bac6f1f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:32:11.375766 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507d84c-65f8-480c-94ab-012bac6f1f64 admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:32:11.376067 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507d84c-65f8-480c-94ab-012bac6f1f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:32:11.376343 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507d84c-65f8-480c-94ab-012bac6f1f64 admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:32:11.377065 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c507d84c-65f8-480c-94ab-012bac6f1f64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:32:11.378689 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c507d84c-65f8-480c-94ab-012bac6f1f64 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:32:11.389702 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1212/2411] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:32:11.393949 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb19165-78a8-4fbf-b641-95f9607f040f admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:32:11.404619 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb19165-78a8-4fbf-b641-95f9607f040f admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:32:11.409737 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab57ce-4480-41ea-aeac-2e748b0bfca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:32:11.410610 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab57ce-4480-41ea-aeac-2e748b0bfca8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:32:11.410942 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab57ce-4480-41ea-aeac-2e748b0bfca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:32:11.411219 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab57ce-4480-41ea-aeac-2e748b0bfca8 admin admin] PATH_INFO: `/v3/projects/86aead422c4f473fb3de442a0f6f6310/users/c801bad569f54c9b8876e0a96c9a9061/roles/36909bbf31d04993bb2a9fe587b572dc` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:32:11.425753 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ab57ce-4480-41ea-aeac-2e748b0bfca8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86aead422c4f473fb3de442a0f6f6310, user_id=c801bad569f54c9b8876e0a96c9a9061, role_id=36909bbf31d04993bb2a9fe587b572dc)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:32:11.428486 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ab57ce-4480-41ea-aeac-2e748b0bfca8 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:32:11.445845 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1200/2412] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:32:11 2022] PUT /identity/v3/projects/86aead422c4f473fb3de442a0f6f6310/users/c801bad569f54c9b8876e0a96c9a9061/roles/36909bbf31d04993bb2a9fe587b572dc => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:32:11.449784 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c507d84c-65f8-480c-94ab-012bac6f1f64 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:32:11.460219 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c507d84c-65f8-480c-94ab-012bac6f1f64 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:32:11.515178 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f3f320-a639-41a5-96b2-eab05962eb1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:32:11.515855 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f3f320-a639-41a5-96b2-eab05962eb1c admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:32:11.516133 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f3f320-a639-41a5-96b2-eab05962eb1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:32:11.516402 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f3f320-a639-41a5-96b2-eab05962eb1c admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:32:11.517122 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f3f320-a639-41a5-96b2-eab05962eb1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:32:11.518736 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f3f320-a639-41a5-96b2-eab05962eb1c admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:32:11.529756 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1213/2413] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:32:11.534081 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab57ce-4480-41ea-aeac-2e748b0bfca8 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:32:11.545095 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab57ce-4480-41ea-aeac-2e748b0bfca8 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:32:11.549751 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fd4657-e1cd-4f05-a335-87b3c2d45081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:32:11.550619 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd4657-e1cd-4f05-a335-87b3c2d45081 admin admin] REQUEST_METHOD: `PUT` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:32:11.550957 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd4657-e1cd-4f05-a335-87b3c2d45081 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:32:11.551236 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd4657-e1cd-4f05-a335-87b3c2d45081 admin admin] PATH_INFO: `/v3/projects/86aead422c4f473fb3de442a0f6f6310/users/c801bad569f54c9b8876e0a96c9a9061/roles/36909bbf31d04993bb2a9fe587b572dc` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:32:11.553206 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fd4657-e1cd-4f05-a335-87b3c2d45081 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86aead422c4f473fb3de442a0f6f6310, user_id=c801bad569f54c9b8876e0a96c9a9061, role_id=36909bbf31d04993bb2a9fe587b572dc)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:32:11.555882 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fd4657-e1cd-4f05-a335-87b3c2d45081 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:32:11.566288 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1201/2414] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:32:11 2022] PUT /identity/v3/projects/86aead422c4f473fb3de442a0f6f6310/users/c801bad569f54c9b8876e0a96c9a9061/roles/36909bbf31d04993bb2a9fe587b572dc => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:32:16.669311 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf8c12-c0cb-4e44-b29b-d2ab85ae0719 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:32:16.669796 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf8c12-c0cb-4e44-b29b-d2ab85ae0719 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:32:16.669879 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf8c12-c0cb-4e44-b29b-d2ab85ae0719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:32:16.707654 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-10bf8c12-c0cb-4e44-b29b-d2ab85ae0719 None None] MFA Rules not processed for user `c801bad569f54c9b8876e0a96c9a9061`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:32:16.708717 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-10bf8c12-c0cb-4e44-b29b-d2ab85ae0719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:32:16.791051 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1214/2415] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:32:16 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:32:16.803553 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fd4657-e1cd-4f05-a335-87b3c2d45081 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:32:16.805874 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-80fd4657-e1cd-4f05-a335-87b3c2d45081 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:32:16.890938 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fd4657-e1cd-4f05-a335-87b3c2d45081 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:32:16.894786 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c25f31-0c87-483d-aaf0-d303b078e95d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf28c0ec3d94fb99bcd573dd8dd0e30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:32:16.895638 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c25f31-0c87-483d-aaf0-d303b078e95d service glance] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:32:16.896071 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c25f31-0c87-483d-aaf0-d303b078e95d service glance] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:32:16.896349 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c25f31-0c87-483d-aaf0-d303b078e95d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:32:16.960998 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c25f31-0c87-483d-aaf0-d303b078e95d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:32:16.962487 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c25f31-0c87-483d-aaf0-d303b078e95d service glance] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:32:16.972648 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1202/2416] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:32:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:32:17.084729 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f1a78c-af57-4553-b027-55b5d016c548 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:32:17.085227 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f1a78c-af57-4553-b027-55b5d016c548 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:32:17.085513 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f1a78c-af57-4553-b027-55b5d016c548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:32:17.146219 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-e5f1a78c-af57-4553-b027-55b5d016c548 None None] MFA Rules not processed for user `0503fdca7f834ef0a81422804dc74812`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:32:17.147500 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-e5f1a78c-af57-4553-b027-55b5d016c548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:32:17.225301 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1215/2417] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Mar 30 01:32:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:32:17.241892 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c25f31-0c87-483d-aaf0-d303b078e95d service glance] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:32:17.243419 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-59c25f31-0c87-483d-aaf0-d303b078e95d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:32:17.331347 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c25f31-0c87-483d-aaf0-d303b078e95d service glance] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:32:17.336487 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e58a38-c980-4ca9-a575-6ab2f301602c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f16de81dfb4c14b027cd6cd1e6ff2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:32:17.337060 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e58a38-c980-4ca9-a575-6ab2f301602c service swift] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:32:17.337340 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e58a38-c980-4ca9-a575-6ab2f301602c service swift] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:32:17.337611 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e58a38-c980-4ca9-a575-6ab2f301602c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:32:17.346096 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e58a38-c980-4ca9-a575-6ab2f301602c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:32:17.347675 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e58a38-c980-4ca9-a575-6ab2f301602c service swift] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:32:17.355357 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1203/2418] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Mar 30 01:32:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 30 01:32:26.591683 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4605b8-4b32-413c-bba0-f936039f8017 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:32:26.592187 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4605b8-4b32-413c-bba0-f936039f8017 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:32:26.592396 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4605b8-4b32-413c-bba0-f936039f8017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:32:26.609893 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-7a4605b8-4b32-413c-bba0-f936039f8017 None None] MFA Rules not processed for user `7b027a3d344845dca12c585560b50519`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:32:26.611131 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-7a4605b8-4b32-413c-bba0-f936039f8017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:32:26.618477 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1216/2419] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:32:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:32:28.382102 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed09a6-6085-498b-b8ca-501ec3e375ef None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:32:28.382590 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed09a6-6085-498b-b8ca-501ec3e375ef None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:32:28.382683 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed09a6-6085-498b-b8ca-501ec3e375ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:32:28.401494 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-cfed09a6-6085-498b-b8ca-501ec3e375ef None None] MFA Rules not processed for user `0503fdca7f834ef0a81422804dc74812`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:32:28.402751 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-cfed09a6-6085-498b-b8ca-501ec3e375ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:32:28.411501 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1204/2420] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Mar 30 01:32:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:32:28.423799 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4605b8-4b32-413c-bba0-f936039f8017 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:32:28.436607 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4605b8-4b32-413c-bba0-f936039f8017 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:32:28.440616 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275533d6-237d-4de6-82c5-eff7bc50dc7a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f16de81dfb4c14b027cd6cd1e6ff2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:32:28.441292 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275533d6-237d-4de6-82c5-eff7bc50dc7a service swift] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:32:28.441575 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275533d6-237d-4de6-82c5-eff7bc50dc7a service swift] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:32:28.441849 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275533d6-237d-4de6-82c5-eff7bc50dc7a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:32:28.450833 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275533d6-237d-4de6-82c5-eff7bc50dc7a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:32:28.452739 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275533d6-237d-4de6-82c5-eff7bc50dc7a service swift] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:32:28.461536 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1217/2421] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Mar 30 01:32:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Mar 30 01:32:31.890821 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfed09a6-6085-498b-b8ca-501ec3e375ef None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:32:31.893241 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-cfed09a6-6085-498b-b8ca-501ec3e375ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:32:31.999578 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfed09a6-6085-498b-b8ca-501ec3e375ef None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:32:32.007828 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca5f45c-976c-4262-b9f0-e5dd43c644e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:32:32.008974 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5f45c-976c-4262-b9f0-e5dd43c644e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:32:32.009262 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5f45c-976c-4262-b9f0-e5dd43c644e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:32:32.010732 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5f45c-976c-4262-b9f0-e5dd43c644e7 admin admin] PATH_INFO: `/v3/users/6d93afdf3a67428e8b712c00ca84277b` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:32:32.012092 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca5f45c-976c-4262-b9f0-e5dd43c644e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d93afdf3a67428e8b712c00ca84277b)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:32:32.014816 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca5f45c-976c-4262-b9f0-e5dd43c644e7 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:32:32.100195 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-0ca5f45c-976c-4262-b9f0-e5dd43c644e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d93afdf3a67428e8b712c00ca84277b'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:32:32.114522 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-0ca5f45c-976c-4262-b9f0-e5dd43c644e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d93afdf3a67428e8b712c00ca84277b'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:32:32.124448 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-0ca5f45c-976c-4262-b9f0-e5dd43c644e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d93afdf3a67428e8b712c00ca84277b'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:32:32.125175 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-0ca5f45c-976c-4262-b9f0-e5dd43c644e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d93afdf3a67428e8b712c00ca84277b'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:32:32.133649 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-0ca5f45c-976c-4262-b9f0-e5dd43c644e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d93afdf3a67428e8b712c00ca84277b'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:32:32.155620 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1205/2422] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:32:31 2022] DELETE /identity/v3/users/6d93afdf3a67428e8b712c00ca84277b => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:32:32.441126 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275533d6-237d-4de6-82c5-eff7bc50dc7a service swift] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:32:32.459640 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275533d6-237d-4de6-82c5-eff7bc50dc7a service swift] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:32:32.520125 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f92115-2df5-4cfc-9318-084bba23cd3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:32:32.521016 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f92115-2df5-4cfc-9318-084bba23cd3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:32:32.521300 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f92115-2df5-4cfc-9318-084bba23cd3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:32:32.521582 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f92115-2df5-4cfc-9318-084bba23cd3f admin admin] PATH_INFO: `/v3/projects/3c5f5559501e4265ace8a4c9b0914eb7` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:32:32.526486 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f92115-2df5-4cfc-9318-084bba23cd3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c5f5559501e4265ace8a4c9b0914eb7)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:32:32.529123 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f92115-2df5-4cfc-9318-084bba23cd3f admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:32:32.584816 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-e0f92115-2df5-4cfc-9318-084bba23cd3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c5f5559501e4265ace8a4c9b0914eb7', 'request_id': 'req-e0f92115-2df5-4cfc-9318-084bba23cd3f'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:32:32.590085 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-e0f92115-2df5-4cfc-9318-084bba23cd3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c5f5559501e4265ace8a4c9b0914eb7', 'request_id': 'req-e0f92115-2df5-4cfc-9318-084bba23cd3f'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:32:32.601608 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-e0f92115-2df5-4cfc-9318-084bba23cd3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c5f5559501e4265ace8a4c9b0914eb7', 'request_id': 'req-e0f92115-2df5-4cfc-9318-084bba23cd3f'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:32:32.615158 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-e0f92115-2df5-4cfc-9318-084bba23cd3f admin admin] The token cache is being invalidate because project 3c5f5559501e4265ace8a4c9b0914eb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:32:32.615480 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-e0f92115-2df5-4cfc-9318-084bba23cd3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:32:32.616114 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-e0f92115-2df5-4cfc-9318-084bba23cd3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:32:32.617691 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1218/2423] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:32:32 2022] DELETE /identity/v3/projects/3c5f5559501e4265ace8a4c9b0914eb7 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:32:45.891744 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070fab39-4ecc-4cf3-8309-a8212cf2a8cf None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:32:45.892976 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070fab39-4ecc-4cf3-8309-a8212cf2a8cf None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:32:45.893419 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070fab39-4ecc-4cf3-8309-a8212cf2a8cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:32:45.921642 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-070fab39-4ecc-4cf3-8309-a8212cf2a8cf None None] MFA Rules not processed for user `4a2bf75cc4e3465987b8450318708b49`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:32:45.923172 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-070fab39-4ecc-4cf3-8309-a8212cf2a8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:32:46.007231 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1206/2424] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:32:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:32:56.209682 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f92115-2df5-4cfc-9318-084bba23cd3f admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:32:56.211157 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-e0f92115-2df5-4cfc-9318-084bba23cd3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:32:56.271380 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f92115-2df5-4cfc-9318-084bba23cd3f admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:32:56.274947 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01153f57-842f-428b-a8c1-34d35bb64ea6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:32:56.275591 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01153f57-842f-428b-a8c1-34d35bb64ea6 service neutron] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:32:56.275870 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01153f57-842f-428b-a8c1-34d35bb64ea6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:32:56.276143 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01153f57-842f-428b-a8c1-34d35bb64ea6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:32:56.278020 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-01153f57-842f-428b-a8c1-34d35bb64ea6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:32:56.338564 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01153f57-842f-428b-a8c1-34d35bb64ea6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:32:56.340499 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01153f57-842f-428b-a8c1-34d35bb64ea6 service neutron] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:32:56.349814 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1219/2425] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:32:56 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:32:56.704299 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2fafa-9921-4032-9b0c-c787915e62a3 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:32:56.704838 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2fafa-9921-4032-9b0c-c787915e62a3 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:32:56.704838 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2fafa-9921-4032-9b0c-c787915e62a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:32:56.722412 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-0dc2fafa-9921-4032-9b0c-c787915e62a3 None None] MFA Rules not processed for user `c610ebdafc22479a8a47892591caaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:32:56.723734 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-0dc2fafa-9921-4032-9b0c-c787915e62a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:32:56.779261 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1207/2426] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:32:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 01:33:24.584813 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01153f57-842f-428b-a8c1-34d35bb64ea6 service neutron] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:33:24.586799 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-01153f57-842f-428b-a8c1-34d35bb64ea6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:33:24.607072 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01153f57-842f-428b-a8c1-34d35bb64ea6 service neutron] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:33:24.612062 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef57bd34-ca8d-429f-99a0-553420342caf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:33:24.612833 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef57bd34-ca8d-429f-99a0-553420342caf service neutron] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:33:24.613197 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef57bd34-ca8d-429f-99a0-553420342caf service neutron] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:33:24.613562 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef57bd34-ca8d-429f-99a0-553420342caf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:33:24.616296 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-ef57bd34-ca8d-429f-99a0-553420342caf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:33:24.701986 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef57bd34-ca8d-429f-99a0-553420342caf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:33:24.703396 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef57bd34-ca8d-429f-99a0-553420342caf service neutron] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:33:24.723684 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1220/2427] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:33:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:33:25.915599 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc2fafa-9921-4032-9b0c-c787915e62a3 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:33:25.925831 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc2fafa-9921-4032-9b0c-c787915e62a3 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:33:25.929387 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0621d3-6fa2-4c05-adf1-276252e39ff2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:33:25.930019 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0621d3-6fa2-4c05-adf1-276252e39ff2 service neutron] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:33:25.930301 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0621d3-6fa2-4c05-adf1-276252e39ff2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:33:25.930575 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0621d3-6fa2-4c05-adf1-276252e39ff2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:33:25.932369 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-de0621d3-6fa2-4c05-adf1-276252e39ff2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:33:25.945955 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0621d3-6fa2-4c05-adf1-276252e39ff2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:33:25.947409 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0621d3-6fa2-4c05-adf1-276252e39ff2 service neutron] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:33:25.957993 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1208/2428] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:33:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:33:42.198465 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef57bd34-ca8d-429f-99a0-553420342caf service neutron] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:33:42.199906 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-ef57bd34-ca8d-429f-99a0-553420342caf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:33:42.213593 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef57bd34-ca8d-429f-99a0-553420342caf service neutron] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:33:42.219097 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deac1bbe-2229-49a5-9f26-ce05afdf6bc4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140c6d1a20e94192bde06e72040f162d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:33:42.219732 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac1bbe-2229-49a5-9f26-ce05afdf6bc4 service nova] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:33:42.220007 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac1bbe-2229-49a5-9f26-ce05afdf6bc4 service nova] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:33:42.220282 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac1bbe-2229-49a5-9f26-ce05afdf6bc4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:33:42.221960 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-deac1bbe-2229-49a5-9f26-ce05afdf6bc4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:33:42.277421 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deac1bbe-2229-49a5-9f26-ce05afdf6bc4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:33:42.279042 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deac1bbe-2229-49a5-9f26-ce05afdf6bc4 service nova] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:33:42.288214 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1221/2429] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:33:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:33:42.574569 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0621d3-6fa2-4c05-adf1-276252e39ff2 service neutron] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:33:42.585848 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0621d3-6fa2-4c05-adf1-276252e39ff2 service neutron] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:33:42.591423 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328b4b30-3218-43cf-a219-77f201dc63e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140c6d1a20e94192bde06e72040f162d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:33:42.592128 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b4b30-3218-43cf-a219-77f201dc63e0 service nova] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:33:42.592478 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b4b30-3218-43cf-a219-77f201dc63e0 service nova] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:33:42.593563 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b4b30-3218-43cf-a219-77f201dc63e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:33:42.595651 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-328b4b30-3218-43cf-a219-77f201dc63e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:33:42.606363 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328b4b30-3218-43cf-a219-77f201dc63e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:33:42.607969 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328b4b30-3218-43cf-a219-77f201dc63e0 service nova] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:33:42.617928 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1209/2430] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:33:42 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:33:43.156270 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deac1bbe-2229-49a5-9f26-ce05afdf6bc4 service nova] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:33:43.157768 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-deac1bbe-2229-49a5-9f26-ce05afdf6bc4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:33:43.219534 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deac1bbe-2229-49a5-9f26-ce05afdf6bc4 service nova] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:33:43.223258 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a42f7e-16ee-475e-99b9-6507c14c717e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45219f386f0147b6bd380efe4ab62812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:33:43.223960 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a42f7e-16ee-475e-99b9-6507c14c717e service cinder] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:33:43.224243 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a42f7e-16ee-475e-99b9-6507c14c717e service cinder] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:33:43.224520 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a42f7e-16ee-475e-99b9-6507c14c717e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:33:43.226275 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-23a42f7e-16ee-475e-99b9-6507c14c717e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:33:43.238207 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a42f7e-16ee-475e-99b9-6507c14c717e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:33:43.239741 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a42f7e-16ee-475e-99b9-6507c14c717e service cinder] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:33:43.249389 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1222/2431] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:33:43 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:33:44.428337 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c6f2c-91b5-429e-a9eb-beeb603cabf2 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:33:44.428881 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c6f2c-91b5-429e-a9eb-beeb603cabf2 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:33:44.429096 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c6f2c-91b5-429e-a9eb-beeb603cabf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:33:44.448810 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-882c6f2c-91b5-429e-a9eb-beeb603cabf2 None None] MFA Rules not processed for user `b5e24981873246ea9df9d121c8dc22a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:33:44.450115 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-882c6f2c-91b5-429e-a9eb-beeb603cabf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:33:44.458010 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1210/2432] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:33:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 01:33:44.772966 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a42f7e-16ee-475e-99b9-6507c14c717e service cinder] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:33:44.784089 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a42f7e-16ee-475e-99b9-6507c14c717e service cinder] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:33:44.787830 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a04e10-ed1d-4c26-b5e4-fb7d23b5c7f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:33:44.788734 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a04e10-ed1d-4c26-b5e4-fb7d23b5c7f9 service neutron] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:33:44.789027 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a04e10-ed1d-4c26-b5e4-fb7d23b5c7f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:33:44.789307 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a04e10-ed1d-4c26-b5e4-fb7d23b5c7f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:33:44.791119 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-83a04e10-ed1d-4c26-b5e4-fb7d23b5c7f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:33:44.802024 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a04e10-ed1d-4c26-b5e4-fb7d23b5c7f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:33:44.803527 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a04e10-ed1d-4c26-b5e4-fb7d23b5c7f9 service neutron] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:33:44.811514 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1223/2433] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:33:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:33:45.144091 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882c6f2c-91b5-429e-a9eb-beeb603cabf2 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:33:45.145889 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-882c6f2c-91b5-429e-a9eb-beeb603cabf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:33:45.230723 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882c6f2c-91b5-429e-a9eb-beeb603cabf2 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:33:45.235842 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d6225a-422e-44ee-9404-b08bc875271d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7343cd5457264dabb4c2b3a62df59431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:33:45.236486 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6225a-422e-44ee-9404-b08bc875271d service placement] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:33:45.236764 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6225a-422e-44ee-9404-b08bc875271d service placement] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:33:45.237037 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6225a-422e-44ee-9404-b08bc875271d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:33:45.238850 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-79d6225a-422e-44ee-9404-b08bc875271d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:33:45.250244 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d6225a-422e-44ee-9404-b08bc875271d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:33:45.251840 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d6225a-422e-44ee-9404-b08bc875271d service placement] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:33:45.261500 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1211/2434] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:33:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:33:46.987708 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a04e10-ed1d-4c26-b5e4-fb7d23b5c7f9 service neutron] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:33:46.996218 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a04e10-ed1d-4c26-b5e4-fb7d23b5c7f9 service neutron] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:33:47.000832 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f864bcd0-9510-4b8a-bfa3-56aaf26a6a17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:33:47.001483 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864bcd0-9510-4b8a-bfa3-56aaf26a6a17 service neutron] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:33:47.001766 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864bcd0-9510-4b8a-bfa3-56aaf26a6a17 service neutron] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:33:47.002040 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864bcd0-9510-4b8a-bfa3-56aaf26a6a17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:33:47.003850 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-f864bcd0-9510-4b8a-bfa3-56aaf26a6a17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:33:47.015106 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f864bcd0-9510-4b8a-bfa3-56aaf26a6a17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:33:47.016563 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f864bcd0-9510-4b8a-bfa3-56aaf26a6a17 service neutron] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:33:47.025169 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1224/2435] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:33:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:33:49.594721 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d6225a-422e-44ee-9404-b08bc875271d service placement] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:33:49.596393 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-79d6225a-422e-44ee-9404-b08bc875271d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:33:49.617637 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d6225a-422e-44ee-9404-b08bc875271d service placement] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:33:49.625360 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e64d5ea-605b-4b59-8119-d5cc06e53a3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140c6d1a20e94192bde06e72040f162d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:33:49.626290 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e64d5ea-605b-4b59-8119-d5cc06e53a3e service nova] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:33:49.626646 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e64d5ea-605b-4b59-8119-d5cc06e53a3e service nova] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:33:49.627242 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e64d5ea-605b-4b59-8119-d5cc06e53a3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:33:49.629331 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-4e64d5ea-605b-4b59-8119-d5cc06e53a3e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:33:49.644621 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e64d5ea-605b-4b59-8119-d5cc06e53a3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:33:49.646232 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e64d5ea-605b-4b59-8119-d5cc06e53a3e service nova] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:33:49.673917 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1212/2436] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:33:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:33:56.182979 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f864bcd0-9510-4b8a-bfa3-56aaf26a6a17 service neutron] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:33:56.202633 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f864bcd0-9510-4b8a-bfa3-56aaf26a6a17 service neutron] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:33:56.208975 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7db4df-1949-4d4b-b56d-ff04f84d7634 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140c6d1a20e94192bde06e72040f162d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:33:56.209965 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7db4df-1949-4d4b-b56d-ff04f84d7634 service nova] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:33:56.210354 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7db4df-1949-4d4b-b56d-ff04f84d7634 service nova] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:33:56.210791 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7db4df-1949-4d4b-b56d-ff04f84d7634 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:33:56.212794 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-7d7db4df-1949-4d4b-b56d-ff04f84d7634 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:33:56.227447 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7db4df-1949-4d4b-b56d-ff04f84d7634 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:33:56.229258 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7db4df-1949-4d4b-b56d-ff04f84d7634 service nova] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:33:56.242954 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1225/2437] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:33:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:33:57.527605 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45998a-282a-40ca-9d73-862038d9e32b None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:33:57.528116 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45998a-282a-40ca-9d73-862038d9e32b None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:33:57.528225 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45998a-282a-40ca-9d73-862038d9e32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:33:57.548990 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-2b45998a-282a-40ca-9d73-862038d9e32b None None] MFA Rules not processed for user `35958469e64e490f919742685700caa9`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:33:57.550211 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-2b45998a-282a-40ca-9d73-862038d9e32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:33:57.606625 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1213/2438] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:33:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:34:02.021136 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7db4df-1949-4d4b-b56d-ff04f84d7634 service nova] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:34:02.030425 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7db4df-1949-4d4b-b56d-ff04f84d7634 service nova] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:34:02.034244 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6362c0e7-71e6-4316-bee4-36b5200d0a88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:34:02.034918 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6362c0e7-71e6-4316-bee4-36b5200d0a88 service neutron] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:02.035203 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6362c0e7-71e6-4316-bee4-36b5200d0a88 service neutron] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:02.035481 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6362c0e7-71e6-4316-bee4-36b5200d0a88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:02.037245 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-6362c0e7-71e6-4316-bee4-36b5200d0a88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:34:02.099428 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6362c0e7-71e6-4316-bee4-36b5200d0a88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:34:02.100940 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6362c0e7-71e6-4316-bee4-36b5200d0a88 service neutron] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:34:02.111152 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1226/2439] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:34:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:34:02.588848 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7b939-cf0e-4cf4-949b-254d8c18cc83 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:02.589690 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7b939-cf0e-4cf4-949b-254d8c18cc83 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:02.590127 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7b939-cf0e-4cf4-949b-254d8c18cc83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:02.609513 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-a1f7b939-cf0e-4cf4-949b-254d8c18cc83 None None] MFA Rules not processed for user `0503fdca7f834ef0a81422804dc74812`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:34:02.610729 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-a1f7b939-cf0e-4cf4-949b-254d8c18cc83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:34:02.686446 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1214/2440] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Mar 30 01:34:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:34:02.727239 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6362c0e7-71e6-4316-bee4-36b5200d0a88 service neutron] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:34:02.728639 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-6362c0e7-71e6-4316-bee4-36b5200d0a88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:34:02.799326 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6362c0e7-71e6-4316-bee4-36b5200d0a88 service neutron] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:34:02.804368 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5805a29-061e-4f83-9abf-60b89717e5fa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f16de81dfb4c14b027cd6cd1e6ff2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:34:02.805013 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5805a29-061e-4f83-9abf-60b89717e5fa service swift] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:02.805296 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5805a29-061e-4f83-9abf-60b89717e5fa service swift] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:02.805570 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5805a29-061e-4f83-9abf-60b89717e5fa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:02.814255 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5805a29-061e-4f83-9abf-60b89717e5fa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:34:02.815858 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5805a29-061e-4f83-9abf-60b89717e5fa service swift] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:34:02.823881 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1227/2441] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Mar 30 01:34:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 30 01:34:03.322909 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f7b939-cf0e-4cf4-949b-254d8c18cc83 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:34:03.352410 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f7b939-cf0e-4cf4-949b-254d8c18cc83 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:34:03.363403 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8d04b0-bc59-4054-9c7b-9eaf316897d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140c6d1a20e94192bde06e72040f162d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:34:03.364072 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d04b0-bc59-4054-9c7b-9eaf316897d9 service nova] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:03.364355 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d04b0-bc59-4054-9c7b-9eaf316897d9 service nova] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:03.364625 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d04b0-bc59-4054-9c7b-9eaf316897d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:03.371024 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-4e8d04b0-bc59-4054-9c7b-9eaf316897d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:34:03.389528 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8d04b0-bc59-4054-9c7b-9eaf316897d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:34:03.391740 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8d04b0-bc59-4054-9c7b-9eaf316897d9 service nova] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:34:03.406086 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1215/2442] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:34:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:34:06.782298 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5805a29-061e-4f83-9abf-60b89717e5fa service swift] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:34:06.783841 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-c5805a29-061e-4f83-9abf-60b89717e5fa service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:34:06.810012 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5805a29-061e-4f83-9abf-60b89717e5fa service swift] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:34:06.830495 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dda96c0-5390-4aa1-a1ed-ae9ce4e4654a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:34:06.831433 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda96c0-5390-4aa1-a1ed-ae9ce4e4654a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:06.832160 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda96c0-5390-4aa1-a1ed-ae9ce4e4654a admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:06.832451 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda96c0-5390-4aa1-a1ed-ae9ce4e4654a admin admin] PATH_INFO: `/v3/users/c610ebdafc22479a8a47892591caaf95` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:06.833659 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dda96c0-5390-4aa1-a1ed-ae9ce4e4654a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c610ebdafc22479a8a47892591caaf95)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:34:06.837193 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dda96c0-5390-4aa1-a1ed-ae9ce4e4654a admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:34:06.906815 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-6dda96c0-5390-4aa1-a1ed-ae9ce4e4654a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c610ebdafc22479a8a47892591caaf95'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:06.917284 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-6dda96c0-5390-4aa1-a1ed-ae9ce4e4654a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c610ebdafc22479a8a47892591caaf95'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:06.917927 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-6dda96c0-5390-4aa1-a1ed-ae9ce4e4654a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c610ebdafc22479a8a47892591caaf95'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:06.927212 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-6dda96c0-5390-4aa1-a1ed-ae9ce4e4654a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c610ebdafc22479a8a47892591caaf95'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:06.941711 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-6dda96c0-5390-4aa1-a1ed-ae9ce4e4654a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c610ebdafc22479a8a47892591caaf95'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:06.949416 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1228/2443] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:34:06 2022] DELETE /identity/v3/users/c610ebdafc22479a8a47892591caaf95 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:34:07.145647 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8d04b0-bc59-4054-9c7b-9eaf316897d9 service nova] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:34:07.158193 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8d04b0-bc59-4054-9c7b-9eaf316897d9 service nova] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:34:07.236984 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f7d66f-02ff-4de3-b7b1-87e3bd2cfba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:34:07.237970 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7d66f-02ff-4de3-b7b1-87e3bd2cfba0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:07.238338 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7d66f-02ff-4de3-b7b1-87e3bd2cfba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:07.238687 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7d66f-02ff-4de3-b7b1-87e3bd2cfba0 admin admin] PATH_INFO: `/v3/projects/10d8e88a77d8487680652e10a7a18348` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:07.239985 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f7d66f-02ff-4de3-b7b1-87e3bd2cfba0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10d8e88a77d8487680652e10a7a18348)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:34:07.241959 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f7d66f-02ff-4de3-b7b1-87e3bd2cfba0 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:34:07.303568 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-56f7d66f-02ff-4de3-b7b1-87e3bd2cfba0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10d8e88a77d8487680652e10a7a18348', 'request_id': 'req-56f7d66f-02ff-4de3-b7b1-87e3bd2cfba0'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:07.313914 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-56f7d66f-02ff-4de3-b7b1-87e3bd2cfba0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10d8e88a77d8487680652e10a7a18348', 'request_id': 'req-56f7d66f-02ff-4de3-b7b1-87e3bd2cfba0'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:07.320122 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-56f7d66f-02ff-4de3-b7b1-87e3bd2cfba0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10d8e88a77d8487680652e10a7a18348', 'request_id': 'req-56f7d66f-02ff-4de3-b7b1-87e3bd2cfba0'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:07.336090 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-56f7d66f-02ff-4de3-b7b1-87e3bd2cfba0 admin admin] The token cache is being invalidate because project 10d8e88a77d8487680652e10a7a18348 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:34:07.336769 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-56f7d66f-02ff-4de3-b7b1-87e3bd2cfba0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:07.337602 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-56f7d66f-02ff-4de3-b7b1-87e3bd2cfba0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:07.339597 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1216/2444] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:34:07 2022] DELETE /identity/v3/projects/10d8e88a77d8487680652e10a7a18348 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:34:07.344669 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa48f091-58c0-40fd-b76f-e2963e5eb08d None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:07.344964 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa48f091-58c0-40fd-b76f-e2963e5eb08d None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:07.345248 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa48f091-58c0-40fd-b76f-e2963e5eb08d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:07.365409 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-aa48f091-58c0-40fd-b76f-e2963e5eb08d None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:34:07.367175 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-aa48f091-58c0-40fd-b76f-e2963e5eb08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:34:07.439243 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1229/2445] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:34:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:34:07.444897 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11491819-7dd1-4fd8-8e99-30b91c0cd0ed None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:07.445201 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11491819-7dd1-4fd8-8e99-30b91c0cd0ed None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:07.445481 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11491819-7dd1-4fd8-8e99-30b91c0cd0ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:07.466535 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-11491819-7dd1-4fd8-8e99-30b91c0cd0ed None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:34:07.468588 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-11491819-7dd1-4fd8-8e99-30b91c0cd0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:34:07.479433 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1217/2446] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:34:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:34:07.484234 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa48f091-58c0-40fd-b76f-e2963e5eb08d None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:34:07.496197 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa48f091-58c0-40fd-b76f-e2963e5eb08d None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:34:07.502424 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed4c67-d4a7-4087-bb49-de50f5790622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:34:07.503207 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed4c67-d4a7-4087-bb49-de50f5790622 admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:07.503578 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed4c67-d4a7-4087-bb49-de50f5790622 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:07.503921 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed4c67-d4a7-4087-bb49-de50f5790622 admin admin] PATH_INFO: `/v3/domains` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:07.504726 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed4c67-d4a7-4087-bb49-de50f5790622 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:34:07.505215 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed4c67-d4a7-4087-bb49-de50f5790622 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:34:07.506991 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed4c67-d4a7-4087-bb49-de50f5790622 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:34:07.523246 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1230/2447] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Mar 30 01:34:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:34:07.527356 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11491819-7dd1-4fd8-8e99-30b91c0cd0ed None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:34:07.541450 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11491819-7dd1-4fd8-8e99-30b91c0cd0ed None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:34:07.550806 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd18e8f0-6a7f-4bb6-9f64-1e6431258204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:34:07.551796 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd18e8f0-6a7f-4bb6-9f64-1e6431258204 admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:07.552319 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd18e8f0-6a7f-4bb6-9f64-1e6431258204 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:07.552554 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd18e8f0-6a7f-4bb6-9f64-1e6431258204 admin admin] PATH_INFO: `/v3/projects` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:07.553319 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd18e8f0-6a7f-4bb6-9f64-1e6431258204 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:34:07.555682 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd18e8f0-6a7f-4bb6-9f64-1e6431258204 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:34:07.588707 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1218/2448] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:34:07 2022] POST /identity/v3/projects => generated 365 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 01:34:07.595333 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed4c67-d4a7-4087-bb49-de50f5790622 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:34:07.607133 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed4c67-d4a7-4087-bb49-de50f5790622 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:34:07.683386 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3dbb63-d7f0-4bc4-b4ba-d5fc9c15204a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:34:07.684067 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3dbb63-d7f0-4bc4-b4ba-d5fc9c15204a admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:07.684356 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3dbb63-d7f0-4bc4-b4ba-d5fc9c15204a admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:07.684635 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3dbb63-d7f0-4bc4-b4ba-d5fc9c15204a admin admin] PATH_INFO: `/v3/users` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:07.685328 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3dbb63-d7f0-4bc4-b4ba-d5fc9c15204a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:34:07.687954 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3dbb63-d7f0-4bc4-b4ba-d5fc9c15204a admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:34:07.710302 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1231/2449] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:34:07 2022] POST /identity/v3/users => generated 283 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:34:07.714759 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd18e8f0-6a7f-4bb6-9f64-1e6431258204 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:34:07.724795 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd18e8f0-6a7f-4bb6-9f64-1e6431258204 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:34:07.729653 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dfb6e6-99bd-4be5-a8ad-b85aa8b5fd57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:34:07.730311 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dfb6e6-99bd-4be5-a8ad-b85aa8b5fd57 admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:07.730591 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dfb6e6-99bd-4be5-a8ad-b85aa8b5fd57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:07.730901 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dfb6e6-99bd-4be5-a8ad-b85aa8b5fd57 admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:07.731621 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dfb6e6-99bd-4be5-a8ad-b85aa8b5fd57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:34:07.733778 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dfb6e6-99bd-4be5-a8ad-b85aa8b5fd57 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:34:07.747500 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1219/2450] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:34:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 01:34:07.751314 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3dbb63-d7f0-4bc4-b4ba-d5fc9c15204a admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:34:07.762328 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3dbb63-d7f0-4bc4-b4ba-d5fc9c15204a admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:34:07.767565 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ef49a5-95c9-46c9-b618-88f7cbffa478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:34:07.768368 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef49a5-95c9-46c9-b618-88f7cbffa478 admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:07.768712 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef49a5-95c9-46c9-b618-88f7cbffa478 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:07.769053 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef49a5-95c9-46c9-b618-88f7cbffa478 admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:07.769856 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ef49a5-95c9-46c9-b618-88f7cbffa478 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:34:07.771614 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ef49a5-95c9-46c9-b618-88f7cbffa478 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:34:07.787377 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dfb6e6-99bd-4be5-a8ad-b85aa8b5fd57 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:34:07.793131 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1232/2451] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:34:07 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:34:07.799944 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dfb6e6-99bd-4be5-a8ad-b85aa8b5fd57 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:34:07.805340 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4be7006-0eb2-4eec-95da-f0e0edda3381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:34:07.806488 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be7006-0eb2-4eec-95da-f0e0edda3381 admin admin] REQUEST_METHOD: `PUT` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:07.806876 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be7006-0eb2-4eec-95da-f0e0edda3381 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:07.807225 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be7006-0eb2-4eec-95da-f0e0edda3381 admin admin] PATH_INFO: `/v3/projects/d3ef736febbe446e845e4f4d02092f30/users/f98bebf6fdd34ff4a0f5a88bdebd8ac6/roles/7185d0cfbcd44502b1613bcfe1b42f6f` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:07.832376 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4be7006-0eb2-4eec-95da-f0e0edda3381 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3ef736febbe446e845e4f4d02092f30, user_id=f98bebf6fdd34ff4a0f5a88bdebd8ac6, role_id=7185d0cfbcd44502b1613bcfe1b42f6f)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:34:07.836707 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4be7006-0eb2-4eec-95da-f0e0edda3381 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:34:07.878734 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1220/2452] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:34:07 2022] PUT /identity/v3/projects/d3ef736febbe446e845e4f4d02092f30/users/f98bebf6fdd34ff4a0f5a88bdebd8ac6/roles/7185d0cfbcd44502b1613bcfe1b42f6f => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:34:07.891060 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b92e8-1775-43d8-b749-a3de1a8bd92a None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:07.891383 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b92e8-1775-43d8-b749-a3de1a8bd92a None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:07.891616 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b92e8-1775-43d8-b749-a3de1a8bd92a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:07.923494 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-475b92e8-1775-43d8-b749-a3de1a8bd92a None None] MFA Rules not processed for user `f98bebf6fdd34ff4a0f5a88bdebd8ac6`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:34:07.924726 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-475b92e8-1775-43d8-b749-a3de1a8bd92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:34:08.018134 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1233/2453] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:34:07 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:34:08.022439 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4be7006-0eb2-4eec-95da-f0e0edda3381 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:34:08.094373 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4be7006-0eb2-4eec-95da-f0e0edda3381 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:34:08.101531 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e06962d-e183-47b0-9185-5433d90658c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:34:08.102289 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06962d-e183-47b0-9185-5433d90658c1 admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:08.102841 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06962d-e183-47b0-9185-5433d90658c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:08.103105 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06962d-e183-47b0-9185-5433d90658c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:08.103844 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e06962d-e183-47b0-9185-5433d90658c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:34:08.105759 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e06962d-e183-47b0-9185-5433d90658c1 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:34:08.134129 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1221/2454] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:34:08 2022] POST /identity/v3/projects => generated 365 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:34:08.138029 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475b92e8-1775-43d8-b749-a3de1a8bd92a None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:34:08.162364 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475b92e8-1775-43d8-b749-a3de1a8bd92a None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:34:08.230573 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cb029c-fd53-4510-814b-053d6be3f0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:34:08.231320 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb029c-fd53-4510-814b-053d6be3f0b9 admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:08.231906 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb029c-fd53-4510-814b-053d6be3f0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:08.232945 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb029c-fd53-4510-814b-053d6be3f0b9 admin admin] PATH_INFO: `/v3/users` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:08.233856 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cb029c-fd53-4510-814b-053d6be3f0b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:34:08.235926 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cb029c-fd53-4510-814b-053d6be3f0b9 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:34:08.261328 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1234/2455] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:34:08 2022] POST /identity/v3/users => generated 289 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:34:08.265508 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e06962d-e183-47b0-9185-5433d90658c1 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:34:08.279617 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e06962d-e183-47b0-9185-5433d90658c1 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:34:08.284909 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd4ff8a-7808-44ee-86ba-fb3b9b3852e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:34:08.285753 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd4ff8a-7808-44ee-86ba-fb3b9b3852e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:08.286134 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd4ff8a-7808-44ee-86ba-fb3b9b3852e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:08.286538 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd4ff8a-7808-44ee-86ba-fb3b9b3852e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:08.287400 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd4ff8a-7808-44ee-86ba-fb3b9b3852e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:34:08.289082 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd4ff8a-7808-44ee-86ba-fb3b9b3852e5 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:34:08.302579 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1222/2456] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:34:08 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:34:08.305652 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cb029c-fd53-4510-814b-053d6be3f0b9 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:34:08.319052 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cb029c-fd53-4510-814b-053d6be3f0b9 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:34:08.323716 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f63fb37-4727-49d3-9abf-e0303eae12b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:34:08.324589 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63fb37-4727-49d3-9abf-e0303eae12b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:08.324865 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63fb37-4727-49d3-9abf-e0303eae12b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:08.325145 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63fb37-4727-49d3-9abf-e0303eae12b1 admin admin] PATH_INFO: `/v3/projects/c2638cf1a2244a379d9dfeb8e0274fe2/users/1c137c6c2193443e8ac38a0112587a9c/roles/36909bbf31d04993bb2a9fe587b572dc` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:08.345760 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f63fb37-4727-49d3-9abf-e0303eae12b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2638cf1a2244a379d9dfeb8e0274fe2, user_id=1c137c6c2193443e8ac38a0112587a9c, role_id=36909bbf31d04993bb2a9fe587b572dc)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:34:08.349490 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f63fb37-4727-49d3-9abf-e0303eae12b1 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:34:08.366787 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1235/2457] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:34:08 2022] PUT /identity/v3/projects/c2638cf1a2244a379d9dfeb8e0274fe2/users/1c137c6c2193443e8ac38a0112587a9c/roles/36909bbf31d04993bb2a9fe587b572dc => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:34:08.369096 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd4ff8a-7808-44ee-86ba-fb3b9b3852e5 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:34:08.380310 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd4ff8a-7808-44ee-86ba-fb3b9b3852e5 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:34:08.441892 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc52500-c370-4782-9f17-91170ed7373e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:34:08.442596 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc52500-c370-4782-9f17-91170ed7373e admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:08.443326 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc52500-c370-4782-9f17-91170ed7373e admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:08.443326 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc52500-c370-4782-9f17-91170ed7373e admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:08.444020 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc52500-c370-4782-9f17-91170ed7373e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:34:08.445651 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc52500-c370-4782-9f17-91170ed7373e admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:34:08.459868 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1223/2458] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:34:08 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:34:08.463901 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f63fb37-4727-49d3-9abf-e0303eae12b1 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:34:08.477507 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f63fb37-4727-49d3-9abf-e0303eae12b1 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:34:08.482579 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df2995f-a069-46b9-b986-71a3a272241c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:34:08.484339 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df2995f-a069-46b9-b986-71a3a272241c admin admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:08.484607 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df2995f-a069-46b9-b986-71a3a272241c admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:08.484881 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df2995f-a069-46b9-b986-71a3a272241c admin admin] PATH_INFO: `/v3/projects/c2638cf1a2244a379d9dfeb8e0274fe2/users/1c137c6c2193443e8ac38a0112587a9c/roles/36909bbf31d04993bb2a9fe587b572dc` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:08.486896 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df2995f-a069-46b9-b986-71a3a272241c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2638cf1a2244a379d9dfeb8e0274fe2, user_id=1c137c6c2193443e8ac38a0112587a9c, role_id=36909bbf31d04993bb2a9fe587b572dc)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:34:08.489542 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df2995f-a069-46b9-b986-71a3a272241c admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:34:08.506971 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1236/2459] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:34:08 2022] PUT /identity/v3/projects/c2638cf1a2244a379d9dfeb8e0274fe2/users/1c137c6c2193443e8ac38a0112587a9c/roles/36909bbf31d04993bb2a9fe587b572dc => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:34:08.514229 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b608968-8018-46d7-b916-c3f3bf578879 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:08.514890 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b608968-8018-46d7-b916-c3f3bf578879 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:08.515313 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b608968-8018-46d7-b916-c3f3bf578879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:08.556086 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-9b608968-8018-46d7-b916-c3f3bf578879 None None] MFA Rules not processed for user `1c137c6c2193443e8ac38a0112587a9c`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:34:08.557332 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-9b608968-8018-46d7-b916-c3f3bf578879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:34:08.636224 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1224/2460] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:34:08 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:34:08.648062 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df2995f-a069-46b9-b986-71a3a272241c admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:34:08.650741 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-5df2995f-a069-46b9-b986-71a3a272241c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:34:08.719585 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df2995f-a069-46b9-b986-71a3a272241c admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:34:08.723390 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca84a21b-17b3-4260-9323-117e3271c297 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45219f386f0147b6bd380efe4ab62812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:34:08.724038 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84a21b-17b3-4260-9323-117e3271c297 service cinder] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:08.724317 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84a21b-17b3-4260-9323-117e3271c297 service cinder] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:08.724593 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84a21b-17b3-4260-9323-117e3271c297 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:08.735345 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca84a21b-17b3-4260-9323-117e3271c297 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:34:08.736733 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca84a21b-17b3-4260-9323-117e3271c297 service cinder] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:34:08.747697 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1237/2461] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:34:08 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:34:08.843692 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b608968-8018-46d7-b916-c3f3bf578879 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:34:08.854411 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b608968-8018-46d7-b916-c3f3bf578879 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:34:08.859839 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7addcfcc-c88f-4b34-b643-3100155810b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45219f386f0147b6bd380efe4ab62812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:34:08.860910 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7addcfcc-c88f-4b34-b643-3100155810b5 service cinder] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:08.861286 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7addcfcc-c88f-4b34-b643-3100155810b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:08.861570 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7addcfcc-c88f-4b34-b643-3100155810b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:08.926580 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7addcfcc-c88f-4b34-b643-3100155810b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:34:08.928078 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7addcfcc-c88f-4b34-b643-3100155810b5 service cinder] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:34:08.939180 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1225/2462] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:34:08 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:34:18.420823 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca84a21b-17b3-4260-9323-117e3271c297 service cinder] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:34:18.487366 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca84a21b-17b3-4260-9323-117e3271c297 service cinder] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:34:18.492783 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42956472-357c-4257-86a0-b734a60ef8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:34:18.493800 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42956472-357c-4257-86a0-b734a60ef8f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:18.494331 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42956472-357c-4257-86a0-b734a60ef8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:18.494729 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42956472-357c-4257-86a0-b734a60ef8f2 admin admin] PATH_INFO: `/v3/users/f98bebf6fdd34ff4a0f5a88bdebd8ac6` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:18.496524 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42956472-357c-4257-86a0-b734a60ef8f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f98bebf6fdd34ff4a0f5a88bdebd8ac6)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:34:18.498817 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42956472-357c-4257-86a0-b734a60ef8f2 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:34:18.566068 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-42956472-357c-4257-86a0-b734a60ef8f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f98bebf6fdd34ff4a0f5a88bdebd8ac6'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:18.575718 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-42956472-357c-4257-86a0-b734a60ef8f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f98bebf6fdd34ff4a0f5a88bdebd8ac6'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:18.576452 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-42956472-357c-4257-86a0-b734a60ef8f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f98bebf6fdd34ff4a0f5a88bdebd8ac6'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:18.585406 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-42956472-357c-4257-86a0-b734a60ef8f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f98bebf6fdd34ff4a0f5a88bdebd8ac6'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:18.599062 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-42956472-357c-4257-86a0-b734a60ef8f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f98bebf6fdd34ff4a0f5a88bdebd8ac6'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:18.606269 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1238/2463] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:34:18 2022] DELETE /identity/v3/users/f98bebf6fdd34ff4a0f5a88bdebd8ac6 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:34:18.610884 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2cf807-016c-4269-83d9-dd03f903ff66 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:18.611401 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2cf807-016c-4269-83d9-dd03f903ff66 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:18.611547 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2cf807-016c-4269-83d9-dd03f903ff66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:18.635619 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-bc2cf807-016c-4269-83d9-dd03f903ff66 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:34:18.637141 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-bc2cf807-016c-4269-83d9-dd03f903ff66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:34:18.713087 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1226/2464] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:34:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:34:18.723268 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42956472-357c-4257-86a0-b734a60ef8f2 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:34:18.724781 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-42956472-357c-4257-86a0-b734a60ef8f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:34:18.786962 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42956472-357c-4257-86a0-b734a60ef8f2 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:34:18.791267 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80c1f94-bc33-4350-aea0-b91934f19ca7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:34:18.792118 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c1f94-bc33-4350-aea0-b91934f19ca7 service neutron] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:18.792404 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c1f94-bc33-4350-aea0-b91934f19ca7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:18.792683 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c1f94-bc33-4350-aea0-b91934f19ca7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:18.804996 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80c1f94-bc33-4350-aea0-b91934f19ca7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:34:18.806468 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80c1f94-bc33-4350-aea0-b91934f19ca7 service neutron] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:34:18.817418 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1239/2465] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:34:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:34:19.244955 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2cf807-016c-4269-83d9-dd03f903ff66 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:34:19.246547 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-bc2cf807-016c-4269-83d9-dd03f903ff66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:34:19.265987 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2cf807-016c-4269-83d9-dd03f903ff66 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:34:19.282581 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4aa9c6-7324-4517-9eb6-f08fd8c1f148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:34:19.283767 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4aa9c6-7324-4517-9eb6-f08fd8c1f148 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:19.284141 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4aa9c6-7324-4517-9eb6-f08fd8c1f148 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:19.284515 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4aa9c6-7324-4517-9eb6-f08fd8c1f148 admin admin] PATH_INFO: `/v3/projects/d3ef736febbe446e845e4f4d02092f30` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:19.286442 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4aa9c6-7324-4517-9eb6-f08fd8c1f148 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3ef736febbe446e845e4f4d02092f30)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:34:19.289771 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4aa9c6-7324-4517-9eb6-f08fd8c1f148 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:34:19.411332 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-1a4aa9c6-7324-4517-9eb6-f08fd8c1f148 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3ef736febbe446e845e4f4d02092f30', 'request_id': 'req-1a4aa9c6-7324-4517-9eb6-f08fd8c1f148'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:19.421404 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-1a4aa9c6-7324-4517-9eb6-f08fd8c1f148 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3ef736febbe446e845e4f4d02092f30', 'request_id': 'req-1a4aa9c6-7324-4517-9eb6-f08fd8c1f148'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:19.428598 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-1a4aa9c6-7324-4517-9eb6-f08fd8c1f148 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3ef736febbe446e845e4f4d02092f30', 'request_id': 'req-1a4aa9c6-7324-4517-9eb6-f08fd8c1f148'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:19.441455 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-1a4aa9c6-7324-4517-9eb6-f08fd8c1f148 admin admin] The token cache is being invalidate because project d3ef736febbe446e845e4f4d02092f30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:34:19.441748 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-1a4aa9c6-7324-4517-9eb6-f08fd8c1f148 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:19.442413 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-1a4aa9c6-7324-4517-9eb6-f08fd8c1f148 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:19.447026 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1227/2466] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:34:19 2022] DELETE /identity/v3/projects/d3ef736febbe446e845e4f4d02092f30 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:34:19.448238 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80c1f94-bc33-4350-aea0-b91934f19ca7 service neutron] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:34:19.458242 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80c1f94-bc33-4350-aea0-b91934f19ca7 service neutron] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:34:19.519939 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f4f1ed-5163-4b0a-9376-15a13842a4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:34:19.520829 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4f1ed-5163-4b0a-9376-15a13842a4a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:19.521110 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4f1ed-5163-4b0a-9376-15a13842a4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:19.521388 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4f1ed-5163-4b0a-9376-15a13842a4a4 admin admin] PATH_INFO: `/v3/users/1c137c6c2193443e8ac38a0112587a9c` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:19.522635 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f4f1ed-5163-4b0a-9376-15a13842a4a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c137c6c2193443e8ac38a0112587a9c)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:34:19.524800 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f4f1ed-5163-4b0a-9376-15a13842a4a4 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:34:19.577991 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-b2f4f1ed-5163-4b0a-9376-15a13842a4a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c137c6c2193443e8ac38a0112587a9c'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:19.585146 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-b2f4f1ed-5163-4b0a-9376-15a13842a4a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c137c6c2193443e8ac38a0112587a9c'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:19.585912 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-b2f4f1ed-5163-4b0a-9376-15a13842a4a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c137c6c2193443e8ac38a0112587a9c'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:19.592775 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-b2f4f1ed-5163-4b0a-9376-15a13842a4a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c137c6c2193443e8ac38a0112587a9c'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:19.604714 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-b2f4f1ed-5163-4b0a-9376-15a13842a4a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c137c6c2193443e8ac38a0112587a9c'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:19.613192 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1240/2467] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:34:19 2022] DELETE /identity/v3/users/1c137c6c2193443e8ac38a0112587a9c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:34:19.937773 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4aa9c6-7324-4517-9eb6-f08fd8c1f148 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:34:19.940035 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-1a4aa9c6-7324-4517-9eb6-f08fd8c1f148 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:34:19.962925 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4aa9c6-7324-4517-9eb6-f08fd8c1f148 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:34:20.064393 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfbd787-7025-4a91-8c41-b67049dd68f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:34:20.065305 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfbd787-7025-4a91-8c41-b67049dd68f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:20.065748 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfbd787-7025-4a91-8c41-b67049dd68f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:20.066192 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfbd787-7025-4a91-8c41-b67049dd68f7 admin admin] PATH_INFO: `/v3/projects/c2638cf1a2244a379d9dfeb8e0274fe2` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:20.067766 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfbd787-7025-4a91-8c41-b67049dd68f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2638cf1a2244a379d9dfeb8e0274fe2)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:34:20.070146 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfbd787-7025-4a91-8c41-b67049dd68f7 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:34:20.135839 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-4cfbd787-7025-4a91-8c41-b67049dd68f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2638cf1a2244a379d9dfeb8e0274fe2', 'request_id': 'req-4cfbd787-7025-4a91-8c41-b67049dd68f7'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:20.144832 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-4cfbd787-7025-4a91-8c41-b67049dd68f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2638cf1a2244a379d9dfeb8e0274fe2', 'request_id': 'req-4cfbd787-7025-4a91-8c41-b67049dd68f7'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:20.150682 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-4cfbd787-7025-4a91-8c41-b67049dd68f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2638cf1a2244a379d9dfeb8e0274fe2', 'request_id': 'req-4cfbd787-7025-4a91-8c41-b67049dd68f7'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:20.163083 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-4cfbd787-7025-4a91-8c41-b67049dd68f7 admin admin] The token cache is being invalidate because project c2638cf1a2244a379d9dfeb8e0274fe2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:34:20.163376 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-4cfbd787-7025-4a91-8c41-b67049dd68f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:20.164048 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-4cfbd787-7025-4a91-8c41-b67049dd68f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:20.165600 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1228/2468] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:34:19 2022] DELETE /identity/v3/projects/c2638cf1a2244a379d9dfeb8e0274fe2 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:34:20.170931 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac6f27-12e4-4973-bbfe-0dde8d4b3bf9 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:20.171222 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac6f27-12e4-4973-bbfe-0dde8d4b3bf9 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:20.171506 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac6f27-12e4-4973-bbfe-0dde8d4b3bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:20.189546 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-0fac6f27-12e4-4973-bbfe-0dde8d4b3bf9 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:34:20.190775 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-0fac6f27-12e4-4973-bbfe-0dde8d4b3bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:34:20.254835 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1241/2469] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:34:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:34:20.262640 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29156157-c453-465c-b573-adf5847d35ce None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:20.262972 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29156157-c453-465c-b573-adf5847d35ce None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:20.263443 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29156157-c453-465c-b573-adf5847d35ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:20.282972 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-29156157-c453-465c-b573-adf5847d35ce None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:34:20.284187 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-29156157-c453-465c-b573-adf5847d35ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:34:20.292224 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1229/2470] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:34:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:34:20.296917 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fac6f27-12e4-4973-bbfe-0dde8d4b3bf9 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:34:20.306427 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fac6f27-12e4-4973-bbfe-0dde8d4b3bf9 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:34:20.311065 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae98924-9320-4320-ae32-14ee5ff9c7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:34:20.311705 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae98924-9320-4320-ae32-14ee5ff9c7d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:20.312028 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae98924-9320-4320-ae32-14ee5ff9c7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:20.312797 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae98924-9320-4320-ae32-14ee5ff9c7d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:20.313512 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae98924-9320-4320-ae32-14ee5ff9c7d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:34:20.313809 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae98924-9320-4320-ae32-14ee5ff9c7d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:34:20.315419 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae98924-9320-4320-ae32-14ee5ff9c7d7 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:34:20.329868 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1242/2471] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Mar 30 01:34:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:34:20.331141 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29156157-c453-465c-b573-adf5847d35ce None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:34:20.340294 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29156157-c453-465c-b573-adf5847d35ce None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:34:20.345171 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac163c3-b126-4f44-9797-92f06fcfa21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:34:20.345821 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac163c3-b126-4f44-9797-92f06fcfa21c admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:20.346106 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac163c3-b126-4f44-9797-92f06fcfa21c admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:20.346383 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac163c3-b126-4f44-9797-92f06fcfa21c admin admin] PATH_INFO: `/v3/projects` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:20.347103 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac163c3-b126-4f44-9797-92f06fcfa21c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:34:20.349010 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac163c3-b126-4f44-9797-92f06fcfa21c admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:34:20.377991 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1230/2472] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:34:20 2022] POST /identity/v3/projects => generated 363 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:34:20.382026 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae98924-9320-4320-ae32-14ee5ff9c7d7 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:34:20.392589 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae98924-9320-4320-ae32-14ee5ff9c7d7 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:34:20.450900 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3783ec30-a9d4-4a91-b65d-3286a9d462af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:34:20.451610 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783ec30-a9d4-4a91-b65d-3286a9d462af admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:20.451855 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783ec30-a9d4-4a91-b65d-3286a9d462af admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:20.452101 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783ec30-a9d4-4a91-b65d-3286a9d462af admin admin] PATH_INFO: `/v3/users` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:20.453315 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3783ec30-a9d4-4a91-b65d-3286a9d462af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:34:20.455350 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3783ec30-a9d4-4a91-b65d-3286a9d462af admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:34:20.477980 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1243/2473] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:34:20 2022] POST /identity/v3/users => generated 282 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:34:20.479445 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac163c3-b126-4f44-9797-92f06fcfa21c admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:34:20.490217 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac163c3-b126-4f44-9797-92f06fcfa21c admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:34:20.494940 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2f073f-d49d-4205-b864-20047ccd7a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:34:20.496510 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2f073f-d49d-4205-b864-20047ccd7a9a admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:20.496854 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2f073f-d49d-4205-b864-20047ccd7a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:20.497140 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2f073f-d49d-4205-b864-20047ccd7a9a admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:20.497877 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2f073f-d49d-4205-b864-20047ccd7a9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:34:20.499872 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2f073f-d49d-4205-b864-20047ccd7a9a admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:34:20.511926 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1231/2474] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:34:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:34:20.516733 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3783ec30-a9d4-4a91-b65d-3286a9d462af admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:34:20.527628 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3783ec30-a9d4-4a91-b65d-3286a9d462af admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:34:20.532735 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad1aeaf-4fb3-444a-8ccc-d54cd10013cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:34:20.533405 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad1aeaf-4fb3-444a-8ccc-d54cd10013cc admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:20.533692 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad1aeaf-4fb3-444a-8ccc-d54cd10013cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:20.533971 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad1aeaf-4fb3-444a-8ccc-d54cd10013cc admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:20.534714 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad1aeaf-4fb3-444a-8ccc-d54cd10013cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:34:20.536348 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad1aeaf-4fb3-444a-8ccc-d54cd10013cc admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:34:20.547288 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1244/2475] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:34:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:34:20.551391 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2f073f-d49d-4205-b864-20047ccd7a9a admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:34:20.561346 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2f073f-d49d-4205-b864-20047ccd7a9a admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:34:20.567382 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0663659e-00bb-4be0-9ad2-3e8bb4b57801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:34:20.568647 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0663659e-00bb-4be0-9ad2-3e8bb4b57801 admin admin] REQUEST_METHOD: `PUT` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:20.568647 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0663659e-00bb-4be0-9ad2-3e8bb4b57801 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:20.568890 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0663659e-00bb-4be0-9ad2-3e8bb4b57801 admin admin] PATH_INFO: `/v3/projects/0e5ae357c6684829bdb79e78a081bbf4/users/f8d69b23c59c4d6e8e6ca31951eb1f9c/roles/7185d0cfbcd44502b1613bcfe1b42f6f` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:20.583492 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0663659e-00bb-4be0-9ad2-3e8bb4b57801 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e5ae357c6684829bdb79e78a081bbf4, user_id=f8d69b23c59c4d6e8e6ca31951eb1f9c, role_id=7185d0cfbcd44502b1613bcfe1b42f6f)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:34:20.586184 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0663659e-00bb-4be0-9ad2-3e8bb4b57801 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:34:20.598377 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1232/2476] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:34:20 2022] PUT /identity/v3/projects/0e5ae357c6684829bdb79e78a081bbf4/users/f8d69b23c59c4d6e8e6ca31951eb1f9c/roles/7185d0cfbcd44502b1613bcfe1b42f6f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:34:20.608427 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad0133-7814-4cda-9954-05a87b8c74fd None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:20.608720 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad0133-7814-4cda-9954-05a87b8c74fd None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:20.609514 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad0133-7814-4cda-9954-05a87b8c74fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:20.640359 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-06ad0133-7814-4cda-9954-05a87b8c74fd None None] MFA Rules not processed for user `f8d69b23c59c4d6e8e6ca31951eb1f9c`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:34:20.641789 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-06ad0133-7814-4cda-9954-05a87b8c74fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:34:20.708802 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1245/2477] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:34:20 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:34:20.713376 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0663659e-00bb-4be0-9ad2-3e8bb4b57801 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:34:20.779553 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0663659e-00bb-4be0-9ad2-3e8bb4b57801 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:34:20.785049 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84636ab7-f00b-4378-ad7c-d5f8d674bbad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:34:20.785707 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84636ab7-f00b-4378-ad7c-d5f8d674bbad admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:20.785994 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84636ab7-f00b-4378-ad7c-d5f8d674bbad admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:20.786275 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84636ab7-f00b-4378-ad7c-d5f8d674bbad admin admin] PATH_INFO: `/v3/projects` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:20.786994 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84636ab7-f00b-4378-ad7c-d5f8d674bbad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:34:20.788888 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84636ab7-f00b-4378-ad7c-d5f8d674bbad admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:34:20.813766 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1233/2478] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:34:20 2022] POST /identity/v3/projects => generated 365 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:34:20.817826 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ad0133-7814-4cda-9954-05a87b8c74fd None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:34:20.828407 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ad0133-7814-4cda-9954-05a87b8c74fd None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:34:20.883023 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4e8007-5a04-4d78-ac56-da9761915812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:34:20.883693 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e8007-5a04-4d78-ac56-da9761915812 admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:20.883976 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e8007-5a04-4d78-ac56-da9761915812 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:20.884249 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e8007-5a04-4d78-ac56-da9761915812 admin admin] PATH_INFO: `/v3/users` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:20.884937 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4e8007-5a04-4d78-ac56-da9761915812 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:34:20.887052 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4e8007-5a04-4d78-ac56-da9761915812 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:34:20.907104 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1246/2479] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:34:20 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 01:34:20.911200 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84636ab7-f00b-4378-ad7c-d5f8d674bbad admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:34:20.922052 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84636ab7-f00b-4378-ad7c-d5f8d674bbad admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:34:20.926885 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7865c824-f0cf-4f17-a7c1-25559800a0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:34:20.927540 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865c824-f0cf-4f17-a7c1-25559800a0da admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:20.927826 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865c824-f0cf-4f17-a7c1-25559800a0da admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:20.928104 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865c824-f0cf-4f17-a7c1-25559800a0da admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:20.928853 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7865c824-f0cf-4f17-a7c1-25559800a0da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:34:20.930441 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7865c824-f0cf-4f17-a7c1-25559800a0da admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:34:20.941231 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1234/2480] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:34:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 01:34:20.945257 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4e8007-5a04-4d78-ac56-da9761915812 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:34:20.955083 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4e8007-5a04-4d78-ac56-da9761915812 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:34:20.959691 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a22b6-c108-41a0-bc0a-c061b341b9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:34:20.960580 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a22b6-c108-41a0-bc0a-c061b341b9dc admin admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:20.960861 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a22b6-c108-41a0-bc0a-c061b341b9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:20.961134 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a22b6-c108-41a0-bc0a-c061b341b9dc admin admin] PATH_INFO: `/v3/projects/1840f4e9759048b5965c2e62dcea3e32/users/ffa4ec79e5934aebb2323d5d5b08f067/roles/36909bbf31d04993bb2a9fe587b572dc` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:20.975785 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6a22b6-c108-41a0-bc0a-c061b341b9dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=1840f4e9759048b5965c2e62dcea3e32, user_id=ffa4ec79e5934aebb2323d5d5b08f067, role_id=36909bbf31d04993bb2a9fe587b572dc)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:34:20.978625 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6a22b6-c108-41a0-bc0a-c061b341b9dc admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:34:20.992442 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1247/2481] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:34:20 2022] PUT /identity/v3/projects/1840f4e9759048b5965c2e62dcea3e32/users/ffa4ec79e5934aebb2323d5d5b08f067/roles/36909bbf31d04993bb2a9fe587b572dc => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:34:20.996459 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7865c824-f0cf-4f17-a7c1-25559800a0da admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:34:21.006599 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7865c824-f0cf-4f17-a7c1-25559800a0da admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:34:21.063664 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8b9854-8a71-438e-b1da-a38f93f0eb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:34:21.064332 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b9854-8a71-438e-b1da-a38f93f0eb83 admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:21.064610 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b9854-8a71-438e-b1da-a38f93f0eb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:21.064880 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b9854-8a71-438e-b1da-a38f93f0eb83 admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:21.065599 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8b9854-8a71-438e-b1da-a38f93f0eb83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:34:21.067215 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8b9854-8a71-438e-b1da-a38f93f0eb83 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:34:21.080940 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1235/2482] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:34:20 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 01:34:21.082155 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a22b6-c108-41a0-bc0a-c061b341b9dc admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:34:21.092498 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a22b6-c108-41a0-bc0a-c061b341b9dc admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:34:21.098439 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6343b200-ac83-466f-8de2-a38cb3bccac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:34:21.099349 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6343b200-ac83-466f-8de2-a38cb3bccac4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:21.099631 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6343b200-ac83-466f-8de2-a38cb3bccac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:21.099906 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6343b200-ac83-466f-8de2-a38cb3bccac4 admin admin] PATH_INFO: `/v3/projects/1840f4e9759048b5965c2e62dcea3e32/users/ffa4ec79e5934aebb2323d5d5b08f067/roles/36909bbf31d04993bb2a9fe587b572dc` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:21.101859 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6343b200-ac83-466f-8de2-a38cb3bccac4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1840f4e9759048b5965c2e62dcea3e32, user_id=ffa4ec79e5934aebb2323d5d5b08f067, role_id=36909bbf31d04993bb2a9fe587b572dc)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:34:21.104577 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6343b200-ac83-466f-8de2-a38cb3bccac4 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:34:21.115572 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1248/2483] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:34:21 2022] PUT /identity/v3/projects/1840f4e9759048b5965c2e62dcea3e32/users/ffa4ec79e5934aebb2323d5d5b08f067/roles/36909bbf31d04993bb2a9fe587b572dc => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:34:21.127351 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370af637-4e2f-49a5-8f8e-1ec7a04227f6 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:21.127635 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370af637-4e2f-49a5-8f8e-1ec7a04227f6 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:21.127911 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370af637-4e2f-49a5-8f8e-1ec7a04227f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:21.157211 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-370af637-4e2f-49a5-8f8e-1ec7a04227f6 None None] MFA Rules not processed for user `ffa4ec79e5934aebb2323d5d5b08f067`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:34:21.158483 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-370af637-4e2f-49a5-8f8e-1ec7a04227f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:34:21.236468 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1236/2484] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:34:21 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:34:21.248508 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6343b200-ac83-466f-8de2-a38cb3bccac4 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:34:21.250961 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-6343b200-ac83-466f-8de2-a38cb3bccac4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:34:21.309942 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6343b200-ac83-466f-8de2-a38cb3bccac4 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:34:21.313863 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e9bf3-574f-479c-884d-06c81bbd5eb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45219f386f0147b6bd380efe4ab62812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:34:21.314447 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e9bf3-574f-479c-884d-06c81bbd5eb0 service cinder] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:21.314758 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e9bf3-574f-479c-884d-06c81bbd5eb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:21.315042 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e9bf3-574f-479c-884d-06c81bbd5eb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:21.324517 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1e9bf3-574f-479c-884d-06c81bbd5eb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:34:21.325971 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1e9bf3-574f-479c-884d-06c81bbd5eb0 service cinder] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:34:21.337043 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1249/2485] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:34:21 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 30 01:34:21.411754 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370af637-4e2f-49a5-8f8e-1ec7a04227f6 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:34:21.421173 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370af637-4e2f-49a5-8f8e-1ec7a04227f6 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:34:21.425216 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41bbcf0-b6f7-413f-a981-01fe6b02b6a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45219f386f0147b6bd380efe4ab62812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:34:21.425858 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41bbcf0-b6f7-413f-a981-01fe6b02b6a5 service cinder] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:21.426134 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41bbcf0-b6f7-413f-a981-01fe6b02b6a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:21.426404 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41bbcf0-b6f7-413f-a981-01fe6b02b6a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:21.486264 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41bbcf0-b6f7-413f-a981-01fe6b02b6a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:34:21.487727 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41bbcf0-b6f7-413f-a981-01fe6b02b6a5 service cinder] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:34:21.496585 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1237/2486] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:34:21 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:34:22.138422 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a7ca9-113c-4947-a2fe-e04ef993eb1e None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:22.138901 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a7ca9-113c-4947-a2fe-e04ef993eb1e None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:22.139018 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a7ca9-113c-4947-a2fe-e04ef993eb1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:22.157708 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-bc4a7ca9-113c-4947-a2fe-e04ef993eb1e None None] MFA Rules not processed for user `0503fdca7f834ef0a81422804dc74812`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:34:22.158951 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-bc4a7ca9-113c-4947-a2fe-e04ef993eb1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:34:22.212581 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1250/2487] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Mar 30 01:34:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:34:22.233913 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41bbcf0-b6f7-413f-a981-01fe6b02b6a5 service cinder] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:34:22.236092 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-e41bbcf0-b6f7-413f-a981-01fe6b02b6a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:34:22.304143 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41bbcf0-b6f7-413f-a981-01fe6b02b6a5 service cinder] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:34:22.309613 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b343968-64f2-4386-b7a0-f8a2562eb5c8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f16de81dfb4c14b027cd6cd1e6ff2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:34:22.310279 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b343968-64f2-4386-b7a0-f8a2562eb5c8 service swift] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:22.310571 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b343968-64f2-4386-b7a0-f8a2562eb5c8 service swift] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:22.310884 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b343968-64f2-4386-b7a0-f8a2562eb5c8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:22.319880 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b343968-64f2-4386-b7a0-f8a2562eb5c8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:34:22.321481 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b343968-64f2-4386-b7a0-f8a2562eb5c8 service swift] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:34:22.330155 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1238/2488] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Mar 30 01:34:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 30 01:34:24.304909 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a7ca9-113c-4947-a2fe-e04ef993eb1e None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:34:24.370688 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a7ca9-113c-4947-a2fe-e04ef993eb1e None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:34:24.377286 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5910dc50-c26d-49fe-a704-2219c377557c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:34:24.378385 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5910dc50-c26d-49fe-a704-2219c377557c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:24.378770 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5910dc50-c26d-49fe-a704-2219c377557c admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:24.379201 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5910dc50-c26d-49fe-a704-2219c377557c admin admin] PATH_INFO: `/v3/users/f8d69b23c59c4d6e8e6ca31951eb1f9c` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:24.380767 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5910dc50-c26d-49fe-a704-2219c377557c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8d69b23c59c4d6e8e6ca31951eb1f9c)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:34:24.384494 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5910dc50-c26d-49fe-a704-2219c377557c admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:34:24.433534 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-5910dc50-c26d-49fe-a704-2219c377557c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8d69b23c59c4d6e8e6ca31951eb1f9c'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:24.442525 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-5910dc50-c26d-49fe-a704-2219c377557c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8d69b23c59c4d6e8e6ca31951eb1f9c'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:24.443354 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-5910dc50-c26d-49fe-a704-2219c377557c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8d69b23c59c4d6e8e6ca31951eb1f9c'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:24.451145 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-5910dc50-c26d-49fe-a704-2219c377557c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8d69b23c59c4d6e8e6ca31951eb1f9c'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:24.464926 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-5910dc50-c26d-49fe-a704-2219c377557c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8d69b23c59c4d6e8e6ca31951eb1f9c'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:24.476223 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1251/2489] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:34:24 2022] DELETE /identity/v3/users/f8d69b23c59c4d6e8e6ca31951eb1f9c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:34:24.480857 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab992f-9ad8-42a2-a3e5-56040b72c3e2 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:24.481364 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab992f-9ad8-42a2-a3e5-56040b72c3e2 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:24.481462 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab992f-9ad8-42a2-a3e5-56040b72c3e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:24.499991 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-70ab992f-9ad8-42a2-a3e5-56040b72c3e2 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:34:24.501179 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-70ab992f-9ad8-42a2-a3e5-56040b72c3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:34:24.568547 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1239/2490] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:34:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 01:34:24.577072 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5910dc50-c26d-49fe-a704-2219c377557c admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:34:24.578732 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-5910dc50-c26d-49fe-a704-2219c377557c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:34:24.644125 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5910dc50-c26d-49fe-a704-2219c377557c admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:34:24.648933 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9dcdcf-aea1-4929-ae31-6933c6737634 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:34:24.665996 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9dcdcf-aea1-4929-ae31-6933c6737634 service neutron] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:24.666563 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9dcdcf-aea1-4929-ae31-6933c6737634 service neutron] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:24.667044 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9dcdcf-aea1-4929-ae31-6933c6737634 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:24.680396 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9dcdcf-aea1-4929-ae31-6933c6737634 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:34:24.682488 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9dcdcf-aea1-4929-ae31-6933c6737634 service neutron] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:34:24.695719 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1252/2491] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:34:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:34:25.078687 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ab992f-9ad8-42a2-a3e5-56040b72c3e2 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:34:25.088947 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-70ab992f-9ad8-42a2-a3e5-56040b72c3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:34:25.104276 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ab992f-9ad8-42a2-a3e5-56040b72c3e2 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:34:25.110160 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00932ebd-9aaa-407f-b57c-472da28347ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:34:25.111309 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00932ebd-9aaa-407f-b57c-472da28347ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:25.111702 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00932ebd-9aaa-407f-b57c-472da28347ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:25.112220 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00932ebd-9aaa-407f-b57c-472da28347ed admin admin] PATH_INFO: `/v3/projects/0e5ae357c6684829bdb79e78a081bbf4` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:25.113481 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00932ebd-9aaa-407f-b57c-472da28347ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e5ae357c6684829bdb79e78a081bbf4)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:34:25.115781 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00932ebd-9aaa-407f-b57c-472da28347ed admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:34:25.189288 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-00932ebd-9aaa-407f-b57c-472da28347ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e5ae357c6684829bdb79e78a081bbf4', 'request_id': 'req-00932ebd-9aaa-407f-b57c-472da28347ed'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:25.203349 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-00932ebd-9aaa-407f-b57c-472da28347ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e5ae357c6684829bdb79e78a081bbf4', 'request_id': 'req-00932ebd-9aaa-407f-b57c-472da28347ed'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:25.213205 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-00932ebd-9aaa-407f-b57c-472da28347ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e5ae357c6684829bdb79e78a081bbf4', 'request_id': 'req-00932ebd-9aaa-407f-b57c-472da28347ed'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:25.240414 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-00932ebd-9aaa-407f-b57c-472da28347ed admin admin] The token cache is being invalidate because project 0e5ae357c6684829bdb79e78a081bbf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:34:25.240754 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-00932ebd-9aaa-407f-b57c-472da28347ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:25.241361 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-00932ebd-9aaa-407f-b57c-472da28347ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:25.242934 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1240/2492] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:34:25 2022] DELETE /identity/v3/projects/0e5ae357c6684829bdb79e78a081bbf4 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:34:25.247705 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9dcdcf-aea1-4929-ae31-6933c6737634 service neutron] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:34:25.263767 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9dcdcf-aea1-4929-ae31-6933c6737634 service neutron] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:34:25.361385 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f518d658-84e8-4603-9b39-14735f6aa50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:34:25.362268 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f518d658-84e8-4603-9b39-14735f6aa50f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:25.362552 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f518d658-84e8-4603-9b39-14735f6aa50f admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:25.362872 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f518d658-84e8-4603-9b39-14735f6aa50f admin admin] PATH_INFO: `/v3/users/ffa4ec79e5934aebb2323d5d5b08f067` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:25.364226 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f518d658-84e8-4603-9b39-14735f6aa50f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffa4ec79e5934aebb2323d5d5b08f067)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:34:25.372049 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f518d658-84e8-4603-9b39-14735f6aa50f admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:34:25.444181 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-f518d658-84e8-4603-9b39-14735f6aa50f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffa4ec79e5934aebb2323d5d5b08f067'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:25.454978 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-f518d658-84e8-4603-9b39-14735f6aa50f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffa4ec79e5934aebb2323d5d5b08f067'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:25.455863 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-f518d658-84e8-4603-9b39-14735f6aa50f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffa4ec79e5934aebb2323d5d5b08f067'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:25.465957 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-f518d658-84e8-4603-9b39-14735f6aa50f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffa4ec79e5934aebb2323d5d5b08f067'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:25.481806 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-f518d658-84e8-4603-9b39-14735f6aa50f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffa4ec79e5934aebb2323d5d5b08f067'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:25.489144 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1253/2493] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:34:25 2022] DELETE /identity/v3/users/ffa4ec79e5934aebb2323d5d5b08f067 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:34:26.196316 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00932ebd-9aaa-407f-b57c-472da28347ed admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:34:26.197798 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-00932ebd-9aaa-407f-b57c-472da28347ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:34:26.229509 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00932ebd-9aaa-407f-b57c-472da28347ed admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:34:26.321971 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933d358a-8773-49f1-bf02-d33ceb8dd56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:34:26.322929 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d358a-8773-49f1-bf02-d33ceb8dd56a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:26.323213 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d358a-8773-49f1-bf02-d33ceb8dd56a admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:26.323488 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d358a-8773-49f1-bf02-d33ceb8dd56a admin admin] PATH_INFO: `/v3/projects/1840f4e9759048b5965c2e62dcea3e32` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:26.324735 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933d358a-8773-49f1-bf02-d33ceb8dd56a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1840f4e9759048b5965c2e62dcea3e32)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:34:26.327904 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933d358a-8773-49f1-bf02-d33ceb8dd56a admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:34:26.403523 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-933d358a-8773-49f1-bf02-d33ceb8dd56a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1840f4e9759048b5965c2e62dcea3e32', 'request_id': 'req-933d358a-8773-49f1-bf02-d33ceb8dd56a'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:26.413857 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-933d358a-8773-49f1-bf02-d33ceb8dd56a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1840f4e9759048b5965c2e62dcea3e32', 'request_id': 'req-933d358a-8773-49f1-bf02-d33ceb8dd56a'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:26.420484 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-933d358a-8773-49f1-bf02-d33ceb8dd56a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1840f4e9759048b5965c2e62dcea3e32', 'request_id': 'req-933d358a-8773-49f1-bf02-d33ceb8dd56a'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:26.436226 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-933d358a-8773-49f1-bf02-d33ceb8dd56a admin admin] The token cache is being invalidate because project 1840f4e9759048b5965c2e62dcea3e32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:34:26.437973 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-933d358a-8773-49f1-bf02-d33ceb8dd56a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:26.438876 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-933d358a-8773-49f1-bf02-d33ceb8dd56a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:26.446226 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1241/2494] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:34:26 2022] DELETE /identity/v3/projects/1840f4e9759048b5965c2e62dcea3e32 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:34:26.446565 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997a7f2-fe56-42eb-b1a3-b188a127c94f None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:26.447078 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997a7f2-fe56-42eb-b1a3-b188a127c94f None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:26.447171 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997a7f2-fe56-42eb-b1a3-b188a127c94f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:26.473635 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-9997a7f2-fe56-42eb-b1a3-b188a127c94f None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:34:26.476725 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-9997a7f2-fe56-42eb-b1a3-b188a127c94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:34:26.589148 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1254/2495] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:34:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 01:34:26.612325 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb00fc0-6ae9-45e2-8f32-1c9f61118bb3 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:26.612610 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb00fc0-6ae9-45e2-8f32-1c9f61118bb3 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:26.612887 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb00fc0-6ae9-45e2-8f32-1c9f61118bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:26.639552 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-9bb00fc0-6ae9-45e2-8f32-1c9f61118bb3 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:34:26.641550 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-9bb00fc0-6ae9-45e2-8f32-1c9f61118bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:34:26.661074 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1242/2496] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:34:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:34:26.661958 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9997a7f2-fe56-42eb-b1a3-b188a127c94f None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:34:26.672702 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9997a7f2-fe56-42eb-b1a3-b188a127c94f None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:34:26.678960 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8331a8-5d31-4611-88f7-d513e0d83daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:34:26.679724 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8331a8-5d31-4611-88f7-d513e0d83daa admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:26.680145 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8331a8-5d31-4611-88f7-d513e0d83daa admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:26.680572 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8331a8-5d31-4611-88f7-d513e0d83daa admin admin] PATH_INFO: `/v3/domains` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:26.681290 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8331a8-5d31-4611-88f7-d513e0d83daa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:34:26.681666 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8331a8-5d31-4611-88f7-d513e0d83daa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:34:26.683654 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8331a8-5d31-4611-88f7-d513e0d83daa admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:34:26.714494 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1255/2497] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Mar 30 01:34:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:34:26.715991 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb00fc0-6ae9-45e2-8f32-1c9f61118bb3 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:34:26.729122 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb00fc0-6ae9-45e2-8f32-1c9f61118bb3 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:34:26.742938 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6c9c79-a6be-4cbe-a6d3-aa6d9cfc6d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:34:26.743855 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c9c79-a6be-4cbe-a6d3-aa6d9cfc6d4e admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:26.744198 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c9c79-a6be-4cbe-a6d3-aa6d9cfc6d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:26.744542 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c9c79-a6be-4cbe-a6d3-aa6d9cfc6d4e admin admin] PATH_INFO: `/v3/projects` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:26.745515 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6c9c79-a6be-4cbe-a6d3-aa6d9cfc6d4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:34:26.748188 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6c9c79-a6be-4cbe-a6d3-aa6d9cfc6d4e admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:34:26.831434 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1243/2498] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:34:26 2022] POST /identity/v3/projects => generated 377 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:34:26.836914 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8331a8-5d31-4611-88f7-d513e0d83daa admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:34:26.895916 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8331a8-5d31-4611-88f7-d513e0d83daa admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:34:27.006280 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d67daa-a6be-46ed-bcf1-4cf542e9a93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:34:27.007720 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d67daa-a6be-46ed-bcf1-4cf542e9a93b admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:27.009498 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d67daa-a6be-46ed-bcf1-4cf542e9a93b admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:27.009858 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d67daa-a6be-46ed-bcf1-4cf542e9a93b admin admin] PATH_INFO: `/v3/users` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:27.010645 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d67daa-a6be-46ed-bcf1-4cf542e9a93b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:34:27.012699 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d67daa-a6be-46ed-bcf1-4cf542e9a93b admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:34:27.039236 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1256/2499] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:34:26 2022] POST /identity/v3/users => generated 289 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:34:27.040631 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6c9c79-a6be-4cbe-a6d3-aa6d9cfc6d4e admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:34:27.058038 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6c9c79-a6be-4cbe-a6d3-aa6d9cfc6d4e admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:34:27.065006 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9915acf0-be64-4244-afd2-108e1afd2033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:34:27.065785 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9915acf0-be64-4244-afd2-108e1afd2033 admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:27.066147 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9915acf0-be64-4244-afd2-108e1afd2033 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:27.066500 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9915acf0-be64-4244-afd2-108e1afd2033 admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:27.067444 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9915acf0-be64-4244-afd2-108e1afd2033 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:34:27.069089 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9915acf0-be64-4244-afd2-108e1afd2033 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:34:27.084482 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1244/2500] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:34:27 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:34:27.086185 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d67daa-a6be-46ed-bcf1-4cf542e9a93b admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:34:27.098396 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d67daa-a6be-46ed-bcf1-4cf542e9a93b admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:34:27.126781 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6400bb-7d1a-48c2-a2c6-b6e4d5c0ff98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:34:27.128838 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6400bb-7d1a-48c2-a2c6-b6e4d5c0ff98 admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:27.129696 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6400bb-7d1a-48c2-a2c6-b6e4d5c0ff98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:27.130763 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6400bb-7d1a-48c2-a2c6-b6e4d5c0ff98 admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:27.132307 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6400bb-7d1a-48c2-a2c6-b6e4d5c0ff98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:34:27.137163 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6400bb-7d1a-48c2-a2c6-b6e4d5c0ff98 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:34:27.153580 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1257/2501] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:34:27 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:34:27.158401 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9915acf0-be64-4244-afd2-108e1afd2033 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:34:27.169503 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9915acf0-be64-4244-afd2-108e1afd2033 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:34:27.176891 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8be312e-ac95-4e87-b071-107aa18b066f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:34:27.177949 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be312e-ac95-4e87-b071-107aa18b066f admin admin] REQUEST_METHOD: `PUT` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:27.178336 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be312e-ac95-4e87-b071-107aa18b066f admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:27.178737 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be312e-ac95-4e87-b071-107aa18b066f admin admin] PATH_INFO: `/v3/projects/b2c23dca3c3f4d32ac5d5b86c29bd2eb/users/c75926d7c4ce45e3b2a720acf83b398e/roles/7185d0cfbcd44502b1613bcfe1b42f6f` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:27.196930 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8be312e-ac95-4e87-b071-107aa18b066f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2c23dca3c3f4d32ac5d5b86c29bd2eb, user_id=c75926d7c4ce45e3b2a720acf83b398e, role_id=7185d0cfbcd44502b1613bcfe1b42f6f)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:34:27.199978 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8be312e-ac95-4e87-b071-107aa18b066f admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:34:27.226807 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1245/2502] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:34:27 2022] PUT /identity/v3/projects/b2c23dca3c3f4d32ac5d5b86c29bd2eb/users/c75926d7c4ce45e3b2a720acf83b398e/roles/7185d0cfbcd44502b1613bcfe1b42f6f => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:34:27.233061 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade895c-be9b-4853-995c-e0e281c9c034 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:27.233349 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade895c-be9b-4853-995c-e0e281c9c034 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:27.234276 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade895c-be9b-4853-995c-e0e281c9c034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:27.268546 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-aade895c-be9b-4853-995c-e0e281c9c034 None None] MFA Rules not processed for user `c75926d7c4ce45e3b2a720acf83b398e`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:34:27.269787 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-aade895c-be9b-4853-995c-e0e281c9c034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:34:27.366965 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1258/2503] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:34:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:34:27.367782 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8be312e-ac95-4e87-b071-107aa18b066f admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:34:27.441041 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8be312e-ac95-4e87-b071-107aa18b066f admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:34:27.445809 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fb4b67-4c21-4a45-84df-725aa5e38ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:34:27.446496 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb4b67-4c21-4a45-84df-725aa5e38ed4 admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:27.446810 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb4b67-4c21-4a45-84df-725aa5e38ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:27.447085 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb4b67-4c21-4a45-84df-725aa5e38ed4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:27.447783 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fb4b67-4c21-4a45-84df-725aa5e38ed4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:34:27.449795 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fb4b67-4c21-4a45-84df-725aa5e38ed4 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:34:27.505460 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1246/2504] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:34:27 2022] POST /identity/v3/projects => generated 375 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:34:27.516700 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aade895c-be9b-4853-995c-e0e281c9c034 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:34:27.535847 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aade895c-be9b-4853-995c-e0e281c9c034 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:34:27.732592 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50fa267-be3f-4913-a02b-c8a7e0b978d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:34:27.733467 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50fa267-be3f-4913-a02b-c8a7e0b978d2 admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:27.735111 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50fa267-be3f-4913-a02b-c8a7e0b978d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:27.735267 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50fa267-be3f-4913-a02b-c8a7e0b978d2 admin admin] PATH_INFO: `/v3/users` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:27.736042 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50fa267-be3f-4913-a02b-c8a7e0b978d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:34:27.738246 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50fa267-be3f-4913-a02b-c8a7e0b978d2 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:34:27.795052 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1259/2505] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:34:27 2022] POST /identity/v3/users => generated 294 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 01:34:27.795287 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fb4b67-4c21-4a45-84df-725aa5e38ed4 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:34:27.810305 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fb4b67-4c21-4a45-84df-725aa5e38ed4 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:34:27.822051 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1120d00a-24be-405e-912f-737c66e2a462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:34:27.823973 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120d00a-24be-405e-912f-737c66e2a462 admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:27.824442 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120d00a-24be-405e-912f-737c66e2a462 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:27.827121 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120d00a-24be-405e-912f-737c66e2a462 admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:27.828217 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1120d00a-24be-405e-912f-737c66e2a462 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:34:27.830043 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1120d00a-24be-405e-912f-737c66e2a462 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:34:27.861934 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50fa267-be3f-4913-a02b-c8a7e0b978d2 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:34:27.869742 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1247/2506] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:34:27 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:34:27.883352 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50fa267-be3f-4913-a02b-c8a7e0b978d2 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:34:27.909091 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244a9e75-380e-4df0-b691-93511ec96ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:34:27.909974 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a9e75-380e-4df0-b691-93511ec96ea8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:27.910255 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a9e75-380e-4df0-b691-93511ec96ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:27.910524 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a9e75-380e-4df0-b691-93511ec96ea8 admin admin] PATH_INFO: `/v3/projects/b8f52f086d054b9b9ffb00eafaf42346/users/acbeda200d994a0b8cfda9116106816c/roles/36909bbf31d04993bb2a9fe587b572dc` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:27.941823 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244a9e75-380e-4df0-b691-93511ec96ea8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8f52f086d054b9b9ffb00eafaf42346, user_id=acbeda200d994a0b8cfda9116106816c, role_id=36909bbf31d04993bb2a9fe587b572dc)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:34:27.952838 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244a9e75-380e-4df0-b691-93511ec96ea8 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:34:27.972660 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1260/2507] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:34:27 2022] PUT /identity/v3/projects/b8f52f086d054b9b9ffb00eafaf42346/users/acbeda200d994a0b8cfda9116106816c/roles/36909bbf31d04993bb2a9fe587b572dc => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:34:27.986125 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1120d00a-24be-405e-912f-737c66e2a462 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:34:28.001136 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1120d00a-24be-405e-912f-737c66e2a462 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:34:28.110644 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ba1cb4-58ac-4f75-b693-659e476a443f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:34:28.111481 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba1cb4-58ac-4f75-b693-659e476a443f admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:28.112328 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba1cb4-58ac-4f75-b693-659e476a443f admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:28.112610 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba1cb4-58ac-4f75-b693-659e476a443f admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:28.113656 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ba1cb4-58ac-4f75-b693-659e476a443f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:34:28.115529 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ba1cb4-58ac-4f75-b693-659e476a443f admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:34:28.148433 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1248/2508] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:34:27 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 01:34:28.152408 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244a9e75-380e-4df0-b691-93511ec96ea8 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:34:28.167317 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244a9e75-380e-4df0-b691-93511ec96ea8 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:34:28.178817 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66988817-0bc5-44a9-945d-14a58646f3eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:34:28.178817 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66988817-0bc5-44a9-945d-14a58646f3eb admin admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:28.178817 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66988817-0bc5-44a9-945d-14a58646f3eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:28.178817 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66988817-0bc5-44a9-945d-14a58646f3eb admin admin] PATH_INFO: `/v3/projects/b8f52f086d054b9b9ffb00eafaf42346/users/acbeda200d994a0b8cfda9116106816c/roles/36909bbf31d04993bb2a9fe587b572dc` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:28.181373 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66988817-0bc5-44a9-945d-14a58646f3eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8f52f086d054b9b9ffb00eafaf42346, user_id=acbeda200d994a0b8cfda9116106816c, role_id=36909bbf31d04993bb2a9fe587b572dc)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:34:28.184620 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66988817-0bc5-44a9-945d-14a58646f3eb admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:34:28.201223 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1261/2509] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:34:28 2022] PUT /identity/v3/projects/b8f52f086d054b9b9ffb00eafaf42346/users/acbeda200d994a0b8cfda9116106816c/roles/36909bbf31d04993bb2a9fe587b572dc => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:34:28.212941 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e040f-35b1-4c01-93ad-807bc4923412 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:28.213536 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e040f-35b1-4c01-93ad-807bc4923412 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:28.213536 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e040f-35b1-4c01-93ad-807bc4923412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:28.246499 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-a22e040f-35b1-4c01-93ad-807bc4923412 None None] MFA Rules not processed for user `acbeda200d994a0b8cfda9116106816c`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:34:28.246499 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-a22e040f-35b1-4c01-93ad-807bc4923412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:34:28.344187 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1249/2510] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:34:28 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:34:28.354519 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66988817-0bc5-44a9-945d-14a58646f3eb admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:34:28.356251 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-66988817-0bc5-44a9-945d-14a58646f3eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:34:28.437882 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66988817-0bc5-44a9-945d-14a58646f3eb admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:34:28.443274 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a892eec-b271-4ddb-a142-3922acc22e93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45219f386f0147b6bd380efe4ab62812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:34:28.444029 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a892eec-b271-4ddb-a142-3922acc22e93 service cinder] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:28.444398 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a892eec-b271-4ddb-a142-3922acc22e93 service cinder] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:28.444662 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a892eec-b271-4ddb-a142-3922acc22e93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:28.535108 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a892eec-b271-4ddb-a142-3922acc22e93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:34:28.536567 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a892eec-b271-4ddb-a142-3922acc22e93 service cinder] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:34:28.547321 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1262/2511] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:34:28 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:34:34.563848 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22e040f-35b1-4c01-93ad-807bc4923412 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:34:34.565331 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-a22e040f-35b1-4c01-93ad-807bc4923412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:34:34.578223 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22e040f-35b1-4c01-93ad-807bc4923412 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:34:34.582216 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ffad51-5594-4e74-a04c-9a0f7a3cd58e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45219f386f0147b6bd380efe4ab62812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:34:34.582914 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ffad51-5594-4e74-a04c-9a0f7a3cd58e service cinder] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:34.583199 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ffad51-5594-4e74-a04c-9a0f7a3cd58e service cinder] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:34.583474 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ffad51-5594-4e74-a04c-9a0f7a3cd58e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:34.592561 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ffad51-5594-4e74-a04c-9a0f7a3cd58e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:34:34.594114 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ffad51-5594-4e74-a04c-9a0f7a3cd58e service cinder] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:34:34.603914 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1250/2512] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:34:34 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:34:44.363663 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac0e71-08e3-4c83-aa7e-9f7827103076 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:44.364177 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac0e71-08e3-4c83-aa7e-9f7827103076 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:44.364280 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac0e71-08e3-4c83-aa7e-9f7827103076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:44.383682 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-89ac0e71-08e3-4c83-aa7e-9f7827103076 None None] MFA Rules not processed for user `0503fdca7f834ef0a81422804dc74812`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:34:44.384894 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-89ac0e71-08e3-4c83-aa7e-9f7827103076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:34:44.439922 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1263/2513] 10.222.0.30 () {58 vars in 967 bytes} [Wed Mar 30 01:34:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:34:44.453432 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ffad51-5594-4e74-a04c-9a0f7a3cd58e service cinder] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:34:44.454889 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-62ffad51-5594-4e74-a04c-9a0f7a3cd58e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:34:44.531923 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ffad51-5594-4e74-a04c-9a0f7a3cd58e service cinder] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:34:44.536915 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10348758-00c4-4441-bd2e-f04028749558 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f16de81dfb4c14b027cd6cd1e6ff2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:34:44.537555 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10348758-00c4-4441-bd2e-f04028749558 service swift] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:44.537836 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10348758-00c4-4441-bd2e-f04028749558 service swift] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:44.538106 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10348758-00c4-4441-bd2e-f04028749558 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:44.546907 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10348758-00c4-4441-bd2e-f04028749558 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:34:44.548547 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10348758-00c4-4441-bd2e-f04028749558 service swift] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:34:44.556702 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1251/2514] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Mar 30 01:34:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 30 01:34:45.011740 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f2414-3134-435d-abf2-05565ce6c57a None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:45.012105 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f2414-3134-435d-abf2-05565ce6c57a None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:45.012474 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f2414-3134-435d-abf2-05565ce6c57a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:45.032834 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-282f2414-3134-435d-abf2-05565ce6c57a None None] MFA Rules not processed for user `0503fdca7f834ef0a81422804dc74812`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:34:45.034142 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-282f2414-3134-435d-abf2-05565ce6c57a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:34:45.041993 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1264/2515] 10.222.0.30 () {58 vars in 967 bytes} [Wed Mar 30 01:34:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:34:45.054650 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10348758-00c4-4441-bd2e-f04028749558 service swift] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:34:45.066194 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10348758-00c4-4441-bd2e-f04028749558 service swift] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:34:45.071535 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af8240b-03d3-4e42-a0e5-b6f2499c78df service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f16de81dfb4c14b027cd6cd1e6ff2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:34:45.072474 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8240b-03d3-4e42-a0e5-b6f2499c78df service swift] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:45.072974 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8240b-03d3-4e42-a0e5-b6f2499c78df service swift] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:45.073512 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8240b-03d3-4e42-a0e5-b6f2499c78df service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:45.083951 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af8240b-03d3-4e42-a0e5-b6f2499c78df service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:34:45.085703 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af8240b-03d3-4e42-a0e5-b6f2499c78df service swift] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:34:45.095529 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1252/2516] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Mar 30 01:34:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 30 01:34:52.429475 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f2414-3134-435d-abf2-05565ce6c57a None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:34:52.430965 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-282f2414-3134-435d-abf2-05565ce6c57a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:34:52.495031 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f2414-3134-435d-abf2-05565ce6c57a None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:34:52.499752 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e57f4b8-a1ef-466e-9733-97ae1df404a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:34:52.500375 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57f4b8-a1ef-466e-9733-97ae1df404a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:52.500651 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57f4b8-a1ef-466e-9733-97ae1df404a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:52.500917 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57f4b8-a1ef-466e-9733-97ae1df404a6 admin admin] PATH_INFO: `/v3/users/7b027a3d344845dca12c585560b50519` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:52.502103 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e57f4b8-a1ef-466e-9733-97ae1df404a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b027a3d344845dca12c585560b50519)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:34:52.504055 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e57f4b8-a1ef-466e-9733-97ae1df404a6 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:34:52.549533 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-6e57f4b8-a1ef-466e-9733-97ae1df404a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b027a3d344845dca12c585560b50519'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:52.556799 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-6e57f4b8-a1ef-466e-9733-97ae1df404a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b027a3d344845dca12c585560b50519'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:52.557579 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-6e57f4b8-a1ef-466e-9733-97ae1df404a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b027a3d344845dca12c585560b50519'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:52.564836 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-6e57f4b8-a1ef-466e-9733-97ae1df404a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b027a3d344845dca12c585560b50519'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:52.575820 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-6e57f4b8-a1ef-466e-9733-97ae1df404a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b027a3d344845dca12c585560b50519'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:52.582066 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1265/2517] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:34:52 2022] DELETE /identity/v3/users/7b027a3d344845dca12c585560b50519 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:34:52.756714 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af8240b-03d3-4e42-a0e5-b6f2499c78df service swift] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:34:52.768028 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af8240b-03d3-4e42-a0e5-b6f2499c78df service swift] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:34:52.823073 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2647e865-f840-43f5-b7e4-e07bbd02722e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:34:52.823935 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647e865-f840-43f5-b7e4-e07bbd02722e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:52.824221 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647e865-f840-43f5-b7e4-e07bbd02722e admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:52.824497 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647e865-f840-43f5-b7e4-e07bbd02722e admin admin] PATH_INFO: `/v3/projects/256d574808e54c9aa1a0242cd5983675` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:52.825679 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2647e865-f840-43f5-b7e4-e07bbd02722e admin admin] RBAC: Authorizing `identity:delete_project(project_id=256d574808e54c9aa1a0242cd5983675)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:34:52.828265 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2647e865-f840-43f5-b7e4-e07bbd02722e admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:34:52.871393 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-2647e865-f840-43f5-b7e4-e07bbd02722e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '256d574808e54c9aa1a0242cd5983675', 'request_id': 'req-2647e865-f840-43f5-b7e4-e07bbd02722e'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:52.878677 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-2647e865-f840-43f5-b7e4-e07bbd02722e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '256d574808e54c9aa1a0242cd5983675', 'request_id': 'req-2647e865-f840-43f5-b7e4-e07bbd02722e'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:52.883926 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-2647e865-f840-43f5-b7e4-e07bbd02722e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '256d574808e54c9aa1a0242cd5983675', 'request_id': 'req-2647e865-f840-43f5-b7e4-e07bbd02722e'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:52.895232 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-2647e865-f840-43f5-b7e4-e07bbd02722e admin admin] The token cache is being invalidate because project 256d574808e54c9aa1a0242cd5983675 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:34:52.895522 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-2647e865-f840-43f5-b7e4-e07bbd02722e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:52.896151 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-2647e865-f840-43f5-b7e4-e07bbd02722e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:52.897668 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1253/2518] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:34:52 2022] DELETE /identity/v3/projects/256d574808e54c9aa1a0242cd5983675 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:34:52.901670 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e57f4b8-a1ef-466e-9733-97ae1df404a6 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:34:52.903168 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-6e57f4b8-a1ef-466e-9733-97ae1df404a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:34:52.917119 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e57f4b8-a1ef-466e-9733-97ae1df404a6 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:34:52.971663 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e28296f-9ef2-497f-aa46-0cef7790c1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:34:52.972781 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e28296f-9ef2-497f-aa46-0cef7790c1b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:52.973073 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e28296f-9ef2-497f-aa46-0cef7790c1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:52.973352 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e28296f-9ef2-497f-aa46-0cef7790c1b7 admin admin] PATH_INFO: `/v3/users/c801bad569f54c9b8876e0a96c9a9061` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:52.974527 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e28296f-9ef2-497f-aa46-0cef7790c1b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c801bad569f54c9b8876e0a96c9a9061)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:34:52.976477 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e28296f-9ef2-497f-aa46-0cef7790c1b7 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:34:53.022132 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-2e28296f-9ef2-497f-aa46-0cef7790c1b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c801bad569f54c9b8876e0a96c9a9061'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:53.028622 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-2e28296f-9ef2-497f-aa46-0cef7790c1b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c801bad569f54c9b8876e0a96c9a9061'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:53.029432 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-2e28296f-9ef2-497f-aa46-0cef7790c1b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c801bad569f54c9b8876e0a96c9a9061'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:53.036494 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-2e28296f-9ef2-497f-aa46-0cef7790c1b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c801bad569f54c9b8876e0a96c9a9061'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:53.047861 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-2e28296f-9ef2-497f-aa46-0cef7790c1b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c801bad569f54c9b8876e0a96c9a9061'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:53.053674 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1266/2519] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:34:52 2022] DELETE /identity/v3/users/c801bad569f54c9b8876e0a96c9a9061 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:34:53.221896 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2647e865-f840-43f5-b7e4-e07bbd02722e admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:34:53.223455 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-2647e865-f840-43f5-b7e4-e07bbd02722e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:34:53.236427 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2647e865-f840-43f5-b7e4-e07bbd02722e admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:34:53.291166 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5660d255-e99d-474b-8822-d0f8f83e2ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:34:53.292025 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5660d255-e99d-474b-8822-d0f8f83e2ace admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:53.292311 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5660d255-e99d-474b-8822-d0f8f83e2ace admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:53.292587 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5660d255-e99d-474b-8822-d0f8f83e2ace admin admin] PATH_INFO: `/v3/projects/86aead422c4f473fb3de442a0f6f6310` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:53.293774 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5660d255-e99d-474b-8822-d0f8f83e2ace admin admin] RBAC: Authorizing `identity:delete_project(project_id=86aead422c4f473fb3de442a0f6f6310)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:34:53.295726 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5660d255-e99d-474b-8822-d0f8f83e2ace admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:34:53.340370 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-5660d255-e99d-474b-8822-d0f8f83e2ace admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86aead422c4f473fb3de442a0f6f6310', 'request_id': 'req-5660d255-e99d-474b-8822-d0f8f83e2ace'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:53.347171 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-5660d255-e99d-474b-8822-d0f8f83e2ace admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86aead422c4f473fb3de442a0f6f6310', 'request_id': 'req-5660d255-e99d-474b-8822-d0f8f83e2ace'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:53.352890 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-5660d255-e99d-474b-8822-d0f8f83e2ace admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86aead422c4f473fb3de442a0f6f6310', 'request_id': 'req-5660d255-e99d-474b-8822-d0f8f83e2ace'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:53.364133 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-5660d255-e99d-474b-8822-d0f8f83e2ace admin admin] The token cache is being invalidate because project 86aead422c4f473fb3de442a0f6f6310 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:34:53.364427 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-5660d255-e99d-474b-8822-d0f8f83e2ace admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:53.365064 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-5660d255-e99d-474b-8822-d0f8f83e2ace admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:53.366594 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1254/2520] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:34:53 2022] DELETE /identity/v3/projects/86aead422c4f473fb3de442a0f6f6310 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:34:53.373252 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30047c2-c125-4f55-b159-0b180680f64a None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:53.373252 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30047c2-c125-4f55-b159-0b180680f64a None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:53.373252 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30047c2-c125-4f55-b159-0b180680f64a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:53.390636 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-c30047c2-c125-4f55-b159-0b180680f64a None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:34:53.391887 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-c30047c2-c125-4f55-b159-0b180680f64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:34:53.451858 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1267/2521] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:34:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:34:53.459698 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa19e8e-097f-40b8-ad67-637e136b7d4f None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:53.459995 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa19e8e-097f-40b8-ad67-637e136b7d4f None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:53.460275 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa19e8e-097f-40b8-ad67-637e136b7d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:53.478229 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-ffa19e8e-097f-40b8-ad67-637e136b7d4f None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:34:53.479458 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-ffa19e8e-097f-40b8-ad67-637e136b7d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:34:53.488091 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1255/2522] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:34:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:34:53.492191 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30047c2-c125-4f55-b159-0b180680f64a None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:34:53.502774 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30047c2-c125-4f55-b159-0b180680f64a None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:34:53.507264 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d39ba89-0e4f-45b1-8105-de7647ba6b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:34:53.507909 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39ba89-0e4f-45b1-8105-de7647ba6b60 admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:53.508190 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39ba89-0e4f-45b1-8105-de7647ba6b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:53.508461 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39ba89-0e4f-45b1-8105-de7647ba6b60 admin admin] PATH_INFO: `/v3/domains` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:53.509177 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d39ba89-0e4f-45b1-8105-de7647ba6b60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:34:53.509479 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d39ba89-0e4f-45b1-8105-de7647ba6b60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:34:53.511100 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d39ba89-0e4f-45b1-8105-de7647ba6b60 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:34:53.522868 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1268/2523] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Mar 30 01:34:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:34:53.527099 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa19e8e-097f-40b8-ad67-637e136b7d4f None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:34:53.536708 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa19e8e-097f-40b8-ad67-637e136b7d4f None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:34:53.541400 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1c0603-1e63-4a56-869d-e80a97f2d892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:34:53.541980 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c0603-1e63-4a56-869d-e80a97f2d892 admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:53.542262 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c0603-1e63-4a56-869d-e80a97f2d892 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:53.542536 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c0603-1e63-4a56-869d-e80a97f2d892 admin admin] PATH_INFO: `/v3/projects` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:53.543252 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1c0603-1e63-4a56-869d-e80a97f2d892 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:34:53.545155 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1c0603-1e63-4a56-869d-e80a97f2d892 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:34:53.581019 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1256/2524] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:34:53 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 01:34:53.585129 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d39ba89-0e4f-45b1-8105-de7647ba6b60 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:34:53.596281 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d39ba89-0e4f-45b1-8105-de7647ba6b60 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:34:53.658129 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4093ec34-0764-4642-949a-a7ebbd46f97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:34:53.658832 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4093ec34-0764-4642-949a-a7ebbd46f97c admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:53.659115 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4093ec34-0764-4642-949a-a7ebbd46f97c admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:53.659387 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4093ec34-0764-4642-949a-a7ebbd46f97c admin admin] PATH_INFO: `/v3/users` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:53.660079 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4093ec34-0764-4642-949a-a7ebbd46f97c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:34:53.662049 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4093ec34-0764-4642-949a-a7ebbd46f97c admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:34:53.684742 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1269/2525] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:34:53 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 01:34:53.688840 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1c0603-1e63-4a56-869d-e80a97f2d892 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:34:53.699031 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1c0603-1e63-4a56-869d-e80a97f2d892 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:34:53.703987 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a31169-c805-455e-9e78-8ccfa42a7317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:34:53.704640 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a31169-c805-455e-9e78-8ccfa42a7317 admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:53.704919 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a31169-c805-455e-9e78-8ccfa42a7317 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:53.705193 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a31169-c805-455e-9e78-8ccfa42a7317 admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:53.705909 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a31169-c805-455e-9e78-8ccfa42a7317 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:34:53.707543 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a31169-c805-455e-9e78-8ccfa42a7317 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:34:53.717608 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1257/2526] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:34:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 01:34:53.722199 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4093ec34-0764-4642-949a-a7ebbd46f97c admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:34:53.731793 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4093ec34-0764-4642-949a-a7ebbd46f97c admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:34:53.737389 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f20609f-cc13-46ea-bf2c-ad3c46bc9ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:34:53.738034 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f20609f-cc13-46ea-bf2c-ad3c46bc9ee6 admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:53.738314 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f20609f-cc13-46ea-bf2c-ad3c46bc9ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:53.738586 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f20609f-cc13-46ea-bf2c-ad3c46bc9ee6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:53.739339 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f20609f-cc13-46ea-bf2c-ad3c46bc9ee6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:34:53.740915 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f20609f-cc13-46ea-bf2c-ad3c46bc9ee6 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:34:53.750572 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1270/2527] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:34:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:34:53.754482 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a31169-c805-455e-9e78-8ccfa42a7317 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:34:53.764124 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a31169-c805-455e-9e78-8ccfa42a7317 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:34:53.768953 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feab6d9-36f2-4623-87e7-4ee5ba743fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:34:53.769877 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feab6d9-36f2-4623-87e7-4ee5ba743fbe admin admin] REQUEST_METHOD: `PUT` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:53.770161 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feab6d9-36f2-4623-87e7-4ee5ba743fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:53.770435 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feab6d9-36f2-4623-87e7-4ee5ba743fbe admin admin] PATH_INFO: `/v3/projects/41e905053f284f86801ebd7f370ff78a/users/bd10fd958b4d420881a837e0403de153/roles/7185d0cfbcd44502b1613bcfe1b42f6f` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:53.785632 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feab6d9-36f2-4623-87e7-4ee5ba743fbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=41e905053f284f86801ebd7f370ff78a, user_id=bd10fd958b4d420881a837e0403de153, role_id=7185d0cfbcd44502b1613bcfe1b42f6f)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:34:53.788309 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feab6d9-36f2-4623-87e7-4ee5ba743fbe admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:34:53.801469 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1258/2528] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:34:53 2022] PUT /identity/v3/projects/41e905053f284f86801ebd7f370ff78a/users/bd10fd958b4d420881a837e0403de153/roles/7185d0cfbcd44502b1613bcfe1b42f6f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:34:53.806392 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73a8fb-f536-4454-a675-5e8897eb2b97 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:53.806684 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73a8fb-f536-4454-a675-5e8897eb2b97 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:53.807000 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73a8fb-f536-4454-a675-5e8897eb2b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:53.824742 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-ed73a8fb-f536-4454-a675-5e8897eb2b97 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:34:53.825931 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-ed73a8fb-f536-4454-a675-5e8897eb2b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:34:53.883373 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1271/2529] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:34:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:34:53.892886 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feab6d9-36f2-4623-87e7-4ee5ba743fbe admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:34:53.894539 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-0feab6d9-36f2-4623-87e7-4ee5ba743fbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:34:53.951576 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feab6d9-36f2-4623-87e7-4ee5ba743fbe admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:34:53.955758 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d2c0f6-b557-4b10-a01a-93d3063a1519 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:34:53.956389 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2c0f6-b557-4b10-a01a-93d3063a1519 service neutron] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:53.956668 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2c0f6-b557-4b10-a01a-93d3063a1519 service neutron] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:53.956936 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2c0f6-b557-4b10-a01a-93d3063a1519 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:53.965780 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d2c0f6-b557-4b10-a01a-93d3063a1519 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:34:53.967223 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d2c0f6-b557-4b10-a01a-93d3063a1519 service neutron] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:34:53.977464 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1259/2530] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:34:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:34:58.035255 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c9ae86-d56b-4fce-a867-9ab91b3720f5 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:58.035881 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c9ae86-d56b-4fce-a867-9ab91b3720f5 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:58.035881 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c9ae86-d56b-4fce-a867-9ab91b3720f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:58.068044 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-72c9ae86-d56b-4fce-a867-9ab91b3720f5 None None] MFA Rules not processed for user `bd10fd958b4d420881a837e0403de153`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:34:58.069744 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-72c9ae86-d56b-4fce-a867-9ab91b3720f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:34:58.141900 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1272/2531] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:34:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:34:58.146496 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d2c0f6-b557-4b10-a01a-93d3063a1519 service neutron] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:34:58.156667 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d2c0f6-b557-4b10-a01a-93d3063a1519 service neutron] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:34:58.161392 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd7f295-34a5-43ba-b7ea-6f5febcd3b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:34:58.162059 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd7f295-34a5-43ba-b7ea-6f5febcd3b54 admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:58.162541 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd7f295-34a5-43ba-b7ea-6f5febcd3b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:58.162859 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd7f295-34a5-43ba-b7ea-6f5febcd3b54 admin admin] PATH_INFO: `/v3/projects` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:58.163573 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd7f295-34a5-43ba-b7ea-6f5febcd3b54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:34:58.165479 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd7f295-34a5-43ba-b7ea-6f5febcd3b54 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:34:58.193122 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1260/2532] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:34:58 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:34:58.197112 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c9ae86-d56b-4fce-a867-9ab91b3720f5 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:34:58.209420 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c9ae86-d56b-4fce-a867-9ab91b3720f5 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:34:58.277436 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916d647b-6144-4c54-b627-2a7aff06e404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:34:58.278137 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d647b-6144-4c54-b627-2a7aff06e404 admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:58.278425 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d647b-6144-4c54-b627-2a7aff06e404 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:58.278732 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d647b-6144-4c54-b627-2a7aff06e404 admin admin] PATH_INFO: `/v3/users` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:58.279775 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916d647b-6144-4c54-b627-2a7aff06e404 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:34:58.281743 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916d647b-6144-4c54-b627-2a7aff06e404 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:34:58.307083 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1273/2533] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:34:58 2022] POST /identity/v3/users => generated 292 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:34:58.310927 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd7f295-34a5-43ba-b7ea-6f5febcd3b54 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:34:58.323619 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd7f295-34a5-43ba-b7ea-6f5febcd3b54 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:34:58.329424 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7138bbe5-29d8-43aa-9ed7-7c0920b6a470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:34:58.330336 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138bbe5-29d8-43aa-9ed7-7c0920b6a470 admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:58.330622 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138bbe5-29d8-43aa-9ed7-7c0920b6a470 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:58.331090 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138bbe5-29d8-43aa-9ed7-7c0920b6a470 admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:58.331863 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7138bbe5-29d8-43aa-9ed7-7c0920b6a470 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:34:58.333543 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7138bbe5-29d8-43aa-9ed7-7c0920b6a470 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:34:58.345998 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1261/2534] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:34:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:34:58.350005 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916d647b-6144-4c54-b627-2a7aff06e404 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:34:58.364659 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916d647b-6144-4c54-b627-2a7aff06e404 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:34:58.369840 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c7dde1-f5e8-45db-98ab-3262aaa16465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:34:58.370974 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c7dde1-f5e8-45db-98ab-3262aaa16465 admin admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:58.371265 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c7dde1-f5e8-45db-98ab-3262aaa16465 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:58.371531 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c7dde1-f5e8-45db-98ab-3262aaa16465 admin admin] PATH_INFO: `/v3/projects/b883cc6c4a874c66b775b02471346e61/users/528cd42356fc4365b95b0d214ff04d48/roles/36909bbf31d04993bb2a9fe587b572dc` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:58.388988 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c7dde1-f5e8-45db-98ab-3262aaa16465 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b883cc6c4a874c66b775b02471346e61, user_id=528cd42356fc4365b95b0d214ff04d48, role_id=36909bbf31d04993bb2a9fe587b572dc)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:34:58.392477 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c7dde1-f5e8-45db-98ab-3262aaa16465 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:34:58.409220 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1274/2535] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:34:58 2022] PUT /identity/v3/projects/b883cc6c4a874c66b775b02471346e61/users/528cd42356fc4365b95b0d214ff04d48/roles/36909bbf31d04993bb2a9fe587b572dc => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:34:58.412954 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7138bbe5-29d8-43aa-9ed7-7c0920b6a470 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:34:58.425397 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7138bbe5-29d8-43aa-9ed7-7c0920b6a470 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:34:58.515540 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c4a21b-7dc0-44d3-91d4-44440c79dd31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:34:58.516233 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c4a21b-7dc0-44d3-91d4-44440c79dd31 admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:58.516504 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c4a21b-7dc0-44d3-91d4-44440c79dd31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:58.516782 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c4a21b-7dc0-44d3-91d4-44440c79dd31 admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:58.517623 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c4a21b-7dc0-44d3-91d4-44440c79dd31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:34:58.519310 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c4a21b-7dc0-44d3-91d4-44440c79dd31 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:34:58.538266 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1262/2536] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:34:58 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 01:34:58.542436 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c7dde1-f5e8-45db-98ab-3262aaa16465 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:34:58.554610 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c7dde1-f5e8-45db-98ab-3262aaa16465 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:34:58.561265 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c50cf9a-32a3-4bc1-a5ad-5acb490d7d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:34:58.561265 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50cf9a-32a3-4bc1-a5ad-5acb490d7d39 admin admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:58.561265 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50cf9a-32a3-4bc1-a5ad-5acb490d7d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:58.563235 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50cf9a-32a3-4bc1-a5ad-5acb490d7d39 admin admin] PATH_INFO: `/v3/projects/b883cc6c4a874c66b775b02471346e61/users/528cd42356fc4365b95b0d214ff04d48/roles/36909bbf31d04993bb2a9fe587b572dc` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:58.566775 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c50cf9a-32a3-4bc1-a5ad-5acb490d7d39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b883cc6c4a874c66b775b02471346e61, user_id=528cd42356fc4365b95b0d214ff04d48, role_id=36909bbf31d04993bb2a9fe587b572dc)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:34:58.570963 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c50cf9a-32a3-4bc1-a5ad-5acb490d7d39 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:34:58.585512 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1275/2537] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:34:58 2022] PUT /identity/v3/projects/b883cc6c4a874c66b775b02471346e61/users/528cd42356fc4365b95b0d214ff04d48/roles/36909bbf31d04993bb2a9fe587b572dc => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:34:58.590784 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c4a21b-7dc0-44d3-91d4-44440c79dd31 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:34:58.593485 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-56c4a21b-7dc0-44d3-91d4-44440c79dd31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:34:58.612995 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c4a21b-7dc0-44d3-91d4-44440c79dd31 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:34:58.741336 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff62676-56dd-4548-84fb-e2f5ac283a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:34:58.742388 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff62676-56dd-4548-84fb-e2f5ac283a71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:58.742939 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff62676-56dd-4548-84fb-e2f5ac283a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:58.743313 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff62676-56dd-4548-84fb-e2f5ac283a71 admin admin] PATH_INFO: `/v3/users/c75926d7c4ce45e3b2a720acf83b398e` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:58.748008 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff62676-56dd-4548-84fb-e2f5ac283a71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c75926d7c4ce45e3b2a720acf83b398e)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:34:58.750837 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff62676-56dd-4548-84fb-e2f5ac283a71 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:34:58.831221 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-fff62676-56dd-4548-84fb-e2f5ac283a71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c75926d7c4ce45e3b2a720acf83b398e'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:58.844357 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-fff62676-56dd-4548-84fb-e2f5ac283a71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c75926d7c4ce45e3b2a720acf83b398e'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:58.851679 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-fff62676-56dd-4548-84fb-e2f5ac283a71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c75926d7c4ce45e3b2a720acf83b398e'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:58.852462 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-fff62676-56dd-4548-84fb-e2f5ac283a71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c75926d7c4ce45e3b2a720acf83b398e'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:58.861432 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-fff62676-56dd-4548-84fb-e2f5ac283a71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c75926d7c4ce45e3b2a720acf83b398e'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:58.867471 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1263/2538] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:34:58 2022] DELETE /identity/v3/users/c75926d7c4ce45e3b2a720acf83b398e => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:34:58.872041 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d41a7b-fc0c-4180-9beb-17f587738b1d None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:58.872333 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d41a7b-fc0c-4180-9beb-17f587738b1d None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:58.872615 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d41a7b-fc0c-4180-9beb-17f587738b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:58.891530 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-22d41a7b-fc0c-4180-9beb-17f587738b1d None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:34:58.892759 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-22d41a7b-fc0c-4180-9beb-17f587738b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:34:58.960780 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1276/2539] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:34:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:34:58.976875 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff62676-56dd-4548-84fb-e2f5ac283a71 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:34:58.981579 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-fff62676-56dd-4548-84fb-e2f5ac283a71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:34:59.051762 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff62676-56dd-4548-84fb-e2f5ac283a71 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:34:59.055543 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71890ddd-e5d0-42d8-943b-da6959041aed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:34:59.056490 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71890ddd-e5d0-42d8-943b-da6959041aed service neutron] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:59.056490 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71890ddd-e5d0-42d8-943b-da6959041aed service neutron] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:59.056843 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71890ddd-e5d0-42d8-943b-da6959041aed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:59.072434 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71890ddd-e5d0-42d8-943b-da6959041aed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:34:59.074626 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71890ddd-e5d0-42d8-943b-da6959041aed service neutron] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:34:59.086686 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1264/2540] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:34:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:34:59.545314 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d41a7b-fc0c-4180-9beb-17f587738b1d None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:34:59.548606 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-22d41a7b-fc0c-4180-9beb-17f587738b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:34:59.564246 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d41a7b-fc0c-4180-9beb-17f587738b1d None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:34:59.569443 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a71b3bb-511c-4b43-8d2a-b764b6a2d770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:34:59.570527 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a71b3bb-511c-4b43-8d2a-b764b6a2d770 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:59.571055 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a71b3bb-511c-4b43-8d2a-b764b6a2d770 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:59.571510 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a71b3bb-511c-4b43-8d2a-b764b6a2d770 admin admin] PATH_INFO: `/v3/projects/b2c23dca3c3f4d32ac5d5b86c29bd2eb` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:59.573340 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a71b3bb-511c-4b43-8d2a-b764b6a2d770 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2c23dca3c3f4d32ac5d5b86c29bd2eb)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:34:59.575511 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a71b3bb-511c-4b43-8d2a-b764b6a2d770 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:34:59.649626 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-8a71b3bb-511c-4b43-8d2a-b764b6a2d770 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2c23dca3c3f4d32ac5d5b86c29bd2eb', 'request_id': 'req-8a71b3bb-511c-4b43-8d2a-b764b6a2d770'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:59.660621 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-8a71b3bb-511c-4b43-8d2a-b764b6a2d770 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2c23dca3c3f4d32ac5d5b86c29bd2eb', 'request_id': 'req-8a71b3bb-511c-4b43-8d2a-b764b6a2d770'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:59.669990 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-8a71b3bb-511c-4b43-8d2a-b764b6a2d770 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2c23dca3c3f4d32ac5d5b86c29bd2eb', 'request_id': 'req-8a71b3bb-511c-4b43-8d2a-b764b6a2d770'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:59.684160 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-8a71b3bb-511c-4b43-8d2a-b764b6a2d770 admin admin] The token cache is being invalidate because project b2c23dca3c3f4d32ac5d5b86c29bd2eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:34:59.684449 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-8a71b3bb-511c-4b43-8d2a-b764b6a2d770 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:59.685111 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-8a71b3bb-511c-4b43-8d2a-b764b6a2d770 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:59.687905 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1277/2541] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:34:59 2022] DELETE /identity/v3/projects/b2c23dca3c3f4d32ac5d5b86c29bd2eb => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:34:59.691824 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71890ddd-e5d0-42d8-943b-da6959041aed service neutron] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:34:59.701798 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71890ddd-e5d0-42d8-943b-da6959041aed service neutron] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:34:59.762153 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9375ce32-451f-465e-8dfa-fee5333442e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:34:59.763165 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375ce32-451f-465e-8dfa-fee5333442e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:34:59.763515 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375ce32-451f-465e-8dfa-fee5333442e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:34:59.763855 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375ce32-451f-465e-8dfa-fee5333442e3 admin admin] PATH_INFO: `/v3/users/acbeda200d994a0b8cfda9116106816c` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:34:59.765791 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9375ce32-451f-465e-8dfa-fee5333442e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acbeda200d994a0b8cfda9116106816c)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:34:59.767879 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9375ce32-451f-465e-8dfa-fee5333442e3 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:34:59.837526 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-9375ce32-451f-465e-8dfa-fee5333442e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acbeda200d994a0b8cfda9116106816c'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:59.853261 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-9375ce32-451f-465e-8dfa-fee5333442e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acbeda200d994a0b8cfda9116106816c'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:59.861973 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-9375ce32-451f-465e-8dfa-fee5333442e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acbeda200d994a0b8cfda9116106816c'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:59.863548 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-9375ce32-451f-465e-8dfa-fee5333442e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acbeda200d994a0b8cfda9116106816c'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:59.871276 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-9375ce32-451f-465e-8dfa-fee5333442e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acbeda200d994a0b8cfda9116106816c'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:34:59.878791 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1265/2542] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:34:59 2022] DELETE /identity/v3/users/acbeda200d994a0b8cfda9116106816c => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:35:00.278291 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a71b3bb-511c-4b43-8d2a-b764b6a2d770 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:00.279961 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-8a71b3bb-511c-4b43-8d2a-b764b6a2d770 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:00.300339 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a71b3bb-511c-4b43-8d2a-b764b6a2d770 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:00.362797 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf7504a-1dcb-4f2f-ae39-a6961225c89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:00.363823 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7504a-1dcb-4f2f-ae39-a6961225c89a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:00.364116 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7504a-1dcb-4f2f-ae39-a6961225c89a admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:00.364398 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7504a-1dcb-4f2f-ae39-a6961225c89a admin admin] PATH_INFO: `/v3/projects/b8f52f086d054b9b9ffb00eafaf42346` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:00.365627 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf7504a-1dcb-4f2f-ae39-a6961225c89a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8f52f086d054b9b9ffb00eafaf42346)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:00.367813 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf7504a-1dcb-4f2f-ae39-a6961225c89a admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:00.431883 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-4bf7504a-1dcb-4f2f-ae39-a6961225c89a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8f52f086d054b9b9ffb00eafaf42346', 'request_id': 'req-4bf7504a-1dcb-4f2f-ae39-a6961225c89a'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:00.438985 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-4bf7504a-1dcb-4f2f-ae39-a6961225c89a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8f52f086d054b9b9ffb00eafaf42346', 'request_id': 'req-4bf7504a-1dcb-4f2f-ae39-a6961225c89a'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:00.450082 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-4bf7504a-1dcb-4f2f-ae39-a6961225c89a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8f52f086d054b9b9ffb00eafaf42346', 'request_id': 'req-4bf7504a-1dcb-4f2f-ae39-a6961225c89a'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:00.464594 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-4bf7504a-1dcb-4f2f-ae39-a6961225c89a admin admin] The token cache is being invalidate because project b8f52f086d054b9b9ffb00eafaf42346 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:35:00.465290 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-4bf7504a-1dcb-4f2f-ae39-a6961225c89a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:00.466226 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-4bf7504a-1dcb-4f2f-ae39-a6961225c89a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:00.469653 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1278/2543] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:35:00 2022] DELETE /identity/v3/projects/b8f52f086d054b9b9ffb00eafaf42346 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:35:00.475044 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2344a76-8501-4083-9846-83f55772c7be None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:00.475705 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2344a76-8501-4083-9846-83f55772c7be None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:00.476199 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2344a76-8501-4083-9846-83f55772c7be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:00.500991 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-c2344a76-8501-4083-9846-83f55772c7be None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:35:00.502468 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-c2344a76-8501-4083-9846-83f55772c7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:00.578489 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1266/2544] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:35:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:35:00.584312 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f2f46-358b-43e3-856b-a16144053ead None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:00.584888 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f2f46-358b-43e3-856b-a16144053ead None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:00.584888 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f2f46-358b-43e3-856b-a16144053ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:00.606360 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-c34f2f46-358b-43e3-856b-a16144053ead None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:35:00.607760 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-c34f2f46-358b-43e3-856b-a16144053ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:00.619818 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1279/2545] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:35:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 01:35:00.624894 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2344a76-8501-4083-9846-83f55772c7be None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:00.637059 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2344a76-8501-4083-9846-83f55772c7be None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:00.645401 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ce3278-7dbb-40a0-9030-9f65ddc4c2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:00.646201 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce3278-7dbb-40a0-9030-9f65ddc4c2ce admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:00.646695 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce3278-7dbb-40a0-9030-9f65ddc4c2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:00.647001 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce3278-7dbb-40a0-9030-9f65ddc4c2ce admin admin] PATH_INFO: `/v3/domains` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:00.647874 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ce3278-7dbb-40a0-9030-9f65ddc4c2ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:35:00.648187 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ce3278-7dbb-40a0-9030-9f65ddc4c2ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:00.655051 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ce3278-7dbb-40a0-9030-9f65ddc4c2ce admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:00.673041 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34f2f46-358b-43e3-856b-a16144053ead None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:00.673345 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1267/2546] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Mar 30 01:35:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:35:00.684706 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34f2f46-358b-43e3-856b-a16144053ead None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:00.691218 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378f8d33-e11c-4280-a522-0ebe1dd18c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:00.691899 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f8d33-e11c-4280-a522-0ebe1dd18c0a admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:00.692189 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f8d33-e11c-4280-a522-0ebe1dd18c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:00.692463 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f8d33-e11c-4280-a522-0ebe1dd18c0a admin admin] PATH_INFO: `/v3/projects` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:00.693544 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378f8d33-e11c-4280-a522-0ebe1dd18c0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:00.695557 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378f8d33-e11c-4280-a522-0ebe1dd18c0a admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:00.729477 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1280/2547] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:35:00 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:35:00.733868 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ce3278-7dbb-40a0-9030-9f65ddc4c2ce admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:00.746379 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ce3278-7dbb-40a0-9030-9f65ddc4c2ce admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:00.834059 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71e66e1-f90b-4b54-8909-02a01b72f4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:00.834841 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e66e1-f90b-4b54-8909-02a01b72f4e1 admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:00.835473 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e66e1-f90b-4b54-8909-02a01b72f4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:00.835908 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e66e1-f90b-4b54-8909-02a01b72f4e1 admin admin] PATH_INFO: `/v3/users` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:00.836831 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71e66e1-f90b-4b54-8909-02a01b72f4e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:00.839664 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71e66e1-f90b-4b54-8909-02a01b72f4e1 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:00.866890 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1268/2548] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:35:00 2022] POST /identity/v3/users => generated 293 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 01:35:00.873373 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378f8d33-e11c-4280-a522-0ebe1dd18c0a admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:00.886910 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378f8d33-e11c-4280-a522-0ebe1dd18c0a admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:00.898360 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9505bcdc-3b6c-42de-b23b-66e042fb374c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:00.899085 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9505bcdc-3b6c-42de-b23b-66e042fb374c admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:00.899272 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9505bcdc-3b6c-42de-b23b-66e042fb374c admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:00.899855 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9505bcdc-3b6c-42de-b23b-66e042fb374c admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:00.900807 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9505bcdc-3b6c-42de-b23b-66e042fb374c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:00.906745 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9505bcdc-3b6c-42de-b23b-66e042fb374c admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:00.931660 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1281/2549] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:35:00 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 01:35:00.935973 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71e66e1-f90b-4b54-8909-02a01b72f4e1 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:00.959390 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71e66e1-f90b-4b54-8909-02a01b72f4e1 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:00.967689 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cab6afa-198e-4465-b533-c9706b1e6f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:00.969385 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab6afa-198e-4465-b533-c9706b1e6f5a admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:00.969837 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab6afa-198e-4465-b533-c9706b1e6f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:00.970304 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab6afa-198e-4465-b533-c9706b1e6f5a admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:00.971371 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cab6afa-198e-4465-b533-c9706b1e6f5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:00.974980 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cab6afa-198e-4465-b533-c9706b1e6f5a admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:00.991207 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1269/2550] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:35:00 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 01:35:00.995445 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9505bcdc-3b6c-42de-b23b-66e042fb374c admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:01.014388 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9505bcdc-3b6c-42de-b23b-66e042fb374c admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:01.022745 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90512cae-c2d0-4157-bf2a-b09824f0de1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:01.023800 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90512cae-c2d0-4157-bf2a-b09824f0de1c admin admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:01.024151 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90512cae-c2d0-4157-bf2a-b09824f0de1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:01.024501 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90512cae-c2d0-4157-bf2a-b09824f0de1c admin admin] PATH_INFO: `/v3/projects/2dabdc65d95349b280fe355240f1aaf3/users/883e03cc57964e4fb312ac03b356c8df/roles/7185d0cfbcd44502b1613bcfe1b42f6f` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:01.042270 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90512cae-c2d0-4157-bf2a-b09824f0de1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dabdc65d95349b280fe355240f1aaf3, user_id=883e03cc57964e4fb312ac03b356c8df, role_id=7185d0cfbcd44502b1613bcfe1b42f6f)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:01.045330 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90512cae-c2d0-4157-bf2a-b09824f0de1c admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:01.071484 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1282/2551] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:35:00 2022] PUT /identity/v3/projects/2dabdc65d95349b280fe355240f1aaf3/users/883e03cc57964e4fb312ac03b356c8df/roles/7185d0cfbcd44502b1613bcfe1b42f6f => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:35:01.084191 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c74171-3142-4a2a-bf72-68b9584f7104 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:01.084735 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c74171-3142-4a2a-bf72-68b9584f7104 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:01.085098 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c74171-3142-4a2a-bf72-68b9584f7104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:01.126285 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-85c74171-3142-4a2a-bf72-68b9584f7104 None None] MFA Rules not processed for user `883e03cc57964e4fb312ac03b356c8df`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:35:01.127868 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-85c74171-3142-4a2a-bf72-68b9584f7104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:01.222063 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1270/2552] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:35:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:35:01.226555 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90512cae-c2d0-4157-bf2a-b09824f0de1c admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:01.315062 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90512cae-c2d0-4157-bf2a-b09824f0de1c admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:01.322028 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e40c80-071c-4a2a-94b2-ac0e4fdf00fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:01.322908 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e40c80-071c-4a2a-94b2-ac0e4fdf00fa admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:01.323184 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e40c80-071c-4a2a-94b2-ac0e4fdf00fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:01.324046 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e40c80-071c-4a2a-94b2-ac0e4fdf00fa admin admin] PATH_INFO: `/v3/projects` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:01.324192 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e40c80-071c-4a2a-94b2-ac0e4fdf00fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:01.326105 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e40c80-071c-4a2a-94b2-ac0e4fdf00fa admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:01.389259 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1283/2553] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:35:01 2022] POST /identity/v3/projects => generated 387 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:35:01.394533 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c74171-3142-4a2a-bf72-68b9584f7104 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:01.425295 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c74171-3142-4a2a-bf72-68b9584f7104 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:01.538553 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b71282-a24d-466f-96f7-7e09e1769221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:01.539397 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b71282-a24d-466f-96f7-7e09e1769221 admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:01.539589 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b71282-a24d-466f-96f7-7e09e1769221 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:01.539861 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b71282-a24d-466f-96f7-7e09e1769221 admin admin] PATH_INFO: `/v3/users` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:01.540562 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b71282-a24d-466f-96f7-7e09e1769221 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:01.542518 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b71282-a24d-466f-96f7-7e09e1769221 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:01.567879 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1271/2554] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:35:01 2022] POST /identity/v3/users => generated 300 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:35:01.569516 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e40c80-071c-4a2a-94b2-ac0e4fdf00fa admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:01.580902 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e40c80-071c-4a2a-94b2-ac0e4fdf00fa admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:01.586071 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8267a6-eb76-41ce-be2e-10d12c7177a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:01.587559 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8267a6-eb76-41ce-be2e-10d12c7177a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:01.587945 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8267a6-eb76-41ce-be2e-10d12c7177a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:01.588275 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8267a6-eb76-41ce-be2e-10d12c7177a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:01.589066 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8267a6-eb76-41ce-be2e-10d12c7177a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:01.590941 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8267a6-eb76-41ce-be2e-10d12c7177a2 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:01.601386 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1284/2555] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:35:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:35:01.605579 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b71282-a24d-466f-96f7-7e09e1769221 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:01.621697 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b71282-a24d-466f-96f7-7e09e1769221 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:01.629059 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8a768f-dc62-4e5d-b59b-02b18edbf123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:01.630355 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a768f-dc62-4e5d-b59b-02b18edbf123 admin admin] REQUEST_METHOD: `PUT` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:01.630846 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a768f-dc62-4e5d-b59b-02b18edbf123 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:01.631125 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a768f-dc62-4e5d-b59b-02b18edbf123 admin admin] PATH_INFO: `/v3/projects/afd2ed7cfe4241319800eb86b5ec6f2a/users/2afb2d63413f41a3b3d82dc2dc3e9a4b/roles/36909bbf31d04993bb2a9fe587b572dc` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:01.656799 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8a768f-dc62-4e5d-b59b-02b18edbf123 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afd2ed7cfe4241319800eb86b5ec6f2a, user_id=2afb2d63413f41a3b3d82dc2dc3e9a4b, role_id=36909bbf31d04993bb2a9fe587b572dc)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:01.659927 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8a768f-dc62-4e5d-b59b-02b18edbf123 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:01.680550 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1272/2556] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:35:01 2022] PUT /identity/v3/projects/afd2ed7cfe4241319800eb86b5ec6f2a/users/2afb2d63413f41a3b3d82dc2dc3e9a4b/roles/36909bbf31d04993bb2a9fe587b572dc => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:35:01.684730 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8267a6-eb76-41ce-be2e-10d12c7177a2 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:01.699332 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8267a6-eb76-41ce-be2e-10d12c7177a2 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:01.770362 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9317ed16-3064-4a9c-bc04-7d75a4819a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:01.771363 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317ed16-3064-4a9c-bc04-7d75a4819a85 admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:01.771831 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317ed16-3064-4a9c-bc04-7d75a4819a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:01.772280 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317ed16-3064-4a9c-bc04-7d75a4819a85 admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:01.773334 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9317ed16-3064-4a9c-bc04-7d75a4819a85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:01.775124 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9317ed16-3064-4a9c-bc04-7d75a4819a85 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:01.789811 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1285/2557] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:35:01 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:35:01.793869 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8a768f-dc62-4e5d-b59b-02b18edbf123 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:01.812837 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8a768f-dc62-4e5d-b59b-02b18edbf123 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:01.821024 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e006a81-36f6-400d-9861-e259778d06d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:01.822212 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e006a81-36f6-400d-9861-e259778d06d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:01.822862 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e006a81-36f6-400d-9861-e259778d06d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:01.823821 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e006a81-36f6-400d-9861-e259778d06d1 admin admin] PATH_INFO: `/v3/projects/afd2ed7cfe4241319800eb86b5ec6f2a/users/2afb2d63413f41a3b3d82dc2dc3e9a4b/roles/36909bbf31d04993bb2a9fe587b572dc` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:01.827833 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e006a81-36f6-400d-9861-e259778d06d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afd2ed7cfe4241319800eb86b5ec6f2a, user_id=2afb2d63413f41a3b3d82dc2dc3e9a4b, role_id=36909bbf31d04993bb2a9fe587b572dc)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:01.831987 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e006a81-36f6-400d-9861-e259778d06d1 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:01.849210 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1273/2558] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:35:01 2022] PUT /identity/v3/projects/afd2ed7cfe4241319800eb86b5ec6f2a/users/2afb2d63413f41a3b3d82dc2dc3e9a4b/roles/36909bbf31d04993bb2a9fe587b572dc => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:35:01.860000 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562299cb-842f-4315-8446-c996191b4504 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:01.860283 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562299cb-842f-4315-8446-c996191b4504 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:01.860764 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562299cb-842f-4315-8446-c996191b4504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:01.911400 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-562299cb-842f-4315-8446-c996191b4504 None None] MFA Rules not processed for user `2afb2d63413f41a3b3d82dc2dc3e9a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:35:01.917363 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-562299cb-842f-4315-8446-c996191b4504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:02.129355 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1286/2559] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:35:01 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:35:02.143768 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e006a81-36f6-400d-9861-e259778d06d1 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:02.145788 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-7e006a81-36f6-400d-9861-e259778d06d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:02.298920 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e006a81-36f6-400d-9861-e259778d06d1 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:02.312684 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c43de3-0cce-41bc-b870-fcf4045ee52c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45219f386f0147b6bd380efe4ab62812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:02.313570 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c43de3-0cce-41bc-b870-fcf4045ee52c service cinder] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:02.315042 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c43de3-0cce-41bc-b870-fcf4045ee52c service cinder] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:02.315963 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c43de3-0cce-41bc-b870-fcf4045ee52c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:02.341122 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c43de3-0cce-41bc-b870-fcf4045ee52c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:02.343505 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c43de3-0cce-41bc-b870-fcf4045ee52c service cinder] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:02.363872 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1274/2560] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:35:02 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:35:02.462679 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562299cb-842f-4315-8446-c996191b4504 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:02.598518 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562299cb-842f-4315-8446-c996191b4504 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:02.605151 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12236a94-05e5-4f58-8736-59080d5098f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:02.606583 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12236a94-05e5-4f58-8736-59080d5098f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:02.607253 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12236a94-05e5-4f58-8736-59080d5098f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:02.607760 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12236a94-05e5-4f58-8736-59080d5098f2 admin admin] PATH_INFO: `/v3/users/883e03cc57964e4fb312ac03b356c8df` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:02.609591 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12236a94-05e5-4f58-8736-59080d5098f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=883e03cc57964e4fb312ac03b356c8df)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:02.611983 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12236a94-05e5-4f58-8736-59080d5098f2 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:02.716368 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-12236a94-05e5-4f58-8736-59080d5098f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '883e03cc57964e4fb312ac03b356c8df'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:02.737278 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-12236a94-05e5-4f58-8736-59080d5098f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '883e03cc57964e4fb312ac03b356c8df'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:02.738183 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-12236a94-05e5-4f58-8736-59080d5098f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '883e03cc57964e4fb312ac03b356c8df'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:02.756196 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-12236a94-05e5-4f58-8736-59080d5098f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '883e03cc57964e4fb312ac03b356c8df'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:02.774003 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-12236a94-05e5-4f58-8736-59080d5098f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '883e03cc57964e4fb312ac03b356c8df'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:02.781056 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1287/2561] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:35:02 2022] DELETE /identity/v3/users/883e03cc57964e4fb312ac03b356c8df => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:35:02.786028 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b716a-b329-4563-8a2e-2702f6bcc97d None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:02.786028 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b716a-b329-4563-8a2e-2702f6bcc97d None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:02.786453 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b716a-b329-4563-8a2e-2702f6bcc97d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:02.809956 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-e47b716a-b329-4563-8a2e-2702f6bcc97d None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:35:02.811873 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-e47b716a-b329-4563-8a2e-2702f6bcc97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:02.903120 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1275/2562] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:35:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:35:02.914434 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12236a94-05e5-4f58-8736-59080d5098f2 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:02.916718 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-12236a94-05e5-4f58-8736-59080d5098f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:03.024173 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12236a94-05e5-4f58-8736-59080d5098f2 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:03.031294 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ece028f-cc75-4512-9b7c-e4cc68f6c835 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:03.033102 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ece028f-cc75-4512-9b7c-e4cc68f6c835 service neutron] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:03.033600 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ece028f-cc75-4512-9b7c-e4cc68f6c835 service neutron] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:03.033818 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ece028f-cc75-4512-9b7c-e4cc68f6c835 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:03.052505 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ece028f-cc75-4512-9b7c-e4cc68f6c835 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:03.054325 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ece028f-cc75-4512-9b7c-e4cc68f6c835 service neutron] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:03.085073 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1288/2563] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:35:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:35:03.598815 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b716a-b329-4563-8a2e-2702f6bcc97d None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:03.601042 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-e47b716a-b329-4563-8a2e-2702f6bcc97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:03.626456 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b716a-b329-4563-8a2e-2702f6bcc97d None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:03.643404 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1671ae8-e05d-4a44-82dd-269e94592e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:03.645473 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1671ae8-e05d-4a44-82dd-269e94592e52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:03.645966 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1671ae8-e05d-4a44-82dd-269e94592e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:03.646861 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1671ae8-e05d-4a44-82dd-269e94592e52 admin admin] PATH_INFO: `/v3/projects/2dabdc65d95349b280fe355240f1aaf3` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:03.649045 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1671ae8-e05d-4a44-82dd-269e94592e52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2dabdc65d95349b280fe355240f1aaf3)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:03.658183 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1671ae8-e05d-4a44-82dd-269e94592e52 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:03.756103 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-c1671ae8-e05d-4a44-82dd-269e94592e52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2dabdc65d95349b280fe355240f1aaf3', 'request_id': 'req-c1671ae8-e05d-4a44-82dd-269e94592e52'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:03.770877 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-c1671ae8-e05d-4a44-82dd-269e94592e52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2dabdc65d95349b280fe355240f1aaf3', 'request_id': 'req-c1671ae8-e05d-4a44-82dd-269e94592e52'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:03.783351 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-c1671ae8-e05d-4a44-82dd-269e94592e52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2dabdc65d95349b280fe355240f1aaf3', 'request_id': 'req-c1671ae8-e05d-4a44-82dd-269e94592e52'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:03.808246 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-c1671ae8-e05d-4a44-82dd-269e94592e52 admin admin] The token cache is being invalidate because project 2dabdc65d95349b280fe355240f1aaf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:35:03.808761 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-c1671ae8-e05d-4a44-82dd-269e94592e52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:03.809697 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-c1671ae8-e05d-4a44-82dd-269e94592e52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:03.819226 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1276/2564] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:35:03 2022] DELETE /identity/v3/projects/2dabdc65d95349b280fe355240f1aaf3 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:35:03.824559 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ece028f-cc75-4512-9b7c-e4cc68f6c835 service neutron] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:03.855646 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ece028f-cc75-4512-9b7c-e4cc68f6c835 service neutron] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:03.996304 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9fa2ee-0d43-41b6-b2fc-6ef194541e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:03.997975 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9fa2ee-0d43-41b6-b2fc-6ef194541e72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:03.998269 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9fa2ee-0d43-41b6-b2fc-6ef194541e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:03.999118 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9fa2ee-0d43-41b6-b2fc-6ef194541e72 admin admin] PATH_INFO: `/v3/users/2afb2d63413f41a3b3d82dc2dc3e9a4b` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:04.000550 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9fa2ee-0d43-41b6-b2fc-6ef194541e72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2afb2d63413f41a3b3d82dc2dc3e9a4b)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:04.002550 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9fa2ee-0d43-41b6-b2fc-6ef194541e72 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:04.079397 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-ef9fa2ee-0d43-41b6-b2fc-6ef194541e72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2afb2d63413f41a3b3d82dc2dc3e9a4b'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:04.095269 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-ef9fa2ee-0d43-41b6-b2fc-6ef194541e72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2afb2d63413f41a3b3d82dc2dc3e9a4b'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:04.096056 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-ef9fa2ee-0d43-41b6-b2fc-6ef194541e72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2afb2d63413f41a3b3d82dc2dc3e9a4b'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:04.111587 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-ef9fa2ee-0d43-41b6-b2fc-6ef194541e72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2afb2d63413f41a3b3d82dc2dc3e9a4b'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:04.132721 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-ef9fa2ee-0d43-41b6-b2fc-6ef194541e72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2afb2d63413f41a3b3d82dc2dc3e9a4b'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:04.140378 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1289/2565] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:35:03 2022] DELETE /identity/v3/users/2afb2d63413f41a3b3d82dc2dc3e9a4b => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:35:04.616886 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1671ae8-e05d-4a44-82dd-269e94592e52 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:04.622108 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-c1671ae8-e05d-4a44-82dd-269e94592e52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:04.644387 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1671ae8-e05d-4a44-82dd-269e94592e52 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:04.730437 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb6bc9-2c46-4cb9-817d-c45a8fe59bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:04.731348 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb6bc9-2c46-4cb9-817d-c45a8fe59bfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:04.731631 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb6bc9-2c46-4cb9-817d-c45a8fe59bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:04.731902 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb6bc9-2c46-4cb9-817d-c45a8fe59bfb admin admin] PATH_INFO: `/v3/projects/afd2ed7cfe4241319800eb86b5ec6f2a` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:04.733885 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fb6bc9-2c46-4cb9-817d-c45a8fe59bfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=afd2ed7cfe4241319800eb86b5ec6f2a)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:04.736197 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fb6bc9-2c46-4cb9-817d-c45a8fe59bfb admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:04.799144 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-64fb6bc9-2c46-4cb9-817d-c45a8fe59bfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afd2ed7cfe4241319800eb86b5ec6f2a', 'request_id': 'req-64fb6bc9-2c46-4cb9-817d-c45a8fe59bfb'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:04.809722 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-64fb6bc9-2c46-4cb9-817d-c45a8fe59bfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afd2ed7cfe4241319800eb86b5ec6f2a', 'request_id': 'req-64fb6bc9-2c46-4cb9-817d-c45a8fe59bfb'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:04.817468 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-64fb6bc9-2c46-4cb9-817d-c45a8fe59bfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afd2ed7cfe4241319800eb86b5ec6f2a', 'request_id': 'req-64fb6bc9-2c46-4cb9-817d-c45a8fe59bfb'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:04.819321 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28379e8-e659-4292-9261-6bc45d8ba762 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:04.819621 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28379e8-e659-4292-9261-6bc45d8ba762 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:04.819905 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28379e8-e659-4292-9261-6bc45d8ba762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:04.833026 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-64fb6bc9-2c46-4cb9-817d-c45a8fe59bfb admin admin] The token cache is being invalidate because project afd2ed7cfe4241319800eb86b5ec6f2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:35:04.833591 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-64fb6bc9-2c46-4cb9-817d-c45a8fe59bfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:04.834137 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-64fb6bc9-2c46-4cb9-817d-c45a8fe59bfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:04.835978 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1277/2566] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:35:04 2022] DELETE /identity/v3/projects/afd2ed7cfe4241319800eb86b5ec6f2a => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:35:04.841563 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ae0dc-322a-4998-a008-0f08c40339c1 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:04.842102 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ae0dc-322a-4998-a008-0f08c40339c1 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:04.842392 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ae0dc-322a-4998-a008-0f08c40339c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:04.857990 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-b28379e8-e659-4292-9261-6bc45d8ba762 None None] MFA Rules not processed for user `528cd42356fc4365b95b0d214ff04d48`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:35:04.859587 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-b28379e8-e659-4292-9261-6bc45d8ba762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:04.862124 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-7e6ae0dc-322a-4998-a008-0f08c40339c1 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:35:04.863358 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-7e6ae0dc-322a-4998-a008-0f08c40339c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:04.927842 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1278/2567] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:35:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:35:04.935937 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285d82e-e1ae-4d60-ba5d-4882f5414226 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:04.940948 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1290/2568] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:35:04 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 01:35:04.941136 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285d82e-e1ae-4d60-ba5d-4882f5414226 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:04.941136 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285d82e-e1ae-4d60-ba5d-4882f5414226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:04.948317 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28379e8-e659-4292-9261-6bc45d8ba762 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:04.949967 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-b28379e8-e659-4292-9261-6bc45d8ba762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:04.965798 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-e285d82e-e1ae-4d60-ba5d-4882f5414226 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:35:04.968241 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-e285d82e-e1ae-4d60-ba5d-4882f5414226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:04.978382 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1279/2569] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:35:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:35:04.982543 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e285d82e-e1ae-4d60-ba5d-4882f5414226 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:04.992504 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e285d82e-e1ae-4d60-ba5d-4882f5414226 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:04.998423 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa7284-af60-432d-b4ab-30565eedaaa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:04.999826 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa7284-af60-432d-b4ab-30565eedaaa4 admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:05.000332 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa7284-af60-432d-b4ab-30565eedaaa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:05.000613 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa7284-af60-432d-b4ab-30565eedaaa4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:05.001350 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fa7284-af60-432d-b4ab-30565eedaaa4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:35:05.001656 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fa7284-af60-432d-b4ab-30565eedaaa4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:05.003536 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fa7284-af60-432d-b4ab-30565eedaaa4 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:05.016996 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1280/2570] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Mar 30 01:35:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:35:05.022043 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa7284-af60-432d-b4ab-30565eedaaa4 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:05.034448 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa7284-af60-432d-b4ab-30565eedaaa4 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:05.040918 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09774e3b-5f86-4ceb-b58b-7864f62b9685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:05.041893 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09774e3b-5f86-4ceb-b58b-7864f62b9685 admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:05.042323 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09774e3b-5f86-4ceb-b58b-7864f62b9685 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:05.042777 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09774e3b-5f86-4ceb-b58b-7864f62b9685 admin admin] PATH_INFO: `/v3/projects` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:05.043692 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09774e3b-5f86-4ceb-b58b-7864f62b9685 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:05.046182 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09774e3b-5f86-4ceb-b58b-7864f62b9685 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:05.056546 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28379e8-e659-4292-9261-6bc45d8ba762 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:05.065211 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddbbd39-748f-4abf-9d64-cb937baea70b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140c6d1a20e94192bde06e72040f162d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:05.065994 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddbbd39-748f-4abf-9d64-cb937baea70b service nova] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:05.066283 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddbbd39-748f-4abf-9d64-cb937baea70b service nova] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:05.066565 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddbbd39-748f-4abf-9d64-cb937baea70b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:05.069322 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-cddbbd39-748f-4abf-9d64-cb937baea70b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:05.088076 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1281/2571] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:35:05 2022] POST /identity/v3/projects => generated 385 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:35:05.088974 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09774e3b-5f86-4ceb-b58b-7864f62b9685 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:05.138253 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddbbd39-748f-4abf-9d64-cb937baea70b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:05.140433 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddbbd39-748f-4abf-9d64-cb937baea70b service nova] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:05.151310 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1291/2572] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:35:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 30 01:35:05.158284 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09774e3b-5f86-4ceb-b58b-7864f62b9685 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:05.163198 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c847b1e1-6c6c-41ed-a278-397a23b8ff4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:05.163880 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847b1e1-6c6c-41ed-a278-397a23b8ff4d admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:05.164164 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847b1e1-6c6c-41ed-a278-397a23b8ff4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:05.164449 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847b1e1-6c6c-41ed-a278-397a23b8ff4d admin admin] PATH_INFO: `/v3/users` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:05.165149 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c847b1e1-6c6c-41ed-a278-397a23b8ff4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:05.167125 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c847b1e1-6c6c-41ed-a278-397a23b8ff4d admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:05.195155 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddbbd39-748f-4abf-9d64-cb937baea70b service nova] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:05.196143 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1282/2573] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:35:05 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:35:05.206946 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddbbd39-748f-4abf-9d64-cb937baea70b service nova] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:05.214247 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afc5ede-d122-4d41-9d1b-b900087166ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:05.214951 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc5ede-d122-4d41-9d1b-b900087166ad admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:05.215236 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc5ede-d122-4d41-9d1b-b900087166ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:05.215514 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc5ede-d122-4d41-9d1b-b900087166ad admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:05.216237 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afc5ede-d122-4d41-9d1b-b900087166ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:05.218034 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afc5ede-d122-4d41-9d1b-b900087166ad admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:05.234807 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1292/2574] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:35:05 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 01:35:05.237216 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c847b1e1-6c6c-41ed-a278-397a23b8ff4d admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:05.247537 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c847b1e1-6c6c-41ed-a278-397a23b8ff4d admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:05.252907 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a416e65c-fb60-4a32-9d17-2c6db19d2108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:05.253735 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a416e65c-fb60-4a32-9d17-2c6db19d2108 admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:05.254061 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a416e65c-fb60-4a32-9d17-2c6db19d2108 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:05.254438 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a416e65c-fb60-4a32-9d17-2c6db19d2108 admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:05.255325 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a416e65c-fb60-4a32-9d17-2c6db19d2108 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:05.257138 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a416e65c-fb60-4a32-9d17-2c6db19d2108 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:05.270863 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1283/2575] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:35:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:35:05.272581 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afc5ede-d122-4d41-9d1b-b900087166ad admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:05.283197 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afc5ede-d122-4d41-9d1b-b900087166ad admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:05.288246 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1e4ec0-65b6-46d0-a3a2-f818c4e57a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:05.289404 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e4ec0-65b6-46d0-a3a2-f818c4e57a7f admin admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:05.289779 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e4ec0-65b6-46d0-a3a2-f818c4e57a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:05.290151 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e4ec0-65b6-46d0-a3a2-f818c4e57a7f admin admin] PATH_INFO: `/v3/projects/2cbb761aa6ce4584ac4e7c2b30850b4b/users/f733d7706c4f44b9a32dfd8759dd0f29/roles/7185d0cfbcd44502b1613bcfe1b42f6f` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:05.446167 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1e4ec0-65b6-46d0-a3a2-f818c4e57a7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cbb761aa6ce4584ac4e7c2b30850b4b, user_id=f733d7706c4f44b9a32dfd8759dd0f29, role_id=7185d0cfbcd44502b1613bcfe1b42f6f)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:05.448890 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1e4ec0-65b6-46d0-a3a2-f818c4e57a7f admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:05.465928 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1293/2576] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:35:05 2022] PUT /identity/v3/projects/2cbb761aa6ce4584ac4e7c2b30850b4b/users/f733d7706c4f44b9a32dfd8759dd0f29/roles/7185d0cfbcd44502b1613bcfe1b42f6f => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:35:05.477272 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7894506-4f47-4f7c-abec-c047663e2e40 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:05.478003 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7894506-4f47-4f7c-abec-c047663e2e40 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:05.478227 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7894506-4f47-4f7c-abec-c047663e2e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:05.513072 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-c7894506-4f47-4f7c-abec-c047663e2e40 None None] MFA Rules not processed for user `f733d7706c4f44b9a32dfd8759dd0f29`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:35:05.515370 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-c7894506-4f47-4f7c-abec-c047663e2e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:05.590472 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1284/2577] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:35:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:35:05.591338 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1e4ec0-65b6-46d0-a3a2-f818c4e57a7f admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:05.665295 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1e4ec0-65b6-46d0-a3a2-f818c4e57a7f admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:05.671273 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b69dcfe-552e-4223-9413-8108502c27c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:05.672089 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b69dcfe-552e-4223-9413-8108502c27c4 admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:05.672435 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b69dcfe-552e-4223-9413-8108502c27c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:05.672809 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b69dcfe-552e-4223-9413-8108502c27c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:05.673568 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b69dcfe-552e-4223-9413-8108502c27c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:05.675592 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b69dcfe-552e-4223-9413-8108502c27c4 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:05.716766 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1294/2578] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:35:05 2022] POST /identity/v3/projects => generated 385 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 01:35:05.721523 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7894506-4f47-4f7c-abec-c047663e2e40 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:05.733965 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7894506-4f47-4f7c-abec-c047663e2e40 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:05.795427 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd7fa4e-aaec-4f14-89ae-dbe1ae6bd46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:05.796491 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd7fa4e-aaec-4f14-89ae-dbe1ae6bd46b admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:05.796885 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd7fa4e-aaec-4f14-89ae-dbe1ae6bd46b admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:05.797241 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd7fa4e-aaec-4f14-89ae-dbe1ae6bd46b admin admin] PATH_INFO: `/v3/users` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:05.798030 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd7fa4e-aaec-4f14-89ae-dbe1ae6bd46b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:05.800009 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd7fa4e-aaec-4f14-89ae-dbe1ae6bd46b admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:05.822446 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1285/2579] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:35:05 2022] POST /identity/v3/users => generated 299 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 01:35:05.826300 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b69dcfe-552e-4223-9413-8108502c27c4 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:05.853876 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b69dcfe-552e-4223-9413-8108502c27c4 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:05.860909 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c997ad6-fd76-41cd-87ff-e6fd6be5c5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:05.862357 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c997ad6-fd76-41cd-87ff-e6fd6be5c5eb admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:05.862852 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c997ad6-fd76-41cd-87ff-e6fd6be5c5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:05.863173 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c997ad6-fd76-41cd-87ff-e6fd6be5c5eb admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:05.863970 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c997ad6-fd76-41cd-87ff-e6fd6be5c5eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:05.866536 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c997ad6-fd76-41cd-87ff-e6fd6be5c5eb admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:05.878050 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1295/2580] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:35:05 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 01:35:05.882444 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd7fa4e-aaec-4f14-89ae-dbe1ae6bd46b admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:05.893731 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd7fa4e-aaec-4f14-89ae-dbe1ae6bd46b admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:05.899903 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a83418d-ddab-421b-bcec-65ba25ab8e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:05.901245 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a83418d-ddab-421b-bcec-65ba25ab8e07 admin admin] REQUEST_METHOD: `PUT` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:05.901836 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a83418d-ddab-421b-bcec-65ba25ab8e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:05.902206 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a83418d-ddab-421b-bcec-65ba25ab8e07 admin admin] PATH_INFO: `/v3/projects/d6f10158371f426385c658c8624d5b84/users/81365dd321284bbfa7482552c3f765d5/roles/36909bbf31d04993bb2a9fe587b572dc` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:05.923731 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a83418d-ddab-421b-bcec-65ba25ab8e07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6f10158371f426385c658c8624d5b84, user_id=81365dd321284bbfa7482552c3f765d5, role_id=36909bbf31d04993bb2a9fe587b572dc)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:05.927468 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a83418d-ddab-421b-bcec-65ba25ab8e07 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:05.945162 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1286/2581] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:35:05 2022] PUT /identity/v3/projects/d6f10158371f426385c658c8624d5b84/users/81365dd321284bbfa7482552c3f765d5/roles/36909bbf31d04993bb2a9fe587b572dc => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:35:05.949454 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c997ad6-fd76-41cd-87ff-e6fd6be5c5eb admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:05.964435 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c997ad6-fd76-41cd-87ff-e6fd6be5c5eb admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:06.035686 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b08835-3b0a-4947-a961-57a4939b604f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:06.036522 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b08835-3b0a-4947-a961-57a4939b604f admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:06.036810 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b08835-3b0a-4947-a961-57a4939b604f admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:06.037087 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b08835-3b0a-4947-a961-57a4939b604f admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:06.037827 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b08835-3b0a-4947-a961-57a4939b604f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:06.039705 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b08835-3b0a-4947-a961-57a4939b604f admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:06.054222 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1296/2582] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:35:05 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:35:06.055189 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a83418d-ddab-421b-bcec-65ba25ab8e07 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:06.067412 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a83418d-ddab-421b-bcec-65ba25ab8e07 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:06.073031 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed5f62-d90c-41dc-aaed-22369aa67fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:06.074077 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed5f62-d90c-41dc-aaed-22369aa67fbd admin admin] REQUEST_METHOD: `PUT` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:06.074489 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed5f62-d90c-41dc-aaed-22369aa67fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:06.074919 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed5f62-d90c-41dc-aaed-22369aa67fbd admin admin] PATH_INFO: `/v3/projects/d6f10158371f426385c658c8624d5b84/users/81365dd321284bbfa7482552c3f765d5/roles/36909bbf31d04993bb2a9fe587b572dc` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:06.077966 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed5f62-d90c-41dc-aaed-22369aa67fbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6f10158371f426385c658c8624d5b84, user_id=81365dd321284bbfa7482552c3f765d5, role_id=36909bbf31d04993bb2a9fe587b572dc)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:06.081260 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed5f62-d90c-41dc-aaed-22369aa67fbd admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:06.094370 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1287/2583] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:35:06 2022] PUT /identity/v3/projects/d6f10158371f426385c658c8624d5b84/users/81365dd321284bbfa7482552c3f765d5/roles/36909bbf31d04993bb2a9fe587b572dc => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:35:06.106428 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb451e62-165d-45f9-961b-b8c318aa591c None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:06.106794 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb451e62-165d-45f9-961b-b8c318aa591c None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:06.107128 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb451e62-165d-45f9-961b-b8c318aa591c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:06.153289 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-bb451e62-165d-45f9-961b-b8c318aa591c None None] MFA Rules not processed for user `81365dd321284bbfa7482552c3f765d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:35:06.155094 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-bb451e62-165d-45f9-961b-b8c318aa591c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:06.318114 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1297/2584] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:35:06 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:35:06.331934 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed5f62-d90c-41dc-aaed-22369aa67fbd admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:06.334222 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-03ed5f62-d90c-41dc-aaed-22369aa67fbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:06.400276 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed5f62-d90c-41dc-aaed-22369aa67fbd admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:06.404771 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d989cf8b-1e97-4de6-94c4-5bf5a893cc95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45219f386f0147b6bd380efe4ab62812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:06.405562 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989cf8b-1e97-4de6-94c4-5bf5a893cc95 service cinder] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:06.405971 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989cf8b-1e97-4de6-94c4-5bf5a893cc95 service cinder] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:06.406310 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989cf8b-1e97-4de6-94c4-5bf5a893cc95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:06.416756 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d989cf8b-1e97-4de6-94c4-5bf5a893cc95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:06.418439 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d989cf8b-1e97-4de6-94c4-5bf5a893cc95 service cinder] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:06.431033 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1288/2585] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:35:06 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:35:06.450095 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e9084-4afd-4c57-aa4b-23c78e98b40f None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:06.450339 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e9084-4afd-4c57-aa4b-23c78e98b40f None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:06.450647 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e9084-4afd-4c57-aa4b-23c78e98b40f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:06.475970 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-c88e9084-4afd-4c57-aa4b-23c78e98b40f None None] MFA Rules not processed for user `bd10fd958b4d420881a837e0403de153`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:35:06.477383 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-c88e9084-4afd-4c57-aa4b-23c78e98b40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:06.554051 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1298/2586] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:35:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:35:07.337170 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d989cf8b-1e97-4de6-94c4-5bf5a893cc95 service cinder] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:07.438980 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d989cf8b-1e97-4de6-94c4-5bf5a893cc95 service cinder] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:07.444586 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4051ce1d-f9c7-4d55-8d49-c0c6ac1c84a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:07.446347 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4051ce1d-f9c7-4d55-8d49-c0c6ac1c84a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:07.446646 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4051ce1d-f9c7-4d55-8d49-c0c6ac1c84a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:07.446956 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4051ce1d-f9c7-4d55-8d49-c0c6ac1c84a9 admin admin] PATH_INFO: `/v3/users/f733d7706c4f44b9a32dfd8759dd0f29` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:07.448972 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4051ce1d-f9c7-4d55-8d49-c0c6ac1c84a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f733d7706c4f44b9a32dfd8759dd0f29)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:07.452712 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4051ce1d-f9c7-4d55-8d49-c0c6ac1c84a9 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:07.526083 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-4051ce1d-f9c7-4d55-8d49-c0c6ac1c84a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f733d7706c4f44b9a32dfd8759dd0f29'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:07.540535 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-4051ce1d-f9c7-4d55-8d49-c0c6ac1c84a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f733d7706c4f44b9a32dfd8759dd0f29'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:07.550504 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-4051ce1d-f9c7-4d55-8d49-c0c6ac1c84a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f733d7706c4f44b9a32dfd8759dd0f29'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:07.551315 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-4051ce1d-f9c7-4d55-8d49-c0c6ac1c84a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f733d7706c4f44b9a32dfd8759dd0f29'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:07.562256 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-4051ce1d-f9c7-4d55-8d49-c0c6ac1c84a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f733d7706c4f44b9a32dfd8759dd0f29'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:07.570034 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1289/2587] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:35:07 2022] DELETE /identity/v3/users/f733d7706c4f44b9a32dfd8759dd0f29 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:35:07.574911 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928790f5-7ee6-48f2-85b9-d2e3409ccd7f None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:07.575438 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928790f5-7ee6-48f2-85b9-d2e3409ccd7f None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:07.575554 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928790f5-7ee6-48f2-85b9-d2e3409ccd7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:07.593966 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-928790f5-7ee6-48f2-85b9-d2e3409ccd7f None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:35:07.595227 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-928790f5-7ee6-48f2-85b9-d2e3409ccd7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:07.688168 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1299/2588] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:35:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 01:35:07.699319 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4051ce1d-f9c7-4d55-8d49-c0c6ac1c84a9 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:07.701215 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-4051ce1d-f9c7-4d55-8d49-c0c6ac1c84a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:07.772697 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4051ce1d-f9c7-4d55-8d49-c0c6ac1c84a9 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:07.776438 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8010b8d8-ffd3-4e11-88a4-cd5bf67d7e83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:07.777089 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010b8d8-ffd3-4e11-88a4-cd5bf67d7e83 service neutron] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:07.777383 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010b8d8-ffd3-4e11-88a4-cd5bf67d7e83 service neutron] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:07.777665 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010b8d8-ffd3-4e11-88a4-cd5bf67d7e83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:07.788193 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8010b8d8-ffd3-4e11-88a4-cd5bf67d7e83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:07.789635 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8010b8d8-ffd3-4e11-88a4-cd5bf67d7e83 service neutron] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:07.800127 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1290/2589] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:35:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:35:08.079934 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928790f5-7ee6-48f2-85b9-d2e3409ccd7f None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:08.081364 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-928790f5-7ee6-48f2-85b9-d2e3409ccd7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:08.095736 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928790f5-7ee6-48f2-85b9-d2e3409ccd7f None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:08.101819 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3ad980-c4f1-4502-a6ca-ce38ab055a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:08.103021 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3ad980-c4f1-4502-a6ca-ce38ab055a2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:08.103329 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3ad980-c4f1-4502-a6ca-ce38ab055a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:08.103607 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3ad980-c4f1-4502-a6ca-ce38ab055a2e admin admin] PATH_INFO: `/v3/projects/2cbb761aa6ce4584ac4e7c2b30850b4b` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:08.104822 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3ad980-c4f1-4502-a6ca-ce38ab055a2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cbb761aa6ce4584ac4e7c2b30850b4b)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:08.106729 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3ad980-c4f1-4502-a6ca-ce38ab055a2e admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:08.165680 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-3d3ad980-c4f1-4502-a6ca-ce38ab055a2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cbb761aa6ce4584ac4e7c2b30850b4b', 'request_id': 'req-3d3ad980-c4f1-4502-a6ca-ce38ab055a2e'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:08.177777 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-3d3ad980-c4f1-4502-a6ca-ce38ab055a2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cbb761aa6ce4584ac4e7c2b30850b4b', 'request_id': 'req-3d3ad980-c4f1-4502-a6ca-ce38ab055a2e'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:08.187670 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-3d3ad980-c4f1-4502-a6ca-ce38ab055a2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cbb761aa6ce4584ac4e7c2b30850b4b', 'request_id': 'req-3d3ad980-c4f1-4502-a6ca-ce38ab055a2e'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:08.209889 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-3d3ad980-c4f1-4502-a6ca-ce38ab055a2e admin admin] The token cache is being invalidate because project 2cbb761aa6ce4584ac4e7c2b30850b4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:35:08.210192 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-3d3ad980-c4f1-4502-a6ca-ce38ab055a2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:08.211041 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-3d3ad980-c4f1-4502-a6ca-ce38ab055a2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:08.213031 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1300/2590] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:35:08 2022] DELETE /identity/v3/projects/2cbb761aa6ce4584ac4e7c2b30850b4b => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:35:08.235543 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8010b8d8-ffd3-4e11-88a4-cd5bf67d7e83 service neutron] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:08.254163 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8010b8d8-ffd3-4e11-88a4-cd5bf67d7e83 service neutron] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:08.331857 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022a1f77-9704-45fb-8877-4722a4e0aaa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:08.333007 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a1f77-9704-45fb-8877-4722a4e0aaa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:08.333396 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a1f77-9704-45fb-8877-4722a4e0aaa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:08.333774 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a1f77-9704-45fb-8877-4722a4e0aaa8 admin admin] PATH_INFO: `/v3/users/81365dd321284bbfa7482552c3f765d5` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:08.335341 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022a1f77-9704-45fb-8877-4722a4e0aaa8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81365dd321284bbfa7482552c3f765d5)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:08.337594 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022a1f77-9704-45fb-8877-4722a4e0aaa8 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:08.404572 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-022a1f77-9704-45fb-8877-4722a4e0aaa8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81365dd321284bbfa7482552c3f765d5'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:08.435613 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-022a1f77-9704-45fb-8877-4722a4e0aaa8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81365dd321284bbfa7482552c3f765d5'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:08.450023 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-022a1f77-9704-45fb-8877-4722a4e0aaa8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81365dd321284bbfa7482552c3f765d5'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:08.450905 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-022a1f77-9704-45fb-8877-4722a4e0aaa8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81365dd321284bbfa7482552c3f765d5'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:08.461216 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-022a1f77-9704-45fb-8877-4722a4e0aaa8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81365dd321284bbfa7482552c3f765d5'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:08.469301 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1291/2591] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:35:08 2022] DELETE /identity/v3/users/81365dd321284bbfa7482552c3f765d5 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:35:08.862305 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3ad980-c4f1-4502-a6ca-ce38ab055a2e admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:08.863939 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-3d3ad980-c4f1-4502-a6ca-ce38ab055a2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:08.881134 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3ad980-c4f1-4502-a6ca-ce38ab055a2e admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:08.945298 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a133e-1f1f-4645-a0f6-e76ab8aad421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:08.946297 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a133e-1f1f-4645-a0f6-e76ab8aad421 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:08.946576 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a133e-1f1f-4645-a0f6-e76ab8aad421 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:08.946890 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a133e-1f1f-4645-a0f6-e76ab8aad421 admin admin] PATH_INFO: `/v3/projects/d6f10158371f426385c658c8624d5b84` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:08.948084 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0a133e-1f1f-4645-a0f6-e76ab8aad421 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6f10158371f426385c658c8624d5b84)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:08.950093 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0a133e-1f1f-4645-a0f6-e76ab8aad421 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:09.001503 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-6c0a133e-1f1f-4645-a0f6-e76ab8aad421 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6f10158371f426385c658c8624d5b84', 'request_id': 'req-6c0a133e-1f1f-4645-a0f6-e76ab8aad421'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:09.006887 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-6c0a133e-1f1f-4645-a0f6-e76ab8aad421 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6f10158371f426385c658c8624d5b84', 'request_id': 'req-6c0a133e-1f1f-4645-a0f6-e76ab8aad421'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:09.014594 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-6c0a133e-1f1f-4645-a0f6-e76ab8aad421 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6f10158371f426385c658c8624d5b84', 'request_id': 'req-6c0a133e-1f1f-4645-a0f6-e76ab8aad421'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:09.028361 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-6c0a133e-1f1f-4645-a0f6-e76ab8aad421 admin admin] The token cache is being invalidate because project d6f10158371f426385c658c8624d5b84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:35:09.028657 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-6c0a133e-1f1f-4645-a0f6-e76ab8aad421 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:09.029289 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-6c0a133e-1f1f-4645-a0f6-e76ab8aad421 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:09.032066 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1301/2592] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:35:08 2022] DELETE /identity/v3/projects/d6f10158371f426385c658c8624d5b84 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:35:09.041984 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b041cfc-b630-4443-9548-e0b9461250a3 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:09.042304 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b041cfc-b630-4443-9548-e0b9461250a3 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:09.042605 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b041cfc-b630-4443-9548-e0b9461250a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:09.069118 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-9b041cfc-b630-4443-9548-e0b9461250a3 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:35:09.070522 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-9b041cfc-b630-4443-9548-e0b9461250a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:09.143962 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1292/2593] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:35:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:35:09.154723 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152272f6-c8a7-47b5-93c1-2ce0806ade58 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:09.155244 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152272f6-c8a7-47b5-93c1-2ce0806ade58 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:09.155696 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152272f6-c8a7-47b5-93c1-2ce0806ade58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:09.180092 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-152272f6-c8a7-47b5-93c1-2ce0806ade58 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:35:09.181381 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-152272f6-c8a7-47b5-93c1-2ce0806ade58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:09.191108 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1302/2594] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:35:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:35:09.199493 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b041cfc-b630-4443-9548-e0b9461250a3 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:09.208862 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b041cfc-b630-4443-9548-e0b9461250a3 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:09.219525 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d55e7f-a43b-422f-b472-faa29871f4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:09.220255 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d55e7f-a43b-422f-b472-faa29871f4ff admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:09.220540 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d55e7f-a43b-422f-b472-faa29871f4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:09.221630 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d55e7f-a43b-422f-b472-faa29871f4ff admin admin] PATH_INFO: `/v3/domains` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:09.221630 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d55e7f-a43b-422f-b472-faa29871f4ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:35:09.221859 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d55e7f-a43b-422f-b472-faa29871f4ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:09.223553 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d55e7f-a43b-422f-b472-faa29871f4ff admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:09.238089 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1293/2595] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Mar 30 01:35:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:35:09.242290 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152272f6-c8a7-47b5-93c1-2ce0806ade58 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:09.252130 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152272f6-c8a7-47b5-93c1-2ce0806ade58 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:09.260560 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc957c-5141-4e1f-b4f2-f2361710cb14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:09.261244 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc957c-5141-4e1f-b4f2-f2361710cb14 admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:09.262376 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc957c-5141-4e1f-b4f2-f2361710cb14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:09.262376 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc957c-5141-4e1f-b4f2-f2361710cb14 admin admin] PATH_INFO: `/v3/projects` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:09.262747 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dc957c-5141-4e1f-b4f2-f2361710cb14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:09.264434 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dc957c-5141-4e1f-b4f2-f2361710cb14 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:09.305457 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1303/2596] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:35:09 2022] POST /identity/v3/projects => generated 385 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:35:09.309664 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d55e7f-a43b-422f-b472-faa29871f4ff admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:09.321475 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d55e7f-a43b-422f-b472-faa29871f4ff admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:09.383734 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14287794-9998-4a73-bc6a-dbb8b5e4cd6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:09.384397 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14287794-9998-4a73-bc6a-dbb8b5e4cd6b admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:09.384592 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14287794-9998-4a73-bc6a-dbb8b5e4cd6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:09.384869 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14287794-9998-4a73-bc6a-dbb8b5e4cd6b admin admin] PATH_INFO: `/v3/users` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:09.385555 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14287794-9998-4a73-bc6a-dbb8b5e4cd6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:09.387491 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14287794-9998-4a73-bc6a-dbb8b5e4cd6b admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:09.410983 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1294/2597] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:35:09 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 01:35:09.415510 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc957c-5141-4e1f-b4f2-f2361710cb14 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:09.427308 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc957c-5141-4e1f-b4f2-f2361710cb14 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:09.431916 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dc585b-89d3-4e84-a291-3708b948f8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:09.432729 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc585b-89d3-4e84-a291-3708b948f8f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:09.433084 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc585b-89d3-4e84-a291-3708b948f8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:09.433427 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc585b-89d3-4e84-a291-3708b948f8f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:09.434217 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dc585b-89d3-4e84-a291-3708b948f8f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:09.435854 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dc585b-89d3-4e84-a291-3708b948f8f7 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:09.458751 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1304/2598] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:35:09 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:35:09.462873 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14287794-9998-4a73-bc6a-dbb8b5e4cd6b admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:09.473311 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14287794-9998-4a73-bc6a-dbb8b5e4cd6b admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:09.478086 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8bfa3e-255c-4707-9ff2-9faadb792ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:09.478915 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8bfa3e-255c-4707-9ff2-9faadb792ae8 admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:09.479359 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8bfa3e-255c-4707-9ff2-9faadb792ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:09.482831 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8bfa3e-255c-4707-9ff2-9faadb792ae8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:09.482831 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8bfa3e-255c-4707-9ff2-9faadb792ae8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:09.482831 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8bfa3e-255c-4707-9ff2-9faadb792ae8 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:09.494039 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1295/2599] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:35:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:35:09.497768 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dc585b-89d3-4e84-a291-3708b948f8f7 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:09.508654 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dc585b-89d3-4e84-a291-3708b948f8f7 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:09.513660 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882645fd-f2b9-450f-ab8b-4da8b17e1f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:09.515708 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882645fd-f2b9-450f-ab8b-4da8b17e1f07 admin admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:09.516137 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882645fd-f2b9-450f-ab8b-4da8b17e1f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:09.519711 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882645fd-f2b9-450f-ab8b-4da8b17e1f07 admin admin] PATH_INFO: `/v3/projects/df1d7a70d12542b89d164f287464e57b/users/8f4305f2220a4810bcce3786b6d15b67/roles/7185d0cfbcd44502b1613bcfe1b42f6f` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:09.538996 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882645fd-f2b9-450f-ab8b-4da8b17e1f07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df1d7a70d12542b89d164f287464e57b, user_id=8f4305f2220a4810bcce3786b6d15b67, role_id=7185d0cfbcd44502b1613bcfe1b42f6f)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:09.541662 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882645fd-f2b9-450f-ab8b-4da8b17e1f07 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:09.560910 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1305/2600] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:35:09 2022] PUT /identity/v3/projects/df1d7a70d12542b89d164f287464e57b/users/8f4305f2220a4810bcce3786b6d15b67/roles/7185d0cfbcd44502b1613bcfe1b42f6f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:35:09.566365 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a80d7-893e-4efc-b4c7-947aa0efbd80 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:09.566662 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a80d7-893e-4efc-b4c7-947aa0efbd80 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:09.566992 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a80d7-893e-4efc-b4c7-947aa0efbd80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:09.600048 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-472a80d7-893e-4efc-b4c7-947aa0efbd80 None None] MFA Rules not processed for user `8f4305f2220a4810bcce3786b6d15b67`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:35:09.601262 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-472a80d7-893e-4efc-b4c7-947aa0efbd80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:09.678180 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1296/2601] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:35:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:35:09.682935 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882645fd-f2b9-450f-ab8b-4da8b17e1f07 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:09.766908 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882645fd-f2b9-450f-ab8b-4da8b17e1f07 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:09.773441 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce23aca2-099c-432e-8c1b-1f442a7d1996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:09.774177 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce23aca2-099c-432e-8c1b-1f442a7d1996 admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:09.774566 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce23aca2-099c-432e-8c1b-1f442a7d1996 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:09.775491 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce23aca2-099c-432e-8c1b-1f442a7d1996 admin admin] PATH_INFO: `/v3/projects` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:09.775818 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce23aca2-099c-432e-8c1b-1f442a7d1996 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:09.777831 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce23aca2-099c-432e-8c1b-1f442a7d1996 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:09.810213 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1306/2602] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:35:09 2022] POST /identity/v3/projects => generated 383 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:35:09.814629 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472a80d7-893e-4efc-b4c7-947aa0efbd80 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:09.833465 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472a80d7-893e-4efc-b4c7-947aa0efbd80 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:09.908393 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6e1e43-4291-4575-9146-f8f8c4536013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:09.909215 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e1e43-4291-4575-9146-f8f8c4536013 admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:09.909597 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e1e43-4291-4575-9146-f8f8c4536013 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:09.910738 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e1e43-4291-4575-9146-f8f8c4536013 admin admin] PATH_INFO: `/v3/users` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:09.910864 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6e1e43-4291-4575-9146-f8f8c4536013 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:09.913643 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6e1e43-4291-4575-9146-f8f8c4536013 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:09.939157 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1297/2603] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:35:09 2022] POST /identity/v3/users => generated 292 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 01:35:09.940633 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce23aca2-099c-432e-8c1b-1f442a7d1996 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:09.951104 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce23aca2-099c-432e-8c1b-1f442a7d1996 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:09.957630 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b290b069-761e-4b1e-a0c2-3bb595afc27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:09.958323 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b290b069-761e-4b1e-a0c2-3bb595afc27c admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:09.958603 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b290b069-761e-4b1e-a0c2-3bb595afc27c admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:09.958920 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b290b069-761e-4b1e-a0c2-3bb595afc27c admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:09.959656 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b290b069-761e-4b1e-a0c2-3bb595afc27c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:09.961249 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b290b069-761e-4b1e-a0c2-3bb595afc27c admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:09.979936 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1307/2604] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:35:09 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:35:09.981130 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6e1e43-4291-4575-9146-f8f8c4536013 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:09.994641 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6e1e43-4291-4575-9146-f8f8c4536013 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:10.002550 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae70be5f-2e68-408d-b223-467888f6ca01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:10.003375 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70be5f-2e68-408d-b223-467888f6ca01 admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:10.003662 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70be5f-2e68-408d-b223-467888f6ca01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:10.003948 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70be5f-2e68-408d-b223-467888f6ca01 admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:10.004692 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae70be5f-2e68-408d-b223-467888f6ca01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:10.006300 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae70be5f-2e68-408d-b223-467888f6ca01 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:10.017716 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1298/2605] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:35:09 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:35:10.021923 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b290b069-761e-4b1e-a0c2-3bb595afc27c admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:10.034293 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b290b069-761e-4b1e-a0c2-3bb595afc27c admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:10.040205 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d310c11c-1415-48aa-9e4f-3743d4e9b0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:10.045499 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310c11c-1415-48aa-9e4f-3743d4e9b0b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:10.046228 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310c11c-1415-48aa-9e4f-3743d4e9b0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:10.046667 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310c11c-1415-48aa-9e4f-3743d4e9b0b1 admin admin] PATH_INFO: `/v3/projects/a3c418da198242b3a6d272899a169689/users/a5bae6ad234842ecb11a0e29d60f126c/roles/7185d0cfbcd44502b1613bcfe1b42f6f` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:10.070493 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d310c11c-1415-48aa-9e4f-3743d4e9b0b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3c418da198242b3a6d272899a169689, user_id=a5bae6ad234842ecb11a0e29d60f126c, role_id=7185d0cfbcd44502b1613bcfe1b42f6f)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:10.073245 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d310c11c-1415-48aa-9e4f-3743d4e9b0b1 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:10.099878 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1308/2606] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:35:10 2022] PUT /identity/v3/projects/a3c418da198242b3a6d272899a169689/users/a5bae6ad234842ecb11a0e29d60f126c/roles/7185d0cfbcd44502b1613bcfe1b42f6f => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:35:10.112137 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72da5e-70cd-4662-bfde-4fc0e17df09d None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:10.112715 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72da5e-70cd-4662-bfde-4fc0e17df09d None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:10.113147 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72da5e-70cd-4662-bfde-4fc0e17df09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:10.165321 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-4b72da5e-70cd-4662-bfde-4fc0e17df09d None None] MFA Rules not processed for user `a5bae6ad234842ecb11a0e29d60f126c`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:35:10.167730 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-4b72da5e-70cd-4662-bfde-4fc0e17df09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:10.258124 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1299/2607] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:35:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:35:10.262264 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d310c11c-1415-48aa-9e4f-3743d4e9b0b1 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:10.359494 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d310c11c-1415-48aa-9e4f-3743d4e9b0b1 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:10.364945 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a99914-6a8a-4749-988a-d02f4fac6792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:10.366652 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a99914-6a8a-4749-988a-d02f4fac6792 admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:10.366652 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a99914-6a8a-4749-988a-d02f4fac6792 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:10.366652 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a99914-6a8a-4749-988a-d02f4fac6792 admin admin] PATH_INFO: `/v3/projects` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:10.367074 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a99914-6a8a-4749-988a-d02f4fac6792 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:10.369062 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a99914-6a8a-4749-988a-d02f4fac6792 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:10.400845 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1309/2608] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:35:10 2022] POST /identity/v3/projects => generated 385 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 01:35:10.405814 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b72da5e-70cd-4662-bfde-4fc0e17df09d None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:10.417957 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b72da5e-70cd-4662-bfde-4fc0e17df09d None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:10.485876 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70693189-c17a-4637-88f0-241c824a52fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:10.487954 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70693189-c17a-4637-88f0-241c824a52fe admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:10.488194 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70693189-c17a-4637-88f0-241c824a52fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:10.489206 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70693189-c17a-4637-88f0-241c824a52fe admin admin] PATH_INFO: `/v3/users` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:10.490088 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70693189-c17a-4637-88f0-241c824a52fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:10.492789 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70693189-c17a-4637-88f0-241c824a52fe admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:10.519348 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1300/2609] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:35:10 2022] POST /identity/v3/users => generated 299 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 01:35:10.522947 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a99914-6a8a-4749-988a-d02f4fac6792 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:10.535313 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a99914-6a8a-4749-988a-d02f4fac6792 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:10.541999 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e291d48-5a64-46b3-a9a5-d123e1d3b654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:10.542927 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e291d48-5a64-46b3-a9a5-d123e1d3b654 admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:10.543340 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e291d48-5a64-46b3-a9a5-d123e1d3b654 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:10.543713 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e291d48-5a64-46b3-a9a5-d123e1d3b654 admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:10.544571 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e291d48-5a64-46b3-a9a5-d123e1d3b654 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:10.547333 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e291d48-5a64-46b3-a9a5-d123e1d3b654 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:10.562727 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1310/2610] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:35:10 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 01:35:10.564605 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70693189-c17a-4637-88f0-241c824a52fe admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:10.576511 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70693189-c17a-4637-88f0-241c824a52fe admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:10.584839 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa8247-6242-468c-8c25-af41481f836c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:10.585776 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa8247-6242-468c-8c25-af41481f836c admin admin] REQUEST_METHOD: `PUT` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:10.586189 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa8247-6242-468c-8c25-af41481f836c admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:10.586467 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa8247-6242-468c-8c25-af41481f836c admin admin] PATH_INFO: `/v3/projects/947d1e8d7d4a4f2bb18dd54e3f97fcb2/users/a5372dc75506416384842478aa49e146/roles/36909bbf31d04993bb2a9fe587b572dc` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:10.609183 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffa8247-6242-468c-8c25-af41481f836c admin admin] RBAC: Authorizing `identity:create_grant(project_id=947d1e8d7d4a4f2bb18dd54e3f97fcb2, user_id=a5372dc75506416384842478aa49e146, role_id=36909bbf31d04993bb2a9fe587b572dc)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:10.612020 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffa8247-6242-468c-8c25-af41481f836c admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:10.629461 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1301/2611] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:35:10 2022] PUT /identity/v3/projects/947d1e8d7d4a4f2bb18dd54e3f97fcb2/users/a5372dc75506416384842478aa49e146/roles/36909bbf31d04993bb2a9fe587b572dc => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:35:10.634338 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e291d48-5a64-46b3-a9a5-d123e1d3b654 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:10.648547 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e291d48-5a64-46b3-a9a5-d123e1d3b654 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:10.706928 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee137330-c42c-4622-91b3-7b0da119c1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:10.707603 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee137330-c42c-4622-91b3-7b0da119c1bd admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:10.707888 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee137330-c42c-4622-91b3-7b0da119c1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:10.708165 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee137330-c42c-4622-91b3-7b0da119c1bd admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:10.708892 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee137330-c42c-4622-91b3-7b0da119c1bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:10.710477 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee137330-c42c-4622-91b3-7b0da119c1bd admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:10.721829 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1311/2612] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:35:10 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:35:10.725833 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa8247-6242-468c-8c25-af41481f836c admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:10.736046 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa8247-6242-468c-8c25-af41481f836c admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:10.740723 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5238b12-d0bc-41d4-a988-6899416da4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:10.741607 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5238b12-d0bc-41d4-a988-6899416da4be admin admin] REQUEST_METHOD: `PUT` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:10.741886 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5238b12-d0bc-41d4-a988-6899416da4be admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:10.742161 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5238b12-d0bc-41d4-a988-6899416da4be admin admin] PATH_INFO: `/v3/projects/947d1e8d7d4a4f2bb18dd54e3f97fcb2/users/a5372dc75506416384842478aa49e146/roles/36909bbf31d04993bb2a9fe587b572dc` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:10.744188 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5238b12-d0bc-41d4-a988-6899416da4be admin admin] RBAC: Authorizing `identity:create_grant(project_id=947d1e8d7d4a4f2bb18dd54e3f97fcb2, user_id=a5372dc75506416384842478aa49e146, role_id=36909bbf31d04993bb2a9fe587b572dc)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:10.746877 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5238b12-d0bc-41d4-a988-6899416da4be admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:10.759835 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1302/2613] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:35:10 2022] PUT /identity/v3/projects/947d1e8d7d4a4f2bb18dd54e3f97fcb2/users/a5372dc75506416384842478aa49e146/roles/36909bbf31d04993bb2a9fe587b572dc => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:35:10.825406 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8269bd9-47c9-4c84-ac07-146e04b92df4 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:10.825695 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8269bd9-47c9-4c84-ac07-146e04b92df4 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:10.825967 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8269bd9-47c9-4c84-ac07-146e04b92df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:10.861933 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-d8269bd9-47c9-4c84-ac07-146e04b92df4 None None] MFA Rules not processed for user `a5372dc75506416384842478aa49e146`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:35:10.863554 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-d8269bd9-47c9-4c84-ac07-146e04b92df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:10.960626 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1312/2614] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:35:10 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:35:10.973542 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5238b12-d0bc-41d4-a988-6899416da4be admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:10.975315 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-c5238b12-d0bc-41d4-a988-6899416da4be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:11.052571 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5238b12-d0bc-41d4-a988-6899416da4be admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:11.056476 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5bb0b1-89be-4847-a9ea-80c7d3ec45c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45219f386f0147b6bd380efe4ab62812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:11.057236 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5bb0b1-89be-4847-a9ea-80c7d3ec45c4 service cinder] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:11.057517 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5bb0b1-89be-4847-a9ea-80c7d3ec45c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:11.057823 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5bb0b1-89be-4847-a9ea-80c7d3ec45c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:11.137024 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5bb0b1-89be-4847-a9ea-80c7d3ec45c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:11.138533 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5bb0b1-89be-4847-a9ea-80c7d3ec45c4 service cinder] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:11.152055 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1303/2615] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:35:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:35:12.732345 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8269bd9-47c9-4c84-ac07-146e04b92df4 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:12.743478 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8269bd9-47c9-4c84-ac07-146e04b92df4 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:12.747136 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7490dfa6-0ab5-499c-bd93-32d7b3b9c09f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45219f386f0147b6bd380efe4ab62812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:12.747786 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7490dfa6-0ab5-499c-bd93-32d7b3b9c09f service cinder] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:12.748069 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7490dfa6-0ab5-499c-bd93-32d7b3b9c09f service cinder] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:12.748342 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7490dfa6-0ab5-499c-bd93-32d7b3b9c09f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:12.819360 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7490dfa6-0ab5-499c-bd93-32d7b3b9c09f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:12.824638 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7490dfa6-0ab5-499c-bd93-32d7b3b9c09f service cinder] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:12.835213 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1313/2616] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:35:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:35:13.419059 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5bb0b1-89be-4847-a9ea-80c7d3ec45c4 service cinder] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:13.420838 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-ee5bb0b1-89be-4847-a9ea-80c7d3ec45c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:13.433744 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5bb0b1-89be-4847-a9ea-80c7d3ec45c4 service cinder] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:13.438193 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a5f551-d9db-458d-9944-90911eaab4c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45219f386f0147b6bd380efe4ab62812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:13.439202 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a5f551-d9db-458d-9944-90911eaab4c6 service cinder] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:13.439202 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a5f551-d9db-458d-9944-90911eaab4c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:13.439499 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a5f551-d9db-458d-9944-90911eaab4c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:13.449441 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a5f551-d9db-458d-9944-90911eaab4c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:13.450896 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a5f551-d9db-458d-9944-90911eaab4c6 service cinder] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:13.462960 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1304/2617] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:35:13 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:35:15.184324 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7490dfa6-0ab5-499c-bd93-32d7b3b9c09f service cinder] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:15.185751 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-7490dfa6-0ab5-499c-bd93-32d7b3b9c09f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:15.243324 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7490dfa6-0ab5-499c-bd93-32d7b3b9c09f service cinder] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:15.247118 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd518cb8-5d9e-47d3-a0ef-178ec1c35f7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:15.247757 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd518cb8-5d9e-47d3-a0ef-178ec1c35f7f service neutron] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:15.248035 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd518cb8-5d9e-47d3-a0ef-178ec1c35f7f service neutron] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:15.248348 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd518cb8-5d9e-47d3-a0ef-178ec1c35f7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:15.250982 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-bd518cb8-5d9e-47d3-a0ef-178ec1c35f7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:15.314487 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd518cb8-5d9e-47d3-a0ef-178ec1c35f7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:15.315982 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd518cb8-5d9e-47d3-a0ef-178ec1c35f7f service neutron] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:15.325960 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1314/2618] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:35:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:35:17.324918 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a5f551-d9db-458d-9944-90911eaab4c6 service cinder] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:17.336835 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a5f551-d9db-458d-9944-90911eaab4c6 service cinder] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:17.342948 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffecdaa2-44f9-4ac4-a065-ca0498bbb7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:17.344298 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffecdaa2-44f9-4ac4-a065-ca0498bbb7b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:17.344298 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffecdaa2-44f9-4ac4-a065-ca0498bbb7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:17.344592 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffecdaa2-44f9-4ac4-a065-ca0498bbb7b4 admin admin] PATH_INFO: `/v3/users/8f4305f2220a4810bcce3786b6d15b67` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:17.345933 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffecdaa2-44f9-4ac4-a065-ca0498bbb7b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f4305f2220a4810bcce3786b6d15b67)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:17.347963 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffecdaa2-44f9-4ac4-a065-ca0498bbb7b4 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:17.405473 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-ffecdaa2-44f9-4ac4-a065-ca0498bbb7b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f4305f2220a4810bcce3786b6d15b67'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:17.418212 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-ffecdaa2-44f9-4ac4-a065-ca0498bbb7b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f4305f2220a4810bcce3786b6d15b67'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:17.433752 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-ffecdaa2-44f9-4ac4-a065-ca0498bbb7b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f4305f2220a4810bcce3786b6d15b67'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:17.434552 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-ffecdaa2-44f9-4ac4-a065-ca0498bbb7b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f4305f2220a4810bcce3786b6d15b67'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:17.444095 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-ffecdaa2-44f9-4ac4-a065-ca0498bbb7b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f4305f2220a4810bcce3786b6d15b67'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:17.451108 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1305/2619] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:35:17 2022] DELETE /identity/v3/users/8f4305f2220a4810bcce3786b6d15b67 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:35:17.455652 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9206c7-5284-4ac9-ac48-94cedec851c9 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:17.456465 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9206c7-5284-4ac9-ac48-94cedec851c9 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:17.456745 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9206c7-5284-4ac9-ac48-94cedec851c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:17.474176 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-ff9206c7-5284-4ac9-ac48-94cedec851c9 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:35:17.475430 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-ff9206c7-5284-4ac9-ac48-94cedec851c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:17.542197 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1315/2620] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:35:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:35:17.553427 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffecdaa2-44f9-4ac4-a065-ca0498bbb7b4 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:17.555191 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-ffecdaa2-44f9-4ac4-a065-ca0498bbb7b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:17.629123 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffecdaa2-44f9-4ac4-a065-ca0498bbb7b4 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:17.639612 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b452ec7-04e8-45f6-bc5d-13ed88803c17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:17.639612 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b452ec7-04e8-45f6-bc5d-13ed88803c17 service neutron] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:17.640098 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b452ec7-04e8-45f6-bc5d-13ed88803c17 service neutron] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:17.640406 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b452ec7-04e8-45f6-bc5d-13ed88803c17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:17.660781 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b452ec7-04e8-45f6-bc5d-13ed88803c17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:17.662227 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b452ec7-04e8-45f6-bc5d-13ed88803c17 service neutron] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:17.672812 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1306/2621] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:35:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:35:18.051343 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9206c7-5284-4ac9-ac48-94cedec851c9 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:18.053847 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-ff9206c7-5284-4ac9-ac48-94cedec851c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:18.065946 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9206c7-5284-4ac9-ac48-94cedec851c9 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:18.070870 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b53513-a18b-427c-8670-4a0a3628f3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:18.071631 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b53513-a18b-427c-8670-4a0a3628f3ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:18.071907 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b53513-a18b-427c-8670-4a0a3628f3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:18.072172 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b53513-a18b-427c-8670-4a0a3628f3ea admin admin] PATH_INFO: `/v3/projects/df1d7a70d12542b89d164f287464e57b` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:18.073344 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b53513-a18b-427c-8670-4a0a3628f3ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=df1d7a70d12542b89d164f287464e57b)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:18.075268 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b53513-a18b-427c-8670-4a0a3628f3ea admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:18.140372 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-67b53513-a18b-427c-8670-4a0a3628f3ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df1d7a70d12542b89d164f287464e57b', 'request_id': 'req-67b53513-a18b-427c-8670-4a0a3628f3ea'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:18.146898 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-67b53513-a18b-427c-8670-4a0a3628f3ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df1d7a70d12542b89d164f287464e57b', 'request_id': 'req-67b53513-a18b-427c-8670-4a0a3628f3ea'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:18.158893 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-67b53513-a18b-427c-8670-4a0a3628f3ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df1d7a70d12542b89d164f287464e57b', 'request_id': 'req-67b53513-a18b-427c-8670-4a0a3628f3ea'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:18.174747 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-67b53513-a18b-427c-8670-4a0a3628f3ea admin admin] The token cache is being invalidate because project df1d7a70d12542b89d164f287464e57b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:35:18.175035 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-67b53513-a18b-427c-8670-4a0a3628f3ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:18.175724 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-67b53513-a18b-427c-8670-4a0a3628f3ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:18.177288 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1316/2622] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:35:18 2022] DELETE /identity/v3/projects/df1d7a70d12542b89d164f287464e57b => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:35:18.182093 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b452ec7-04e8-45f6-bc5d-13ed88803c17 service neutron] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:18.193965 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b452ec7-04e8-45f6-bc5d-13ed88803c17 service neutron] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:18.272600 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b135d-b240-4798-8c22-33a308d1897e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:18.273740 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b135d-b240-4798-8c22-33a308d1897e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:18.274247 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b135d-b240-4798-8c22-33a308d1897e admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:18.274684 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b135d-b240-4798-8c22-33a308d1897e admin admin] PATH_INFO: `/v3/users/a5bae6ad234842ecb11a0e29d60f126c` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:18.276456 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0b135d-b240-4798-8c22-33a308d1897e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5bae6ad234842ecb11a0e29d60f126c)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:18.278758 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0b135d-b240-4798-8c22-33a308d1897e admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:18.336488 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-5e0b135d-b240-4798-8c22-33a308d1897e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5bae6ad234842ecb11a0e29d60f126c'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:18.358626 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-5e0b135d-b240-4798-8c22-33a308d1897e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5bae6ad234842ecb11a0e29d60f126c'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:18.370782 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-5e0b135d-b240-4798-8c22-33a308d1897e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5bae6ad234842ecb11a0e29d60f126c'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:18.371521 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-5e0b135d-b240-4798-8c22-33a308d1897e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5bae6ad234842ecb11a0e29d60f126c'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:18.381478 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-5e0b135d-b240-4798-8c22-33a308d1897e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5bae6ad234842ecb11a0e29d60f126c'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:18.388572 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1307/2623] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:35:18 2022] DELETE /identity/v3/users/a5bae6ad234842ecb11a0e29d60f126c => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:35:18.750568 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b53513-a18b-427c-8670-4a0a3628f3ea admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:18.752194 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-67b53513-a18b-427c-8670-4a0a3628f3ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:18.780763 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b53513-a18b-427c-8670-4a0a3628f3ea admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:18.862053 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579a77e6-b8f1-4069-8a13-d32a8f12d9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:18.862946 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a77e6-b8f1-4069-8a13-d32a8f12d9ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:18.863227 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a77e6-b8f1-4069-8a13-d32a8f12d9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:18.863498 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a77e6-b8f1-4069-8a13-d32a8f12d9ab admin admin] PATH_INFO: `/v3/projects/a3c418da198242b3a6d272899a169689` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:18.864767 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579a77e6-b8f1-4069-8a13-d32a8f12d9ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3c418da198242b3a6d272899a169689)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:18.866693 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579a77e6-b8f1-4069-8a13-d32a8f12d9ab admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:18.903973 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b135d-b240-4798-8c22-33a308d1897e admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:18.906434 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-5e0b135d-b240-4798-8c22-33a308d1897e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:18.921888 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-579a77e6-b8f1-4069-8a13-d32a8f12d9ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3c418da198242b3a6d272899a169689', 'request_id': 'req-579a77e6-b8f1-4069-8a13-d32a8f12d9ab'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:18.922776 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b135d-b240-4798-8c22-33a308d1897e admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:18.927321 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-579a77e6-b8f1-4069-8a13-d32a8f12d9ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3c418da198242b3a6d272899a169689', 'request_id': 'req-579a77e6-b8f1-4069-8a13-d32a8f12d9ab'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:18.934803 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-579a77e6-b8f1-4069-8a13-d32a8f12d9ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3c418da198242b3a6d272899a169689', 'request_id': 'req-579a77e6-b8f1-4069-8a13-d32a8f12d9ab'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:18.948056 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-579a77e6-b8f1-4069-8a13-d32a8f12d9ab admin admin] The token cache is being invalidate because project a3c418da198242b3a6d272899a169689 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:35:18.948522 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-579a77e6-b8f1-4069-8a13-d32a8f12d9ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:18.949349 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-579a77e6-b8f1-4069-8a13-d32a8f12d9ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:18.954776 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1317/2624] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:35:18 2022] DELETE /identity/v3/projects/a3c418da198242b3a6d272899a169689 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:35:18.956425 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579a77e6-b8f1-4069-8a13-d32a8f12d9ab admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:18.958011 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-579a77e6-b8f1-4069-8a13-d32a8f12d9ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:18.991577 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47ea0d3-5529-46ea-babb-7855131ca2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:18.992708 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ea0d3-5529-46ea-babb-7855131ca2a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:18.993007 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ea0d3-5529-46ea-babb-7855131ca2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:18.993458 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ea0d3-5529-46ea-babb-7855131ca2a7 admin admin] PATH_INFO: `/v3/users/b5e24981873246ea9df9d121c8dc22a9` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:18.994679 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47ea0d3-5529-46ea-babb-7855131ca2a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5e24981873246ea9df9d121c8dc22a9)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:18.996636 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47ea0d3-5529-46ea-babb-7855131ca2a7 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:19.037174 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579a77e6-b8f1-4069-8a13-d32a8f12d9ab admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:19.042495 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa252527-0a8e-4927-aa31-ac1cd8774287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:19.043402 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa252527-0a8e-4927-aa31-ac1cd8774287 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:19.043684 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa252527-0a8e-4927-aa31-ac1cd8774287 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:19.043964 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa252527-0a8e-4927-aa31-ac1cd8774287 admin admin] PATH_INFO: `/v3/users/a5372dc75506416384842478aa49e146` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:19.046030 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa252527-0a8e-4927-aa31-ac1cd8774287 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5372dc75506416384842478aa49e146)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:19.047988 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa252527-0a8e-4927-aa31-ac1cd8774287 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:19.050604 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-c47ea0d3-5529-46ea-babb-7855131ca2a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5e24981873246ea9df9d121c8dc22a9'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:19.064328 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-c47ea0d3-5529-46ea-babb-7855131ca2a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5e24981873246ea9df9d121c8dc22a9'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:19.073464 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-c47ea0d3-5529-46ea-babb-7855131ca2a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5e24981873246ea9df9d121c8dc22a9'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:19.074160 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-c47ea0d3-5529-46ea-babb-7855131ca2a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5e24981873246ea9df9d121c8dc22a9'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:19.082831 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-c47ea0d3-5529-46ea-babb-7855131ca2a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5e24981873246ea9df9d121c8dc22a9'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:19.089799 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1308/2625] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:35:18 2022] DELETE /identity/v3/users/b5e24981873246ea9df9d121c8dc22a9 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:35:19.102642 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-aa252527-0a8e-4927-aa31-ac1cd8774287 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5372dc75506416384842478aa49e146'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:19.111481 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-aa252527-0a8e-4927-aa31-ac1cd8774287 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5372dc75506416384842478aa49e146'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:19.112376 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-aa252527-0a8e-4927-aa31-ac1cd8774287 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5372dc75506416384842478aa49e146'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:19.124160 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-aa252527-0a8e-4927-aa31-ac1cd8774287 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5372dc75506416384842478aa49e146'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:19.136075 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-aa252527-0a8e-4927-aa31-ac1cd8774287 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5372dc75506416384842478aa49e146'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:19.142597 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1318/2626] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:35:18 2022] DELETE /identity/v3/users/a5372dc75506416384842478aa49e146 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:35:19.390921 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47ea0d3-5529-46ea-babb-7855131ca2a7 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:19.395743 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-c47ea0d3-5529-46ea-babb-7855131ca2a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:19.473896 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47ea0d3-5529-46ea-babb-7855131ca2a7 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:19.539621 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa252527-0a8e-4927-aa31-ac1cd8774287 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:19.541296 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-aa252527-0a8e-4927-aa31-ac1cd8774287 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:19.543255 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365394a4-44b6-430c-a2ed-3e7f74018cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:19.544127 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365394a4-44b6-430c-a2ed-3e7f74018cb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:19.544420 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365394a4-44b6-430c-a2ed-3e7f74018cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:19.544705 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365394a4-44b6-430c-a2ed-3e7f74018cb6 admin admin] PATH_INFO: `/v3/projects/039eb3382c0646d4bd8cddff38364c12` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:19.546662 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365394a4-44b6-430c-a2ed-3e7f74018cb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=039eb3382c0646d4bd8cddff38364c12)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:19.548990 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365394a4-44b6-430c-a2ed-3e7f74018cb6 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:19.570003 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa252527-0a8e-4927-aa31-ac1cd8774287 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:19.574628 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ff2a4a-5661-4ae1-88c2-dd2f6d592a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:19.575543 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff2a4a-5661-4ae1-88c2-dd2f6d592a9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:19.575820 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff2a4a-5661-4ae1-88c2-dd2f6d592a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:19.576088 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff2a4a-5661-4ae1-88c2-dd2f6d592a9d admin admin] PATH_INFO: `/v3/projects/947d1e8d7d4a4f2bb18dd54e3f97fcb2` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:19.577645 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ff2a4a-5661-4ae1-88c2-dd2f6d592a9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=947d1e8d7d4a4f2bb18dd54e3f97fcb2)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:19.579945 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ff2a4a-5661-4ae1-88c2-dd2f6d592a9d admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:19.598044 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-365394a4-44b6-430c-a2ed-3e7f74018cb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '039eb3382c0646d4bd8cddff38364c12', 'request_id': 'req-365394a4-44b6-430c-a2ed-3e7f74018cb6'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:19.605641 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-365394a4-44b6-430c-a2ed-3e7f74018cb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '039eb3382c0646d4bd8cddff38364c12', 'request_id': 'req-365394a4-44b6-430c-a2ed-3e7f74018cb6'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:19.612171 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-365394a4-44b6-430c-a2ed-3e7f74018cb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '039eb3382c0646d4bd8cddff38364c12', 'request_id': 'req-365394a4-44b6-430c-a2ed-3e7f74018cb6'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:19.624384 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-365394a4-44b6-430c-a2ed-3e7f74018cb6 admin admin] The token cache is being invalidate because project 039eb3382c0646d4bd8cddff38364c12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:35:19.624676 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-365394a4-44b6-430c-a2ed-3e7f74018cb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:19.625345 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-365394a4-44b6-430c-a2ed-3e7f74018cb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:19.625983 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-a1ff2a4a-5661-4ae1-88c2-dd2f6d592a9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '947d1e8d7d4a4f2bb18dd54e3f97fcb2', 'request_id': 'req-a1ff2a4a-5661-4ae1-88c2-dd2f6d592a9d'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:19.626912 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1309/2627] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:35:19 2022] DELETE /identity/v3/projects/039eb3382c0646d4bd8cddff38364c12 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:35:19.631451 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-a1ff2a4a-5661-4ae1-88c2-dd2f6d592a9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '947d1e8d7d4a4f2bb18dd54e3f97fcb2', 'request_id': 'req-a1ff2a4a-5661-4ae1-88c2-dd2f6d592a9d'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:19.631700 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ffc6fb-6c71-4e6b-8647-d18989219910 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:19.631988 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ffc6fb-6c71-4e6b-8647-d18989219910 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:19.632263 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ffc6fb-6c71-4e6b-8647-d18989219910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:19.639896 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-a1ff2a4a-5661-4ae1-88c2-dd2f6d592a9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '947d1e8d7d4a4f2bb18dd54e3f97fcb2', 'request_id': 'req-a1ff2a4a-5661-4ae1-88c2-dd2f6d592a9d'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:19.654877 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-a1ff2a4a-5661-4ae1-88c2-dd2f6d592a9d admin admin] The token cache is being invalidate because project 947d1e8d7d4a4f2bb18dd54e3f97fcb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:35:19.654877 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-a1ff2a4a-5661-4ae1-88c2-dd2f6d592a9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:19.654877 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-a1ff2a4a-5661-4ae1-88c2-dd2f6d592a9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:19.655359 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-84ffc6fb-6c71-4e6b-8647-d18989219910 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:35:19.655462 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1319/2628] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:35:19 2022] DELETE /identity/v3/projects/947d1e8d7d4a4f2bb18dd54e3f97fcb2 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:35:19.655552 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-84ffc6fb-6c71-4e6b-8647-d18989219910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:19.659078 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6919f-ddcc-4ce6-84db-9057ad95be06 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:19.659350 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6919f-ddcc-4ce6-84db-9057ad95be06 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:19.659626 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6919f-ddcc-4ce6-84db-9057ad95be06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:19.680879 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-9ce6919f-ddcc-4ce6-84db-9057ad95be06 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:35:19.682144 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-9ce6919f-ddcc-4ce6-84db-9057ad95be06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:19.718451 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1310/2629] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:35:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 01:35:19.726575 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6986b250-6a84-46f4-b614-9a4ec9e8a9fb None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:19.726918 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6986b250-6a84-46f4-b614-9a4ec9e8a9fb None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:19.727198 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6986b250-6a84-46f4-b614-9a4ec9e8a9fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:19.743610 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1320/2630] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:35:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 01:35:19.750913 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-6986b250-6a84-46f4-b614-9a4ec9e8a9fb None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:35:19.752051 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f61780-9f17-4fed-a0d5-1632962469aa None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:19.752497 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-6986b250-6a84-46f4-b614-9a4ec9e8a9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:19.752711 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f61780-9f17-4fed-a0d5-1632962469aa None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:19.752711 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f61780-9f17-4fed-a0d5-1632962469aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:19.760580 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1311/2631] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:35:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:35:19.766895 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6986b250-6a84-46f4-b614-9a4ec9e8a9fb None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:19.772609 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-60f61780-9f17-4fed-a0d5-1632962469aa None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:35:19.773790 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-60f61780-9f17-4fed-a0d5-1632962469aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:19.774262 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6986b250-6a84-46f4-b614-9a4ec9e8a9fb None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:19.778835 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d95ee78-6453-41f1-b1e7-5dfdd1a87e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:19.779826 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d95ee78-6453-41f1-b1e7-5dfdd1a87e64 admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:19.780480 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d95ee78-6453-41f1-b1e7-5dfdd1a87e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:19.780758 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d95ee78-6453-41f1-b1e7-5dfdd1a87e64 admin admin] PATH_INFO: `/v3/domains` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:19.781476 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d95ee78-6453-41f1-b1e7-5dfdd1a87e64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:35:19.781788 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d95ee78-6453-41f1-b1e7-5dfdd1a87e64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:19.782651 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1321/2632] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:35:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:35:19.785815 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d95ee78-6453-41f1-b1e7-5dfdd1a87e64 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:19.786684 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f61780-9f17-4fed-a0d5-1632962469aa None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:19.799479 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1312/2633] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Mar 30 01:35:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:35:19.799661 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f61780-9f17-4fed-a0d5-1632962469aa None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:19.801036 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d95ee78-6453-41f1-b1e7-5dfdd1a87e64 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:19.801281 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d5c19-1599-4743-b3ac-21cdf20f03a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:19.801929 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d5c19-1599-4743-b3ac-21cdf20f03a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:19.802211 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d5c19-1599-4743-b3ac-21cdf20f03a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:19.802486 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d5c19-1599-4743-b3ac-21cdf20f03a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:19.803242 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9d5c19-1599-4743-b3ac-21cdf20f03a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:35:19.803548 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9d5c19-1599-4743-b3ac-21cdf20f03a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:19.805124 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9d5c19-1599-4743-b3ac-21cdf20f03a2 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:19.810492 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d95ee78-6453-41f1-b1e7-5dfdd1a87e64 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:19.815782 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2180e6a-9356-4399-a1cc-096751fbc92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:19.816414 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2180e6a-9356-4399-a1cc-096751fbc92b admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:19.816690 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2180e6a-9356-4399-a1cc-096751fbc92b admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:19.816963 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2180e6a-9356-4399-a1cc-096751fbc92b admin admin] PATH_INFO: `/v3/projects` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:19.820561 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1322/2634] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Mar 30 01:35:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:35:19.820738 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2180e6a-9356-4399-a1cc-096751fbc92b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:19.820738 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2180e6a-9356-4399-a1cc-096751fbc92b admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:19.821511 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d5c19-1599-4743-b3ac-21cdf20f03a2 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:19.831420 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d5c19-1599-4743-b3ac-21cdf20f03a2 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:19.836026 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00515f6-0f52-448a-8ec5-774ac8234806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:19.836657 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00515f6-0f52-448a-8ec5-774ac8234806 admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:19.836940 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00515f6-0f52-448a-8ec5-774ac8234806 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:19.837210 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00515f6-0f52-448a-8ec5-774ac8234806 admin admin] PATH_INFO: `/v3/projects` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:19.837884 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00515f6-0f52-448a-8ec5-774ac8234806 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:19.839815 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00515f6-0f52-448a-8ec5-774ac8234806 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:19.844868 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1313/2635] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:35:19 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 01:35:19.848814 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2180e6a-9356-4399-a1cc-096751fbc92b admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:19.867650 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1323/2636] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:35:19 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:35:19.871743 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00515f6-0f52-448a-8ec5-774ac8234806 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:19.910448 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2180e6a-9356-4399-a1cc-096751fbc92b admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:19.930628 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00515f6-0f52-448a-8ec5-774ac8234806 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:19.935275 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119bf1ce-10aa-400f-9dfb-51ffa552b1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:19.936449 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119bf1ce-10aa-400f-9dfb-51ffa552b1e6 admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:19.936906 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119bf1ce-10aa-400f-9dfb-51ffa552b1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:19.937181 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119bf1ce-10aa-400f-9dfb-51ffa552b1e6 admin admin] PATH_INFO: `/v3/users` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:19.937857 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119bf1ce-10aa-400f-9dfb-51ffa552b1e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:19.939786 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119bf1ce-10aa-400f-9dfb-51ffa552b1e6 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:19.960285 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1324/2637] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:35:19 2022] POST /identity/v3/users => generated 286 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 01:35:19.964233 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119bf1ce-10aa-400f-9dfb-51ffa552b1e6 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:19.965750 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5d488f-6111-43b6-a63a-4a3740736ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:19.966411 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d488f-6111-43b6-a63a-4a3740736ceb admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:19.966720 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d488f-6111-43b6-a63a-4a3740736ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:19.967147 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d488f-6111-43b6-a63a-4a3740736ceb admin admin] PATH_INFO: `/v3/users` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:19.967917 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5d488f-6111-43b6-a63a-4a3740736ceb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:19.969844 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5d488f-6111-43b6-a63a-4a3740736ceb admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:19.973770 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119bf1ce-10aa-400f-9dfb-51ffa552b1e6 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:19.978305 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead37de4-365e-4e52-a490-523fc71f7028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:19.978980 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead37de4-365e-4e52-a490-523fc71f7028 admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:19.979252 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead37de4-365e-4e52-a490-523fc71f7028 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:19.979545 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead37de4-365e-4e52-a490-523fc71f7028 admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:19.980233 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead37de4-365e-4e52-a490-523fc71f7028 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:19.981947 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead37de4-365e-4e52-a490-523fc71f7028 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:19.992614 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1314/2638] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:35:19 2022] POST /identity/v3/users => generated 293 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 01:35:19.992783 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1325/2639] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:35:19 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 01:35:19.993503 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5d488f-6111-43b6-a63a-4a3740736ceb admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:19.995817 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead37de4-365e-4e52-a490-523fc71f7028 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:20.003511 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5d488f-6111-43b6-a63a-4a3740736ceb admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:20.005918 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead37de4-365e-4e52-a490-523fc71f7028 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:20.008151 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf2daf-52c0-4491-a1d8-68647cd33c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:20.008794 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf2daf-52c0-4491-a1d8-68647cd33c58 admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:20.009078 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf2daf-52c0-4491-a1d8-68647cd33c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:20.009353 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf2daf-52c0-4491-a1d8-68647cd33c58 admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:20.010064 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaf2daf-52c0-4491-a1d8-68647cd33c58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:20.010445 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7603b1-657e-446a-b827-9217ac3b39c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:20.011108 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7603b1-657e-446a-b827-9217ac3b39c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:20.011388 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7603b1-657e-446a-b827-9217ac3b39c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:20.011658 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7603b1-657e-446a-b827-9217ac3b39c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:20.011761 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaf2daf-52c0-4491-a1d8-68647cd33c58 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:20.012363 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7603b1-657e-446a-b827-9217ac3b39c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:20.013997 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7603b1-657e-446a-b827-9217ac3b39c3 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:20.021577 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1315/2640] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:35:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 01:35:20.026556 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1326/2641] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:35:19 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 01:35:20.026761 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf2daf-52c0-4491-a1d8-68647cd33c58 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:20.027451 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7603b1-657e-446a-b827-9217ac3b39c3 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:20.036130 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf2daf-52c0-4491-a1d8-68647cd33c58 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:20.037414 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7603b1-657e-446a-b827-9217ac3b39c3 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:20.040998 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593f84e8-7e12-4192-a3a3-1f5749838cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:20.041788 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f84e8-7e12-4192-a3a3-1f5749838cca admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:20.041961 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6389e46c-9105-471a-b559-43b49848c14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:20.042100 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f84e8-7e12-4192-a3a3-1f5749838cca admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:20.042352 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f84e8-7e12-4192-a3a3-1f5749838cca admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:20.042833 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6389e46c-9105-471a-b559-43b49848c14d admin admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:20.043116 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593f84e8-7e12-4192-a3a3-1f5749838cca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:20.043258 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6389e46c-9105-471a-b559-43b49848c14d admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:20.043420 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6389e46c-9105-471a-b559-43b49848c14d admin admin] PATH_INFO: `/v3/projects/e9b32e08a5c14f3db8436e988689b820/users/f87fc11acf2f420a9c11ff0dd090e4a9/roles/7185d0cfbcd44502b1613bcfe1b42f6f` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:20.045731 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593f84e8-7e12-4192-a3a3-1f5749838cca admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:20.055598 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1316/2642] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:35:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 01:35:20.058028 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6389e46c-9105-471a-b559-43b49848c14d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9b32e08a5c14f3db8436e988689b820, user_id=f87fc11acf2f420a9c11ff0dd090e4a9, role_id=7185d0cfbcd44502b1613bcfe1b42f6f)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:20.059587 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593f84e8-7e12-4192-a3a3-1f5749838cca admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:20.060725 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6389e46c-9105-471a-b559-43b49848c14d admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:20.072318 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593f84e8-7e12-4192-a3a3-1f5749838cca admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:20.077597 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1327/2643] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:35:20 2022] PUT /identity/v3/projects/e9b32e08a5c14f3db8436e988689b820/users/f87fc11acf2f420a9c11ff0dd090e4a9/roles/7185d0cfbcd44502b1613bcfe1b42f6f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:35:20.090230 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e6907b-fa15-43ad-a7b3-6f566688529f None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:20.090525 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e6907b-fa15-43ad-a7b3-6f566688529f None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:20.090842 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e6907b-fa15-43ad-a7b3-6f566688529f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:20.118133 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-51e6907b-fa15-43ad-a7b3-6f566688529f None None] MFA Rules not processed for user `f87fc11acf2f420a9c11ff0dd090e4a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:35:20.119370 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-51e6907b-fa15-43ad-a7b3-6f566688529f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:20.129506 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d81e76-054c-47b7-94ad-45fa27bb1154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:20.130529 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d81e76-054c-47b7-94ad-45fa27bb1154 admin admin] REQUEST_METHOD: `PUT` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:20.130856 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d81e76-054c-47b7-94ad-45fa27bb1154 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:20.131126 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d81e76-054c-47b7-94ad-45fa27bb1154 admin admin] PATH_INFO: `/v3/projects/f209b912e4bd4a87ae03b6ffd2abe157/users/02c86bc6b7194462ab9f00b4bdc9f3e9/roles/7185d0cfbcd44502b1613bcfe1b42f6f` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:20.144938 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d81e76-054c-47b7-94ad-45fa27bb1154 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f209b912e4bd4a87ae03b6ffd2abe157, user_id=02c86bc6b7194462ab9f00b4bdc9f3e9, role_id=7185d0cfbcd44502b1613bcfe1b42f6f)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:20.147609 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d81e76-054c-47b7-94ad-45fa27bb1154 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:20.164116 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1317/2644] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:35:20 2022] PUT /identity/v3/projects/f209b912e4bd4a87ae03b6ffd2abe157/users/02c86bc6b7194462ab9f00b4bdc9f3e9/roles/7185d0cfbcd44502b1613bcfe1b42f6f => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:35:20.169046 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4530d36-98db-4bcc-ae83-a5095359941e None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:20.169343 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4530d36-98db-4bcc-ae83-a5095359941e None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:20.169697 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4530d36-98db-4bcc-ae83-a5095359941e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:20.184179 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1328/2645] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:35:20 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:35:20.187309 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-a4530d36-98db-4bcc-ae83-a5095359941e None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:35:20.188602 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-a4530d36-98db-4bcc-ae83-a5095359941e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:20.195436 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e6907b-fa15-43ad-a7b3-6f566688529f None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:20.196765 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-51e6907b-fa15-43ad-a7b3-6f566688529f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:20.255842 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e6907b-fa15-43ad-a7b3-6f566688529f None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:20.261334 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1318/2646] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:35:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 01:35:20.271055 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4530d36-98db-4bcc-ae83-a5095359941e None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:20.272483 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-a4530d36-98db-4bcc-ae83-a5095359941e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:20.311941 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8dfb49-1df6-4137-bfcf-b26ca547c82d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45219f386f0147b6bd380efe4ab62812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:20.312346 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8dfb49-1df6-4137-bfcf-b26ca547c82d service cinder] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:20.312635 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8dfb49-1df6-4137-bfcf-b26ca547c82d service cinder] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:20.312913 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8dfb49-1df6-4137-bfcf-b26ca547c82d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:20.334460 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4530d36-98db-4bcc-ae83-a5095359941e None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:20.338085 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53a8086-a349-425e-a68a-d93face73bb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:20.338810 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a8086-a349-425e-a68a-d93face73bb0 service neutron] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:20.339097 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a8086-a349-425e-a68a-d93face73bb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:20.339371 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a8086-a349-425e-a68a-d93face73bb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:20.348496 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53a8086-a349-425e-a68a-d93face73bb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:20.349930 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53a8086-a349-425e-a68a-d93face73bb0 service neutron] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:20.360028 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1319/2647] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:35:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:35:20.369158 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8dfb49-1df6-4137-bfcf-b26ca547c82d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:20.370604 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8dfb49-1df6-4137-bfcf-b26ca547c82d service cinder] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:20.380345 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1329/2648] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:35:20 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 30 01:35:20.405171 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53a8086-a349-425e-a68a-d93face73bb0 service neutron] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:20.414740 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53a8086-a349-425e-a68a-d93face73bb0 service neutron] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:20.420765 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ea4c2-ff3b-4b2a-9889-d4fa45ea6a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:20.421090 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ea4c2-ff3b-4b2a-9889-d4fa45ea6a67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:20.421371 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ea4c2-ff3b-4b2a-9889-d4fa45ea6a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:20.421642 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ea4c2-ff3b-4b2a-9889-d4fa45ea6a67 admin admin] PATH_INFO: `/v3/users/f87fc11acf2f420a9c11ff0dd090e4a9` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:20.423031 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5ea4c2-ff3b-4b2a-9889-d4fa45ea6a67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f87fc11acf2f420a9c11ff0dd090e4a9)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:20.424957 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5ea4c2-ff3b-4b2a-9889-d4fa45ea6a67 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:20.476777 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-8e5ea4c2-ff3b-4b2a-9889-d4fa45ea6a67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f87fc11acf2f420a9c11ff0dd090e4a9'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:20.490997 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-8e5ea4c2-ff3b-4b2a-9889-d4fa45ea6a67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f87fc11acf2f420a9c11ff0dd090e4a9'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:20.499784 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-8e5ea4c2-ff3b-4b2a-9889-d4fa45ea6a67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f87fc11acf2f420a9c11ff0dd090e4a9'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:20.500612 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-8e5ea4c2-ff3b-4b2a-9889-d4fa45ea6a67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f87fc11acf2f420a9c11ff0dd090e4a9'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:20.511926 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-8e5ea4c2-ff3b-4b2a-9889-d4fa45ea6a67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f87fc11acf2f420a9c11ff0dd090e4a9'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:20.521573 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1320/2649] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:35:20 2022] DELETE /identity/v3/users/f87fc11acf2f420a9c11ff0dd090e4a9 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:35:20.527439 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dff749-5237-4dcf-b730-e002897a0357 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:20.527730 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dff749-5237-4dcf-b730-e002897a0357 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:20.528172 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dff749-5237-4dcf-b730-e002897a0357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:20.548374 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-24dff749-5237-4dcf-b730-e002897a0357 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:35:20.549354 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-24dff749-5237-4dcf-b730-e002897a0357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:20.620483 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1330/2650] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:35:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 01:35:20.628321 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ea4c2-ff3b-4b2a-9889-d4fa45ea6a67 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:20.629916 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-8e5ea4c2-ff3b-4b2a-9889-d4fa45ea6a67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:20.692902 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ea4c2-ff3b-4b2a-9889-d4fa45ea6a67 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:20.697062 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80865367-57e9-4b4c-8947-7c0dbb7ce6be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:20.697771 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80865367-57e9-4b4c-8947-7c0dbb7ce6be service neutron] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:20.698064 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80865367-57e9-4b4c-8947-7c0dbb7ce6be service neutron] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:20.698344 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80865367-57e9-4b4c-8947-7c0dbb7ce6be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:20.708264 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80865367-57e9-4b4c-8947-7c0dbb7ce6be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:20.709719 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80865367-57e9-4b4c-8947-7c0dbb7ce6be service neutron] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:20.722864 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1321/2651] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:35:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:35:21.011910 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dff749-5237-4dcf-b730-e002897a0357 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:21.013367 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-24dff749-5237-4dcf-b730-e002897a0357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:21.027001 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dff749-5237-4dcf-b730-e002897a0357 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:21.033346 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0275637f-1da6-4c45-9625-48d85521341a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:21.034445 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0275637f-1da6-4c45-9625-48d85521341a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:21.034939 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0275637f-1da6-4c45-9625-48d85521341a admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:21.035356 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0275637f-1da6-4c45-9625-48d85521341a admin admin] PATH_INFO: `/v3/projects/e9b32e08a5c14f3db8436e988689b820` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:21.037215 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0275637f-1da6-4c45-9625-48d85521341a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9b32e08a5c14f3db8436e988689b820)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:21.039556 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0275637f-1da6-4c45-9625-48d85521341a admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:21.090553 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-0275637f-1da6-4c45-9625-48d85521341a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9b32e08a5c14f3db8436e988689b820', 'request_id': 'req-0275637f-1da6-4c45-9625-48d85521341a'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:21.096030 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-0275637f-1da6-4c45-9625-48d85521341a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9b32e08a5c14f3db8436e988689b820', 'request_id': 'req-0275637f-1da6-4c45-9625-48d85521341a'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:21.103467 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-0275637f-1da6-4c45-9625-48d85521341a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9b32e08a5c14f3db8436e988689b820', 'request_id': 'req-0275637f-1da6-4c45-9625-48d85521341a'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:21.115435 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-0275637f-1da6-4c45-9625-48d85521341a admin admin] The token cache is being invalidate because project e9b32e08a5c14f3db8436e988689b820 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:35:21.115728 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-0275637f-1da6-4c45-9625-48d85521341a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:21.116375 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-0275637f-1da6-4c45-9625-48d85521341a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:21.117940 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1331/2652] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:35:21 2022] DELETE /identity/v3/projects/e9b32e08a5c14f3db8436e988689b820 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:35:21.124323 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f7382-1a3c-4c46-8bcc-e1bef6637471 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:21.124837 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f7382-1a3c-4c46-8bcc-e1bef6637471 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:21.125120 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f7382-1a3c-4c46-8bcc-e1bef6637471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:21.150179 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-c09f7382-1a3c-4c46-8bcc-e1bef6637471 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:35:21.151948 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-c09f7382-1a3c-4c46-8bcc-e1bef6637471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:21.243727 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1322/2653] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:35:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 01:35:21.251424 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769feb3a-cd28-4650-af20-d9dfa8f8273a None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:21.251932 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769feb3a-cd28-4650-af20-d9dfa8f8273a None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:21.252402 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769feb3a-cd28-4650-af20-d9dfa8f8273a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:21.275683 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-769feb3a-cd28-4650-af20-d9dfa8f8273a None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:35:21.277230 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-769feb3a-cd28-4650-af20-d9dfa8f8273a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:21.288318 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1332/2654] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:35:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:35:21.292521 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09f7382-1a3c-4c46-8bcc-e1bef6637471 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:21.306515 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09f7382-1a3c-4c46-8bcc-e1bef6637471 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:21.312006 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb7a75-14de-404d-b23c-0114d006ddc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:21.312811 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb7a75-14de-404d-b23c-0114d006ddc5 admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:21.313160 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb7a75-14de-404d-b23c-0114d006ddc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:21.313507 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb7a75-14de-404d-b23c-0114d006ddc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:21.314308 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fb7a75-14de-404d-b23c-0114d006ddc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:35:21.314683 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fb7a75-14de-404d-b23c-0114d006ddc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:21.316400 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fb7a75-14de-404d-b23c-0114d006ddc5 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:21.334776 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1323/2655] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Mar 30 01:35:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:35:21.335403 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769feb3a-cd28-4650-af20-d9dfa8f8273a None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:21.348383 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769feb3a-cd28-4650-af20-d9dfa8f8273a None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:21.353782 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef90d68-6d03-4d26-aa28-70aab68a88b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:21.355024 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef90d68-6d03-4d26-aa28-70aab68a88b3 admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:21.355512 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef90d68-6d03-4d26-aa28-70aab68a88b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:21.355858 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef90d68-6d03-4d26-aa28-70aab68a88b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:21.356658 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef90d68-6d03-4d26-aa28-70aab68a88b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:21.359033 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef90d68-6d03-4d26-aa28-70aab68a88b3 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:21.396075 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1333/2656] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:35:21 2022] POST /identity/v3/projects => generated 397 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:35:21.400100 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb7a75-14de-404d-b23c-0114d006ddc5 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:21.412337 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb7a75-14de-404d-b23c-0114d006ddc5 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:21.481627 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f7d929-cae9-4c1c-8340-3185ac056998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:21.482306 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7d929-cae9-4c1c-8340-3185ac056998 admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:21.483474 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7d929-cae9-4c1c-8340-3185ac056998 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:21.484087 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7d929-cae9-4c1c-8340-3185ac056998 admin admin] PATH_INFO: `/v3/users` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:21.484925 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f7d929-cae9-4c1c-8340-3185ac056998 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:21.486981 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f7d929-cae9-4c1c-8340-3185ac056998 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:21.522808 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1324/2657] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:35:21 2022] POST /identity/v3/users => generated 299 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 01:35:21.526392 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef90d68-6d03-4d26-aa28-70aab68a88b3 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:21.540950 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef90d68-6d03-4d26-aa28-70aab68a88b3 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:21.548933 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221865e5-438b-408c-b144-e3071bfca292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:21.549750 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221865e5-438b-408c-b144-e3071bfca292 admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:21.550136 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221865e5-438b-408c-b144-e3071bfca292 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:21.550971 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221865e5-438b-408c-b144-e3071bfca292 admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:21.552342 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221865e5-438b-408c-b144-e3071bfca292 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:21.554879 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221865e5-438b-408c-b144-e3071bfca292 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:21.570809 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1334/2658] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:35:21 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:35:21.575094 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f7d929-cae9-4c1c-8340-3185ac056998 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:21.587417 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f7d929-cae9-4c1c-8340-3185ac056998 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:21.595482 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03f2506-e293-4e55-8fdc-c878b3e352ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:21.596288 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f2506-e293-4e55-8fdc-c878b3e352ff admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:21.596617 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f2506-e293-4e55-8fdc-c878b3e352ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:21.596896 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f2506-e293-4e55-8fdc-c878b3e352ff admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:21.597661 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03f2506-e293-4e55-8fdc-c878b3e352ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:21.599617 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03f2506-e293-4e55-8fdc-c878b3e352ff admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:21.611813 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1325/2659] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:35:21 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 01:35:21.615814 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221865e5-438b-408c-b144-e3071bfca292 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:21.626068 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221865e5-438b-408c-b144-e3071bfca292 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:21.632251 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a968ff44-21fc-415b-9f70-33caec1de3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:21.633140 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a968ff44-21fc-415b-9f70-33caec1de3b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:21.633442 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a968ff44-21fc-415b-9f70-33caec1de3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:21.633739 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a968ff44-21fc-415b-9f70-33caec1de3b1 admin admin] PATH_INFO: `/v3/projects/5581b53d30e64ecab15bb87bdf321839/users/33d0af2adf994737ac3819f6bd47418f/roles/7185d0cfbcd44502b1613bcfe1b42f6f` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:21.668063 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a968ff44-21fc-415b-9f70-33caec1de3b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5581b53d30e64ecab15bb87bdf321839, user_id=33d0af2adf994737ac3819f6bd47418f, role_id=7185d0cfbcd44502b1613bcfe1b42f6f)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:21.673004 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a968ff44-21fc-415b-9f70-33caec1de3b1 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:21.699294 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1335/2660] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:35:21 2022] PUT /identity/v3/projects/5581b53d30e64ecab15bb87bdf321839/users/33d0af2adf994737ac3819f6bd47418f/roles/7185d0cfbcd44502b1613bcfe1b42f6f => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:35:21.712561 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07ddb3-f5ba-4e01-9b4f-d8562124d9fd None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:21.713162 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07ddb3-f5ba-4e01-9b4f-d8562124d9fd None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:21.713644 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07ddb3-f5ba-4e01-9b4f-d8562124d9fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:21.772577 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-be07ddb3-f5ba-4e01-9b4f-d8562124d9fd None None] MFA Rules not processed for user `33d0af2adf994737ac3819f6bd47418f`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:35:21.775408 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-be07ddb3-f5ba-4e01-9b4f-d8562124d9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:21.878198 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1326/2661] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:35:21 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:35:21.899791 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a968ff44-21fc-415b-9f70-33caec1de3b1 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:21.902101 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-a968ff44-21fc-415b-9f70-33caec1de3b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:21.983761 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a968ff44-21fc-415b-9f70-33caec1de3b1 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:21.988631 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdadb888-8bf0-4e37-9e3f-68a2b430c310 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45219f386f0147b6bd380efe4ab62812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:21.989678 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdadb888-8bf0-4e37-9e3f-68a2b430c310 service cinder] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:21.989678 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdadb888-8bf0-4e37-9e3f-68a2b430c310 service cinder] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:21.989866 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdadb888-8bf0-4e37-9e3f-68a2b430c310 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:21.999847 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdadb888-8bf0-4e37-9e3f-68a2b430c310 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:22.001408 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdadb888-8bf0-4e37-9e3f-68a2b430c310 service cinder] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:22.033566 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1336/2662] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:35:21 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:35:25.877835 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5213d0e5-4a7e-4fa7-a710-483d7a949711 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:25.878298 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5213d0e5-4a7e-4fa7-a710-483d7a949711 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:25.878380 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5213d0e5-4a7e-4fa7-a710-483d7a949711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:25.931859 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-5213d0e5-4a7e-4fa7-a710-483d7a949711 None None] MFA Rules not processed for user `02c86bc6b7194462ab9f00b4bdc9f3e9`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:35:25.933085 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-5213d0e5-4a7e-4fa7-a710-483d7a949711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:25.998926 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1327/2663] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:35:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:35:26.010497 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdadb888-8bf0-4e37-9e3f-68a2b430c310 service cinder] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:26.012151 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-fdadb888-8bf0-4e37-9e3f-68a2b430c310 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:26.090644 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdadb888-8bf0-4e37-9e3f-68a2b430c310 service cinder] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:26.098935 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31351367-9126-4ca9-be5d-abf67f65d771 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140c6d1a20e94192bde06e72040f162d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:26.099590 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31351367-9126-4ca9-be5d-abf67f65d771 service nova] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:26.099871 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31351367-9126-4ca9-be5d-abf67f65d771 service nova] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:26.100230 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31351367-9126-4ca9-be5d-abf67f65d771 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:26.108952 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31351367-9126-4ca9-be5d-abf67f65d771 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:26.110560 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31351367-9126-4ca9-be5d-abf67f65d771 service nova] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:26.120025 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1337/2664] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:35:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:35:28.523430 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d863c4-3582-43e8-b039-677853594c94 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:28.524164 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d863c4-3582-43e8-b039-677853594c94 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:28.524600 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d863c4-3582-43e8-b039-677853594c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:28.549504 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-d6d863c4-3582-43e8-b039-677853594c94 None None] MFA Rules not processed for user `02c86bc6b7194462ab9f00b4bdc9f3e9`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:35:28.552868 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-d6d863c4-3582-43e8-b039-677853594c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:28.594198 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1328/2665] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:35:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 01:35:29.079874 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31351367-9126-4ca9-be5d-abf67f65d771 service nova] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:29.081704 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-31351367-9126-4ca9-be5d-abf67f65d771 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:29.171618 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31351367-9126-4ca9-be5d-abf67f65d771 service nova] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:29.176703 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca846acd-186a-4e09-b078-e6ceecbbfc9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:29.177603 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca846acd-186a-4e09-b078-e6ceecbbfc9e service neutron] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:29.177942 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca846acd-186a-4e09-b078-e6ceecbbfc9e service neutron] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:29.178424 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca846acd-186a-4e09-b078-e6ceecbbfc9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:29.180522 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-ca846acd-186a-4e09-b078-e6ceecbbfc9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:29.262215 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca846acd-186a-4e09-b078-e6ceecbbfc9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:29.265188 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca846acd-186a-4e09-b078-e6ceecbbfc9e service neutron] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:29.284525 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1338/2666] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:35:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:35:29.828995 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d863c4-3582-43e8-b039-677853594c94 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:29.843232 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d863c4-3582-43e8-b039-677853594c94 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:29.848169 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e949a6-019f-45df-b305-2951c1bd24c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:29.849274 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e949a6-019f-45df-b305-2951c1bd24c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:29.849724 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e949a6-019f-45df-b305-2951c1bd24c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:29.850006 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e949a6-019f-45df-b305-2951c1bd24c0 admin admin] PATH_INFO: `/v3/users/33d0af2adf994737ac3819f6bd47418f` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:29.851267 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e949a6-019f-45df-b305-2951c1bd24c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33d0af2adf994737ac3819f6bd47418f)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:29.854351 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e949a6-019f-45df-b305-2951c1bd24c0 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:29.931331 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-f0e949a6-019f-45df-b305-2951c1bd24c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33d0af2adf994737ac3819f6bd47418f'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:29.946453 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-f0e949a6-019f-45df-b305-2951c1bd24c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33d0af2adf994737ac3819f6bd47418f'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:29.960076 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-f0e949a6-019f-45df-b305-2951c1bd24c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33d0af2adf994737ac3819f6bd47418f'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:29.962151 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-f0e949a6-019f-45df-b305-2951c1bd24c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33d0af2adf994737ac3819f6bd47418f'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:29.992651 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-f0e949a6-019f-45df-b305-2951c1bd24c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33d0af2adf994737ac3819f6bd47418f'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:30.010510 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1329/2667] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:35:29 2022] DELETE /identity/v3/users/33d0af2adf994737ac3819f6bd47418f => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:35:30.015624 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472ef9d-f221-49c2-a078-522590aacbf7 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:30.015943 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472ef9d-f221-49c2-a078-522590aacbf7 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:30.016191 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472ef9d-f221-49c2-a078-522590aacbf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:30.040003 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-b472ef9d-f221-49c2-a078-522590aacbf7 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:35:30.041565 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-b472ef9d-f221-49c2-a078-522590aacbf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:30.167161 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1339/2668] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:35:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 01:35:30.197652 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e949a6-019f-45df-b305-2951c1bd24c0 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:30.199027 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-f0e949a6-019f-45df-b305-2951c1bd24c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:30.324352 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e949a6-019f-45df-b305-2951c1bd24c0 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:30.330836 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41526683-19f8-47b9-9cf5-ee563d7186e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:30.331868 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41526683-19f8-47b9-9cf5-ee563d7186e8 service neutron] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:30.332298 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41526683-19f8-47b9-9cf5-ee563d7186e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:30.332653 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41526683-19f8-47b9-9cf5-ee563d7186e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:30.352026 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41526683-19f8-47b9-9cf5-ee563d7186e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:30.353848 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41526683-19f8-47b9-9cf5-ee563d7186e8 service neutron] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:30.367153 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1330/2669] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:35:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:35:31.125583 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b472ef9d-f221-49c2-a078-522590aacbf7 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:31.128029 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-b472ef9d-f221-49c2-a078-522590aacbf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:31.147012 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b472ef9d-f221-49c2-a078-522590aacbf7 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:31.156001 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3e0d54-7ce1-40df-b1a2-3010d1792771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:31.157476 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3e0d54-7ce1-40df-b1a2-3010d1792771 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:31.157768 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3e0d54-7ce1-40df-b1a2-3010d1792771 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:31.158047 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3e0d54-7ce1-40df-b1a2-3010d1792771 admin admin] PATH_INFO: `/v3/projects/5581b53d30e64ecab15bb87bdf321839` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:31.160651 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3e0d54-7ce1-40df-b1a2-3010d1792771 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5581b53d30e64ecab15bb87bdf321839)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:31.163747 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3e0d54-7ce1-40df-b1a2-3010d1792771 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:31.266559 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-5d3e0d54-7ce1-40df-b1a2-3010d1792771 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5581b53d30e64ecab15bb87bdf321839', 'request_id': 'req-5d3e0d54-7ce1-40df-b1a2-3010d1792771'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:31.273291 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-5d3e0d54-7ce1-40df-b1a2-3010d1792771 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5581b53d30e64ecab15bb87bdf321839', 'request_id': 'req-5d3e0d54-7ce1-40df-b1a2-3010d1792771'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:31.284148 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-5d3e0d54-7ce1-40df-b1a2-3010d1792771 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5581b53d30e64ecab15bb87bdf321839', 'request_id': 'req-5d3e0d54-7ce1-40df-b1a2-3010d1792771'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:31.304098 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-5d3e0d54-7ce1-40df-b1a2-3010d1792771 admin admin] The token cache is being invalidate because project 5581b53d30e64ecab15bb87bdf321839 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:35:31.304779 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-5d3e0d54-7ce1-40df-b1a2-3010d1792771 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:31.305721 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-5d3e0d54-7ce1-40df-b1a2-3010d1792771 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:31.308145 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1340/2670] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:35:31 2022] DELETE /identity/v3/projects/5581b53d30e64ecab15bb87bdf321839 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:35:34.113865 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41526683-19f8-47b9-9cf5-ee563d7186e8 service neutron] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:34.118878 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-41526683-19f8-47b9-9cf5-ee563d7186e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:34.141201 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41526683-19f8-47b9-9cf5-ee563d7186e8 service neutron] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:34.209218 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b37b56-bb37-4d95-9259-1c00d7b6086f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:34.210091 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b37b56-bb37-4d95-9259-1c00d7b6086f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:34.210372 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b37b56-bb37-4d95-9259-1c00d7b6086f admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:34.210650 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b37b56-bb37-4d95-9259-1c00d7b6086f admin admin] PATH_INFO: `/v3/users/4a2bf75cc4e3465987b8450318708b49` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:34.211903 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b37b56-bb37-4d95-9259-1c00d7b6086f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a2bf75cc4e3465987b8450318708b49)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:34.213976 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b37b56-bb37-4d95-9259-1c00d7b6086f admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:34.287732 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-57b37b56-bb37-4d95-9259-1c00d7b6086f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a2bf75cc4e3465987b8450318708b49'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:34.301292 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-57b37b56-bb37-4d95-9259-1c00d7b6086f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a2bf75cc4e3465987b8450318708b49'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:34.309664 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-57b37b56-bb37-4d95-9259-1c00d7b6086f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a2bf75cc4e3465987b8450318708b49'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:34.310840 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-57b37b56-bb37-4d95-9259-1c00d7b6086f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a2bf75cc4e3465987b8450318708b49'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:34.318899 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-57b37b56-bb37-4d95-9259-1c00d7b6086f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a2bf75cc4e3465987b8450318708b49'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:34.325543 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1331/2671] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:35:34 2022] DELETE /identity/v3/users/4a2bf75cc4e3465987b8450318708b49 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:35:34.808714 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3e0d54-7ce1-40df-b1a2-3010d1792771 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:34.811544 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-5d3e0d54-7ce1-40df-b1a2-3010d1792771 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:34.825065 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3e0d54-7ce1-40df-b1a2-3010d1792771 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:34.891329 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb47d807-3f63-4890-a3de-96ca017ef0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:34.892193 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47d807-3f63-4890-a3de-96ca017ef0ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:34.892476 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47d807-3f63-4890-a3de-96ca017ef0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:34.892754 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47d807-3f63-4890-a3de-96ca017ef0ae admin admin] PATH_INFO: `/v3/projects/40c47efe85b3419bbfe4af492f367fa3` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:34.893932 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb47d807-3f63-4890-a3de-96ca017ef0ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=40c47efe85b3419bbfe4af492f367fa3)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:34.895864 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb47d807-3f63-4890-a3de-96ca017ef0ae admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:34.941881 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-bb47d807-3f63-4890-a3de-96ca017ef0ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40c47efe85b3419bbfe4af492f367fa3', 'request_id': 'req-bb47d807-3f63-4890-a3de-96ca017ef0ae'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:34.947084 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-bb47d807-3f63-4890-a3de-96ca017ef0ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40c47efe85b3419bbfe4af492f367fa3', 'request_id': 'req-bb47d807-3f63-4890-a3de-96ca017ef0ae'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:34.954157 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-bb47d807-3f63-4890-a3de-96ca017ef0ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40c47efe85b3419bbfe4af492f367fa3', 'request_id': 'req-bb47d807-3f63-4890-a3de-96ca017ef0ae'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:34.964871 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-bb47d807-3f63-4890-a3de-96ca017ef0ae admin admin] The token cache is being invalidate because project 40c47efe85b3419bbfe4af492f367fa3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:35:34.965157 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-bb47d807-3f63-4890-a3de-96ca017ef0ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:34.965785 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-bb47d807-3f63-4890-a3de-96ca017ef0ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:34.967945 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1341/2672] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:35:34 2022] DELETE /identity/v3/projects/40c47efe85b3419bbfe4af492f367fa3 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:35:34.972833 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743656df-f01e-4134-b9bb-dfbbd0cc178e None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:34.973106 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743656df-f01e-4134-b9bb-dfbbd0cc178e None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:34.973385 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743656df-f01e-4134-b9bb-dfbbd0cc178e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:34.993260 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-743656df-f01e-4134-b9bb-dfbbd0cc178e None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:35:34.994451 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-743656df-f01e-4134-b9bb-dfbbd0cc178e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:35.052311 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1332/2673] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:35:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:35:35.060104 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6c399-b518-48dd-86d9-5d7bf356ad59 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:35.060425 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6c399-b518-48dd-86d9-5d7bf356ad59 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:35.060701 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6c399-b518-48dd-86d9-5d7bf356ad59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:35.078416 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-80a6c399-b518-48dd-86d9-5d7bf356ad59 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:35:35.079632 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-80a6c399-b518-48dd-86d9-5d7bf356ad59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:35.087622 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1342/2674] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:35:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:35:35.092300 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743656df-f01e-4134-b9bb-dfbbd0cc178e None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:35.101895 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743656df-f01e-4134-b9bb-dfbbd0cc178e None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:35.106472 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c94bf3-2584-48b9-86e2-97bccc7f515f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:35.107224 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c94bf3-2584-48b9-86e2-97bccc7f515f admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:35.107547 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c94bf3-2584-48b9-86e2-97bccc7f515f admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:35.107862 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c94bf3-2584-48b9-86e2-97bccc7f515f admin admin] PATH_INFO: `/v3/domains` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:35.108578 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c94bf3-2584-48b9-86e2-97bccc7f515f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:35:35.108884 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c94bf3-2584-48b9-86e2-97bccc7f515f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:35.110456 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c94bf3-2584-48b9-86e2-97bccc7f515f admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:35.121724 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1333/2675] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Mar 30 01:35:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:35:35.126521 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a6c399-b518-48dd-86d9-5d7bf356ad59 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:35.135587 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a6c399-b518-48dd-86d9-5d7bf356ad59 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:35.141031 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885255df-fc2b-4830-93f5-a819ee4c7d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:35.141677 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885255df-fc2b-4830-93f5-a819ee4c7d6f admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:35.141961 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885255df-fc2b-4830-93f5-a819ee4c7d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:35.142239 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885255df-fc2b-4830-93f5-a819ee4c7d6f admin admin] PATH_INFO: `/v3/projects` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:35.142968 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885255df-fc2b-4830-93f5-a819ee4c7d6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:35.144864 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885255df-fc2b-4830-93f5-a819ee4c7d6f admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:35.169761 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1343/2676] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:35:35 2022] POST /identity/v3/projects => generated 369 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:35:35.174103 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c94bf3-2584-48b9-86e2-97bccc7f515f admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:35.184035 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c94bf3-2584-48b9-86e2-97bccc7f515f admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:35.239078 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a148037-23ba-4f0d-9c54-660f46599e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:35.239733 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a148037-23ba-4f0d-9c54-660f46599e2f admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:35.240017 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a148037-23ba-4f0d-9c54-660f46599e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:35.240293 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a148037-23ba-4f0d-9c54-660f46599e2f admin admin] PATH_INFO: `/v3/users` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:35.240974 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a148037-23ba-4f0d-9c54-660f46599e2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:35.242893 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a148037-23ba-4f0d-9c54-660f46599e2f admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:35.262717 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1334/2677] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:35:35 2022] POST /identity/v3/users => generated 285 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 01:35:35.267596 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885255df-fc2b-4830-93f5-a819ee4c7d6f admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:35.277588 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885255df-fc2b-4830-93f5-a819ee4c7d6f admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:35.282816 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ccd681-9fd7-4c8d-8450-1977167a301e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:35.283469 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ccd681-9fd7-4c8d-8450-1977167a301e admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:35.283752 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ccd681-9fd7-4c8d-8450-1977167a301e admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:35.284028 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ccd681-9fd7-4c8d-8450-1977167a301e admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:35.284748 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ccd681-9fd7-4c8d-8450-1977167a301e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:35.286325 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ccd681-9fd7-4c8d-8450-1977167a301e admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:35.300136 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1344/2678] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:35:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:35:35.301265 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a148037-23ba-4f0d-9c54-660f46599e2f admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:35.312600 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a148037-23ba-4f0d-9c54-660f46599e2f admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:35.317355 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4498ca3b-27e5-4062-ab74-6f9228c0d376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:35.318010 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4498ca3b-27e5-4062-ab74-6f9228c0d376 admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:35.318292 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4498ca3b-27e5-4062-ab74-6f9228c0d376 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:35.318569 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4498ca3b-27e5-4062-ab74-6f9228c0d376 admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:35.319328 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4498ca3b-27e5-4062-ab74-6f9228c0d376 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:35.320907 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4498ca3b-27e5-4062-ab74-6f9228c0d376 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:35.330897 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1335/2679] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:35:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:35:35.334996 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ccd681-9fd7-4c8d-8450-1977167a301e admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:35.344985 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ccd681-9fd7-4c8d-8450-1977167a301e admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:35.349540 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f475c99e-fa62-4603-8670-403d8f5b7a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:35.350408 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475c99e-fa62-4603-8670-403d8f5b7a4a admin admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:35.350689 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475c99e-fa62-4603-8670-403d8f5b7a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:35.351064 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475c99e-fa62-4603-8670-403d8f5b7a4a admin admin] PATH_INFO: `/v3/projects/b4e06a6a4bab44e88cf2c816289890bb/users/0dca431d4235420096a1f0d95b7cae1d/roles/7185d0cfbcd44502b1613bcfe1b42f6f` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:35.366917 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f475c99e-fa62-4603-8670-403d8f5b7a4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4e06a6a4bab44e88cf2c816289890bb, user_id=0dca431d4235420096a1f0d95b7cae1d, role_id=7185d0cfbcd44502b1613bcfe1b42f6f)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:35.369531 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f475c99e-fa62-4603-8670-403d8f5b7a4a admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:35.382787 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1345/2680] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:35:35 2022] PUT /identity/v3/projects/b4e06a6a4bab44e88cf2c816289890bb/users/0dca431d4235420096a1f0d95b7cae1d/roles/7185d0cfbcd44502b1613bcfe1b42f6f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:35:35.393746 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a160d-3e50-4c6e-b613-e499dd9e4eac None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:35.394040 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a160d-3e50-4c6e-b613-e499dd9e4eac None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:35.394317 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a160d-3e50-4c6e-b613-e499dd9e4eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:35.421178 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-cb1a160d-3e50-4c6e-b613-e499dd9e4eac None None] MFA Rules not processed for user `0dca431d4235420096a1f0d95b7cae1d`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:35:35.422404 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-cb1a160d-3e50-4c6e-b613-e499dd9e4eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:35.484012 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1336/2681] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:35:35 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:35:35.488432 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f475c99e-fa62-4603-8670-403d8f5b7a4a admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:35.548176 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f475c99e-fa62-4603-8670-403d8f5b7a4a admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:35.552963 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69bdd73-d37f-4dbd-80d2-9a2f71e7c105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:35.553619 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69bdd73-d37f-4dbd-80d2-9a2f71e7c105 admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:35.553927 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69bdd73-d37f-4dbd-80d2-9a2f71e7c105 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:35.554205 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69bdd73-d37f-4dbd-80d2-9a2f71e7c105 admin admin] PATH_INFO: `/v3/projects` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:35.554914 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69bdd73-d37f-4dbd-80d2-9a2f71e7c105 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:35.556801 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69bdd73-d37f-4dbd-80d2-9a2f71e7c105 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:35.582152 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1346/2682] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:35:35 2022] POST /identity/v3/projects => generated 369 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:35:35.586188 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1a160d-3e50-4c6e-b613-e499dd9e4eac None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:35.597169 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1a160d-3e50-4c6e-b613-e499dd9e4eac None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:35.652921 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c753c0-d3e8-4146-86c5-a6680b6c48c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:35.653516 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c753c0-d3e8-4146-86c5-a6680b6c48c5 admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:35.654562 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c753c0-d3e8-4146-86c5-a6680b6c48c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:35.654965 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c753c0-d3e8-4146-86c5-a6680b6c48c5 admin admin] PATH_INFO: `/v3/users` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:35.655666 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c753c0-d3e8-4146-86c5-a6680b6c48c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:35.657572 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c753c0-d3e8-4146-86c5-a6680b6c48c5 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:35.678521 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1337/2683] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:35:35 2022] POST /identity/v3/users => generated 291 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 01:35:35.682722 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69bdd73-d37f-4dbd-80d2-9a2f71e7c105 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:35.692963 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69bdd73-d37f-4dbd-80d2-9a2f71e7c105 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:35.697513 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f4e0f-ec5c-440e-b0af-992a1a601144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:35.698158 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f4e0f-ec5c-440e-b0af-992a1a601144 admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:35.698456 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f4e0f-ec5c-440e-b0af-992a1a601144 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:35.698736 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f4e0f-ec5c-440e-b0af-992a1a601144 admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:35.699456 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7f4e0f-ec5c-440e-b0af-992a1a601144 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:35.701170 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7f4e0f-ec5c-440e-b0af-992a1a601144 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:35.711215 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1347/2684] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:35:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 01:35:35.715119 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c753c0-d3e8-4146-86c5-a6680b6c48c5 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:35.725669 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c753c0-d3e8-4146-86c5-a6680b6c48c5 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:35.730247 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4159c4-e003-4afa-a953-84d4d8208f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:35.731227 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4159c4-e003-4afa-a953-84d4d8208f2e admin admin] REQUEST_METHOD: `PUT` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:35.731505 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4159c4-e003-4afa-a953-84d4d8208f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:35.731778 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4159c4-e003-4afa-a953-84d4d8208f2e admin admin] PATH_INFO: `/v3/projects/9fe349a390a44e92b4bfab8e744d9058/users/85d427943e394493a8ed57b9a548237c/roles/36909bbf31d04993bb2a9fe587b572dc` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:35.746918 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4159c4-e003-4afa-a953-84d4d8208f2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fe349a390a44e92b4bfab8e744d9058, user_id=85d427943e394493a8ed57b9a548237c, role_id=36909bbf31d04993bb2a9fe587b572dc)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:35.749555 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4159c4-e003-4afa-a953-84d4d8208f2e admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:35.762646 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1338/2685] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:35:35 2022] PUT /identity/v3/projects/9fe349a390a44e92b4bfab8e744d9058/users/85d427943e394493a8ed57b9a548237c/roles/36909bbf31d04993bb2a9fe587b572dc => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:35:35.766656 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f4e0f-ec5c-440e-b0af-992a1a601144 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:35.776333 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f4e0f-ec5c-440e-b0af-992a1a601144 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:35.830767 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e4eb6-f693-4dad-86bc-941ec8e47180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:35.831429 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e4eb6-f693-4dad-86bc-941ec8e47180 admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:35.831713 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e4eb6-f693-4dad-86bc-941ec8e47180 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:35.831990 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e4eb6-f693-4dad-86bc-941ec8e47180 admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:35.832709 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3e4eb6-f693-4dad-86bc-941ec8e47180 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:35.834295 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3e4eb6-f693-4dad-86bc-941ec8e47180 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:35.844439 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1348/2686] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:35:35 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:35:35.848514 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4159c4-e003-4afa-a953-84d4d8208f2e admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:35.859681 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4159c4-e003-4afa-a953-84d4d8208f2e admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:35.864323 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34cbb46-3a08-4111-b56f-766edd18cb85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:35.865190 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34cbb46-3a08-4111-b56f-766edd18cb85 admin admin] REQUEST_METHOD: `PUT` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:35.865561 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34cbb46-3a08-4111-b56f-766edd18cb85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:35.865743 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34cbb46-3a08-4111-b56f-766edd18cb85 admin admin] PATH_INFO: `/v3/projects/9fe349a390a44e92b4bfab8e744d9058/users/85d427943e394493a8ed57b9a548237c/roles/36909bbf31d04993bb2a9fe587b572dc` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:35.867708 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34cbb46-3a08-4111-b56f-766edd18cb85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fe349a390a44e92b4bfab8e744d9058, user_id=85d427943e394493a8ed57b9a548237c, role_id=36909bbf31d04993bb2a9fe587b572dc)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:35.870297 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34cbb46-3a08-4111-b56f-766edd18cb85 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:35.881399 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1339/2687] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:35:35 2022] PUT /identity/v3/projects/9fe349a390a44e92b4bfab8e744d9058/users/85d427943e394493a8ed57b9a548237c/roles/36909bbf31d04993bb2a9fe587b572dc => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:35:35.891884 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5499f-dc34-4b04-8444-adb1f8cfc557 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:35.892197 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5499f-dc34-4b04-8444-adb1f8cfc557 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:35.892543 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5499f-dc34-4b04-8444-adb1f8cfc557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:35.922932 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-71c5499f-dc34-4b04-8444-adb1f8cfc557 None None] MFA Rules not processed for user `85d427943e394493a8ed57b9a548237c`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:35:35.925987 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-71c5499f-dc34-4b04-8444-adb1f8cfc557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:36.009437 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1349/2688] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:35:35 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:35:36.021285 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34cbb46-3a08-4111-b56f-766edd18cb85 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:36.023114 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-b34cbb46-3a08-4111-b56f-766edd18cb85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:36.089021 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34cbb46-3a08-4111-b56f-766edd18cb85 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:36.093461 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb7b24-51a8-4307-bf24-7e32d0948dc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45219f386f0147b6bd380efe4ab62812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:36.094107 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb7b24-51a8-4307-bf24-7e32d0948dc8 service cinder] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:36.094390 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb7b24-51a8-4307-bf24-7e32d0948dc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:36.094661 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb7b24-51a8-4307-bf24-7e32d0948dc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:36.103406 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cb7b24-51a8-4307-bf24-7e32d0948dc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:36.104818 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cb7b24-51a8-4307-bf24-7e32d0948dc8 service cinder] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:36.114043 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1340/2689] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:35:36 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:35:37.400121 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c5499f-dc34-4b04-8444-adb1f8cfc557 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:37.460546 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c5499f-dc34-4b04-8444-adb1f8cfc557 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:37.465074 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31277b3-fc83-4002-a50a-45f9c3dba715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:37.465934 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31277b3-fc83-4002-a50a-45f9c3dba715 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:37.466269 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31277b3-fc83-4002-a50a-45f9c3dba715 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:37.466624 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31277b3-fc83-4002-a50a-45f9c3dba715 admin admin] PATH_INFO: `/v3/users/0dca431d4235420096a1f0d95b7cae1d` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:37.467846 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31277b3-fc83-4002-a50a-45f9c3dba715 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dca431d4235420096a1f0d95b7cae1d)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:37.469760 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31277b3-fc83-4002-a50a-45f9c3dba715 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:37.512085 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-f31277b3-fc83-4002-a50a-45f9c3dba715 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dca431d4235420096a1f0d95b7cae1d'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:37.518978 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-f31277b3-fc83-4002-a50a-45f9c3dba715 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dca431d4235420096a1f0d95b7cae1d'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:37.519598 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-f31277b3-fc83-4002-a50a-45f9c3dba715 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dca431d4235420096a1f0d95b7cae1d'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:37.526201 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-f31277b3-fc83-4002-a50a-45f9c3dba715 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dca431d4235420096a1f0d95b7cae1d'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:37.537609 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-f31277b3-fc83-4002-a50a-45f9c3dba715 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dca431d4235420096a1f0d95b7cae1d'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:37.543332 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1350/2690] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:35:37 2022] DELETE /identity/v3/users/0dca431d4235420096a1f0d95b7cae1d => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:35:37.548308 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d8fbc-6f57-4bcf-ba46-416accd61a8d None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:37.548788 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d8fbc-6f57-4bcf-ba46-416accd61a8d None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:37.548894 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d8fbc-6f57-4bcf-ba46-416accd61a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:37.566412 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-480d8fbc-6f57-4bcf-ba46-416accd61a8d None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:35:37.567635 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-480d8fbc-6f57-4bcf-ba46-416accd61a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:37.628208 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1341/2691] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:35:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:35:37.637826 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31277b3-fc83-4002-a50a-45f9c3dba715 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:37.639905 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-f31277b3-fc83-4002-a50a-45f9c3dba715 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:37.695879 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31277b3-fc83-4002-a50a-45f9c3dba715 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:37.699542 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb3eaa2-a0fc-47bb-ac72-4370d72dc9b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:37.700181 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb3eaa2-a0fc-47bb-ac72-4370d72dc9b3 service neutron] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:37.700466 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb3eaa2-a0fc-47bb-ac72-4370d72dc9b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:37.701310 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb3eaa2-a0fc-47bb-ac72-4370d72dc9b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:37.710306 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb3eaa2-a0fc-47bb-ac72-4370d72dc9b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:37.711835 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb3eaa2-a0fc-47bb-ac72-4370d72dc9b3 service neutron] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:37.721400 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1351/2692] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:35:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:35:37.974795 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d8fbc-6f57-4bcf-ba46-416accd61a8d None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:37.976230 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-480d8fbc-6f57-4bcf-ba46-416accd61a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:37.988921 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d8fbc-6f57-4bcf-ba46-416accd61a8d None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:37.993607 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a53d41-1ff6-4a45-9e2c-1e59604e3796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:37.994462 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a53d41-1ff6-4a45-9e2c-1e59604e3796 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:37.994768 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a53d41-1ff6-4a45-9e2c-1e59604e3796 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:37.995046 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a53d41-1ff6-4a45-9e2c-1e59604e3796 admin admin] PATH_INFO: `/v3/projects/b4e06a6a4bab44e88cf2c816289890bb` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:37.996238 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a53d41-1ff6-4a45-9e2c-1e59604e3796 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4e06a6a4bab44e88cf2c816289890bb)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:37.998226 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a53d41-1ff6-4a45-9e2c-1e59604e3796 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:38.043400 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-b0a53d41-1ff6-4a45-9e2c-1e59604e3796 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4e06a6a4bab44e88cf2c816289890bb', 'request_id': 'req-b0a53d41-1ff6-4a45-9e2c-1e59604e3796'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:38.050838 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-b0a53d41-1ff6-4a45-9e2c-1e59604e3796 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4e06a6a4bab44e88cf2c816289890bb', 'request_id': 'req-b0a53d41-1ff6-4a45-9e2c-1e59604e3796'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:38.056292 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-b0a53d41-1ff6-4a45-9e2c-1e59604e3796 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4e06a6a4bab44e88cf2c816289890bb', 'request_id': 'req-b0a53d41-1ff6-4a45-9e2c-1e59604e3796'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:38.067128 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-b0a53d41-1ff6-4a45-9e2c-1e59604e3796 admin admin] The token cache is being invalidate because project b4e06a6a4bab44e88cf2c816289890bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:35:38.067416 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-b0a53d41-1ff6-4a45-9e2c-1e59604e3796 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:38.068039 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-b0a53d41-1ff6-4a45-9e2c-1e59604e3796 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:38.069566 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1342/2693] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:35:37 2022] DELETE /identity/v3/projects/b4e06a6a4bab44e88cf2c816289890bb => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:35:38.073531 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb3eaa2-a0fc-47bb-ac72-4370d72dc9b3 service neutron] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:38.083987 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb3eaa2-a0fc-47bb-ac72-4370d72dc9b3 service neutron] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:38.140765 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20e26c7-afff-47dc-a00b-d0ad33a6adb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:38.141635 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e26c7-afff-47dc-a00b-d0ad33a6adb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:38.142056 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e26c7-afff-47dc-a00b-d0ad33a6adb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:38.142337 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e26c7-afff-47dc-a00b-d0ad33a6adb4 admin admin] PATH_INFO: `/v3/users/85d427943e394493a8ed57b9a548237c` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:38.143565 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20e26c7-afff-47dc-a00b-d0ad33a6adb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85d427943e394493a8ed57b9a548237c)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:38.145583 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20e26c7-afff-47dc-a00b-d0ad33a6adb4 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:38.189962 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-f20e26c7-afff-47dc-a00b-d0ad33a6adb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85d427943e394493a8ed57b9a548237c'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:38.196849 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-f20e26c7-afff-47dc-a00b-d0ad33a6adb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85d427943e394493a8ed57b9a548237c'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:38.197470 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-f20e26c7-afff-47dc-a00b-d0ad33a6adb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85d427943e394493a8ed57b9a548237c'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:38.204712 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-f20e26c7-afff-47dc-a00b-d0ad33a6adb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85d427943e394493a8ed57b9a548237c'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:38.216004 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-f20e26c7-afff-47dc-a00b-d0ad33a6adb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85d427943e394493a8ed57b9a548237c'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:38.222470 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1352/2694] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:35:38 2022] DELETE /identity/v3/users/85d427943e394493a8ed57b9a548237c => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:35:38.570785 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a53d41-1ff6-4a45-9e2c-1e59604e3796 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:38.572421 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-b0a53d41-1ff6-4a45-9e2c-1e59604e3796 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:38.587110 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a53d41-1ff6-4a45-9e2c-1e59604e3796 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:38.657651 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fd7c5a-f45c-4702-8ecb-c5ba1e732f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:38.658654 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd7c5a-f45c-4702-8ecb-c5ba1e732f05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:38.659047 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd7c5a-f45c-4702-8ecb-c5ba1e732f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:38.659396 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd7c5a-f45c-4702-8ecb-c5ba1e732f05 admin admin] PATH_INFO: `/v3/projects/9fe349a390a44e92b4bfab8e744d9058` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:38.660669 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fd7c5a-f45c-4702-8ecb-c5ba1e732f05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fe349a390a44e92b4bfab8e744d9058)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:38.663634 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fd7c5a-f45c-4702-8ecb-c5ba1e732f05 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:38.713765 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-d4fd7c5a-f45c-4702-8ecb-c5ba1e732f05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fe349a390a44e92b4bfab8e744d9058', 'request_id': 'req-d4fd7c5a-f45c-4702-8ecb-c5ba1e732f05'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:38.722101 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-d4fd7c5a-f45c-4702-8ecb-c5ba1e732f05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fe349a390a44e92b4bfab8e744d9058', 'request_id': 'req-d4fd7c5a-f45c-4702-8ecb-c5ba1e732f05'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:38.727659 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-d4fd7c5a-f45c-4702-8ecb-c5ba1e732f05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fe349a390a44e92b4bfab8e744d9058', 'request_id': 'req-d4fd7c5a-f45c-4702-8ecb-c5ba1e732f05'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:38.739636 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-d4fd7c5a-f45c-4702-8ecb-c5ba1e732f05 admin admin] The token cache is being invalidate because project 9fe349a390a44e92b4bfab8e744d9058 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:35:38.739854 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-d4fd7c5a-f45c-4702-8ecb-c5ba1e732f05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:38.740500 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-d4fd7c5a-f45c-4702-8ecb-c5ba1e732f05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:38.742088 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1343/2695] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:35:38 2022] DELETE /identity/v3/projects/9fe349a390a44e92b4bfab8e744d9058 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:35:38.747844 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf2633-32c7-4233-a16a-4c3ed37056cf None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:38.748514 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf2633-32c7-4233-a16a-4c3ed37056cf None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:38.748614 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf2633-32c7-4233-a16a-4c3ed37056cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:38.766564 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-daaf2633-32c7-4233-a16a-4c3ed37056cf None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:35:38.767861 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-daaf2633-32c7-4233-a16a-4c3ed37056cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:38.829691 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1353/2696] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:35:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:35:38.837715 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e847a3f-8a6e-43f1-a1bd-f376b9f6aa53 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:38.838060 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e847a3f-8a6e-43f1-a1bd-f376b9f6aa53 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:38.838341 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e847a3f-8a6e-43f1-a1bd-f376b9f6aa53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:38.858410 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-0e847a3f-8a6e-43f1-a1bd-f376b9f6aa53 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:35:38.859663 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-0e847a3f-8a6e-43f1-a1bd-f376b9f6aa53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:38.872272 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1344/2697] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:35:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:35:38.874619 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf2633-32c7-4233-a16a-4c3ed37056cf None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:38.884864 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf2633-32c7-4233-a16a-4c3ed37056cf None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:38.890575 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c791f-dc76-4638-aab8-9222360311d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:38.891277 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c791f-dc76-4638-aab8-9222360311d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:38.891572 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c791f-dc76-4638-aab8-9222360311d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:38.891902 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c791f-dc76-4638-aab8-9222360311d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:38.892639 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587c791f-dc76-4638-aab8-9222360311d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:35:38.892952 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587c791f-dc76-4638-aab8-9222360311d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:38.894685 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587c791f-dc76-4638-aab8-9222360311d0 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:38.907368 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1354/2698] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Mar 30 01:35:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:35:38.911842 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e847a3f-8a6e-43f1-a1bd-f376b9f6aa53 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:38.921090 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e847a3f-8a6e-43f1-a1bd-f376b9f6aa53 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:38.925905 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0905501-7818-4a44-891c-b4ce8089cf0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:38.926787 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0905501-7818-4a44-891c-b4ce8089cf0f admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:38.926907 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0905501-7818-4a44-891c-b4ce8089cf0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:38.927144 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0905501-7818-4a44-891c-b4ce8089cf0f admin admin] PATH_INFO: `/v3/projects` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:38.927844 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0905501-7818-4a44-891c-b4ce8089cf0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:38.929745 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0905501-7818-4a44-891c-b4ce8089cf0f admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:38.968479 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1345/2699] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:35:38 2022] POST /identity/v3/projects => generated 381 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:35:38.972611 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c791f-dc76-4638-aab8-9222360311d0 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:38.984117 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c791f-dc76-4638-aab8-9222360311d0 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:39.057710 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1165bf-78ed-4c48-9145-3b440a9468ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:39.058370 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1165bf-78ed-4c48-9145-3b440a9468ee admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:39.058649 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1165bf-78ed-4c48-9145-3b440a9468ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:39.058975 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1165bf-78ed-4c48-9145-3b440a9468ee admin admin] PATH_INFO: `/v3/users` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:39.059665 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1165bf-78ed-4c48-9145-3b440a9468ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:39.062412 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1165bf-78ed-4c48-9145-3b440a9468ee admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:39.083768 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1355/2700] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:35:38 2022] POST /identity/v3/users => generated 291 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 01:35:39.087874 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0905501-7818-4a44-891c-b4ce8089cf0f admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:39.099743 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0905501-7818-4a44-891c-b4ce8089cf0f admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:39.109165 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc5dea8-ec31-45b8-8c02-c3079e5c5141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:39.109601 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc5dea8-ec31-45b8-8c02-c3079e5c5141 admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:39.109952 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc5dea8-ec31-45b8-8c02-c3079e5c5141 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:39.110299 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc5dea8-ec31-45b8-8c02-c3079e5c5141 admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:39.111141 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc5dea8-ec31-45b8-8c02-c3079e5c5141 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:39.112978 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc5dea8-ec31-45b8-8c02-c3079e5c5141 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:39.130743 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1346/2701] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 01:35:39.132918 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1165bf-78ed-4c48-9145-3b440a9468ee admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:39.143322 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1165bf-78ed-4c48-9145-3b440a9468ee admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:39.148033 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7802ecf5-a36f-4cf3-8add-f8a05d7eab7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:39.148687 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802ecf5-a36f-4cf3-8add-f8a05d7eab7f admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:39.148974 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802ecf5-a36f-4cf3-8add-f8a05d7eab7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:39.149247 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802ecf5-a36f-4cf3-8add-f8a05d7eab7f admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:39.149972 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7802ecf5-a36f-4cf3-8add-f8a05d7eab7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:39.151595 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7802ecf5-a36f-4cf3-8add-f8a05d7eab7f admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:39.162271 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1356/2702] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:35:39.166411 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc5dea8-ec31-45b8-8c02-c3079e5c5141 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:39.177800 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc5dea8-ec31-45b8-8c02-c3079e5c5141 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:39.182668 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1160d3-e2f4-42ff-8d3c-ad60e36f86f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:39.183638 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1160d3-e2f4-42ff-8d3c-ad60e36f86f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:39.184444 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1160d3-e2f4-42ff-8d3c-ad60e36f86f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:39.184444 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1160d3-e2f4-42ff-8d3c-ad60e36f86f8 admin admin] PATH_INFO: `/v3/projects/5e2e2fdfbb244cc7bd11cd8800981324/users/b17b2cd60b3e432ba7c72cdd1de03c33/roles/7185d0cfbcd44502b1613bcfe1b42f6f` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:39.199649 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1160d3-e2f4-42ff-8d3c-ad60e36f86f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e2e2fdfbb244cc7bd11cd8800981324, user_id=b17b2cd60b3e432ba7c72cdd1de03c33, role_id=7185d0cfbcd44502b1613bcfe1b42f6f)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:39.202509 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1160d3-e2f4-42ff-8d3c-ad60e36f86f8 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:39.217169 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1347/2703] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:35:39 2022] PUT /identity/v3/projects/5e2e2fdfbb244cc7bd11cd8800981324/users/b17b2cd60b3e432ba7c72cdd1de03c33/roles/7185d0cfbcd44502b1613bcfe1b42f6f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:35:39.228682 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11da2e-37a9-4724-b181-7f0bc180153e None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:39.228977 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11da2e-37a9-4724-b181-7f0bc180153e None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:39.229289 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11da2e-37a9-4724-b181-7f0bc180153e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:39.256484 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-3c11da2e-37a9-4724-b181-7f0bc180153e None None] MFA Rules not processed for user `b17b2cd60b3e432ba7c72cdd1de03c33`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:35:39.257699 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-3c11da2e-37a9-4724-b181-7f0bc180153e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:39.320757 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1357/2704] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:35:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:35:39.325240 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1160d3-e2f4-42ff-8d3c-ad60e36f86f8 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:39.385312 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1160d3-e2f4-42ff-8d3c-ad60e36f86f8 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:39.390722 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bb0675-c085-4f09-82aa-e5eaa256ace6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:39.391372 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb0675-c085-4f09-82aa-e5eaa256ace6 admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:39.391654 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb0675-c085-4f09-82aa-e5eaa256ace6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:39.391929 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb0675-c085-4f09-82aa-e5eaa256ace6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:39.392619 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bb0675-c085-4f09-82aa-e5eaa256ace6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:39.394522 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bb0675-c085-4f09-82aa-e5eaa256ace6 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:39.418539 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1348/2705] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:35:39 2022] POST /identity/v3/projects => generated 383 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:35:39.422744 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11da2e-37a9-4724-b181-7f0bc180153e None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:39.433090 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11da2e-37a9-4724-b181-7f0bc180153e None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:39.492087 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cba1ce0-b095-4d93-91e2-92d7485b706e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:39.492802 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba1ce0-b095-4d93-91e2-92d7485b706e admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:39.493015 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba1ce0-b095-4d93-91e2-92d7485b706e admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:39.493287 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba1ce0-b095-4d93-91e2-92d7485b706e admin admin] PATH_INFO: `/v3/users` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:39.493977 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cba1ce0-b095-4d93-91e2-92d7485b706e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:39.495901 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cba1ce0-b095-4d93-91e2-92d7485b706e admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:39.517471 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1358/2706] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:35:39 2022] POST /identity/v3/users => generated 298 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:35:39.521508 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bb0675-c085-4f09-82aa-e5eaa256ace6 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:39.533081 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bb0675-c085-4f09-82aa-e5eaa256ace6 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:39.539393 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa3069d-ce47-4c35-a4cf-fddddc0ccb4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:39.540114 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3069d-ce47-4c35-a4cf-fddddc0ccb4e admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:39.540417 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3069d-ce47-4c35-a4cf-fddddc0ccb4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:39.540686 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3069d-ce47-4c35-a4cf-fddddc0ccb4e admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:39.541421 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa3069d-ce47-4c35-a4cf-fddddc0ccb4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:39.543040 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa3069d-ce47-4c35-a4cf-fddddc0ccb4e admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:39.556057 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1349/2707] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:35:39.559005 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cba1ce0-b095-4d93-91e2-92d7485b706e admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:39.569575 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cba1ce0-b095-4d93-91e2-92d7485b706e admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:39.574439 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf12b400-ffa4-4f0f-b45b-81caa4bc5b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:39.575294 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf12b400-ffa4-4f0f-b45b-81caa4bc5b13 admin admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:39.576281 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf12b400-ffa4-4f0f-b45b-81caa4bc5b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:39.576564 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf12b400-ffa4-4f0f-b45b-81caa4bc5b13 admin admin] PATH_INFO: `/v3/projects/a926c39ef2df41229809c17bdad3218b/users/b1a0fc05fac6489781ebcb3e235423c7/roles/36909bbf31d04993bb2a9fe587b572dc` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:39.593650 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf12b400-ffa4-4f0f-b45b-81caa4bc5b13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a926c39ef2df41229809c17bdad3218b, user_id=b1a0fc05fac6489781ebcb3e235423c7, role_id=36909bbf31d04993bb2a9fe587b572dc)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:39.596474 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf12b400-ffa4-4f0f-b45b-81caa4bc5b13 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:39.611486 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1359/2708] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:35:39 2022] PUT /identity/v3/projects/a926c39ef2df41229809c17bdad3218b/users/b1a0fc05fac6489781ebcb3e235423c7/roles/36909bbf31d04993bb2a9fe587b572dc => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:35:39.615623 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa3069d-ce47-4c35-a4cf-fddddc0ccb4e admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:39.631962 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa3069d-ce47-4c35-a4cf-fddddc0ccb4e admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:39.702683 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ff9220-432b-4c76-b47b-d62c9ad4f502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:39.703392 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff9220-432b-4c76-b47b-d62c9ad4f502 admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:39.703680 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff9220-432b-4c76-b47b-d62c9ad4f502 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:39.703962 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff9220-432b-4c76-b47b-d62c9ad4f502 admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:39.704686 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ff9220-432b-4c76-b47b-d62c9ad4f502 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:39.706281 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ff9220-432b-4c76-b47b-d62c9ad4f502 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:39.716034 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1350/2709] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 01:35:39.723822 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf12b400-ffa4-4f0f-b45b-81caa4bc5b13 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:39.734874 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf12b400-ffa4-4f0f-b45b-81caa4bc5b13 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:39.739437 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf9ab95-1804-4ea6-a0c3-d69b475b50f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:39.740309 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf9ab95-1804-4ea6-a0c3-d69b475b50f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:39.740593 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf9ab95-1804-4ea6-a0c3-d69b475b50f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:39.740869 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf9ab95-1804-4ea6-a0c3-d69b475b50f3 admin admin] PATH_INFO: `/v3/projects/a926c39ef2df41229809c17bdad3218b/users/b1a0fc05fac6489781ebcb3e235423c7/roles/36909bbf31d04993bb2a9fe587b572dc` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:39.742860 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf9ab95-1804-4ea6-a0c3-d69b475b50f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a926c39ef2df41229809c17bdad3218b, user_id=b1a0fc05fac6489781ebcb3e235423c7, role_id=36909bbf31d04993bb2a9fe587b572dc)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:39.745481 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf9ab95-1804-4ea6-a0c3-d69b475b50f3 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:39.756837 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1360/2710] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:35:39 2022] PUT /identity/v3/projects/a926c39ef2df41229809c17bdad3218b/users/b1a0fc05fac6489781ebcb3e235423c7/roles/36909bbf31d04993bb2a9fe587b572dc => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:35:39.767209 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a779983-ab34-4f0f-b167-b01bc51f2b89 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:39.767503 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a779983-ab34-4f0f-b167-b01bc51f2b89 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:39.767782 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a779983-ab34-4f0f-b167-b01bc51f2b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:39.793367 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-4a779983-ab34-4f0f-b167-b01bc51f2b89 None None] MFA Rules not processed for user `b1a0fc05fac6489781ebcb3e235423c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:35:39.795069 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-4a779983-ab34-4f0f-b167-b01bc51f2b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:39.859711 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1351/2711] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:35:39 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:35:39.870124 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf9ab95-1804-4ea6-a0c3-d69b475b50f3 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:39.871854 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-caf9ab95-1804-4ea6-a0c3-d69b475b50f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:39.927477 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf9ab95-1804-4ea6-a0c3-d69b475b50f3 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:39.931249 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f8c52-805a-45cf-99c2-ec616d6abfa1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45219f386f0147b6bd380efe4ab62812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:39.931914 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f8c52-805a-45cf-99c2-ec616d6abfa1 service cinder] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:39.932198 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f8c52-805a-45cf-99c2-ec616d6abfa1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:39.932475 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f8c52-805a-45cf-99c2-ec616d6abfa1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:39.941932 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408f8c52-805a-45cf-99c2-ec616d6abfa1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:39.943414 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408f8c52-805a-45cf-99c2-ec616d6abfa1 service cinder] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:39.952646 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1361/2712] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:35:39 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:35:40.060892 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a779983-ab34-4f0f-b167-b01bc51f2b89 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:40.070460 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a779983-ab34-4f0f-b167-b01bc51f2b89 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:40.074027 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a1b86b-126a-4285-a9a5-7166b4a03377 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45219f386f0147b6bd380efe4ab62812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:40.074662 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a1b86b-126a-4285-a9a5-7166b4a03377 service cinder] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:40.074974 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a1b86b-126a-4285-a9a5-7166b4a03377 service cinder] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:40.075249 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a1b86b-126a-4285-a9a5-7166b4a03377 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:40.132636 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a1b86b-126a-4285-a9a5-7166b4a03377 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:40.134594 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a1b86b-126a-4285-a9a5-7166b4a03377 service cinder] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:40.146481 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1352/2713] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:35:40 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:35:42.698948 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f8c52-805a-45cf-99c2-ec616d6abfa1 service cinder] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:42.766126 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f8c52-805a-45cf-99c2-ec616d6abfa1 service cinder] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:42.770809 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b743cff-234b-4073-ac2d-fc0bdfeb8085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:42.771694 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b743cff-234b-4073-ac2d-fc0bdfeb8085 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:42.771974 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b743cff-234b-4073-ac2d-fc0bdfeb8085 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:42.772246 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b743cff-234b-4073-ac2d-fc0bdfeb8085 admin admin] PATH_INFO: `/v3/users/b17b2cd60b3e432ba7c72cdd1de03c33` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:42.773501 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b743cff-234b-4073-ac2d-fc0bdfeb8085 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b17b2cd60b3e432ba7c72cdd1de03c33)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:42.775457 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b743cff-234b-4073-ac2d-fc0bdfeb8085 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:42.828064 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-7b743cff-234b-4073-ac2d-fc0bdfeb8085 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b17b2cd60b3e432ba7c72cdd1de03c33'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:42.836645 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-7b743cff-234b-4073-ac2d-fc0bdfeb8085 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b17b2cd60b3e432ba7c72cdd1de03c33'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:42.837262 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-7b743cff-234b-4073-ac2d-fc0bdfeb8085 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b17b2cd60b3e432ba7c72cdd1de03c33'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:42.845763 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-7b743cff-234b-4073-ac2d-fc0bdfeb8085 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b17b2cd60b3e432ba7c72cdd1de03c33'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:42.858018 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-7b743cff-234b-4073-ac2d-fc0bdfeb8085 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b17b2cd60b3e432ba7c72cdd1de03c33'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:42.864167 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1362/2714] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:35:42 2022] DELETE /identity/v3/users/b17b2cd60b3e432ba7c72cdd1de03c33 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:35:42.868792 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37694c55-bae9-4069-9621-e9605b4f2758 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:42.869301 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37694c55-bae9-4069-9621-e9605b4f2758 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:42.869481 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37694c55-bae9-4069-9621-e9605b4f2758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:42.888635 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-37694c55-bae9-4069-9621-e9605b4f2758 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:35:42.889932 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-37694c55-bae9-4069-9621-e9605b4f2758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:42.950929 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1353/2715] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:35:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:35:42.960474 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b743cff-234b-4073-ac2d-fc0bdfeb8085 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:42.961867 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-7b743cff-234b-4073-ac2d-fc0bdfeb8085 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:43.018003 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b743cff-234b-4073-ac2d-fc0bdfeb8085 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:43.021663 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053839e5-857e-4aa3-b882-59dd63d84683 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:43.022315 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053839e5-857e-4aa3-b882-59dd63d84683 service neutron] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:43.022599 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053839e5-857e-4aa3-b882-59dd63d84683 service neutron] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:43.022902 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053839e5-857e-4aa3-b882-59dd63d84683 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:43.033030 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053839e5-857e-4aa3-b882-59dd63d84683 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:43.034467 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053839e5-857e-4aa3-b882-59dd63d84683 service neutron] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:43.045146 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1363/2716] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:35:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:35:43.370943 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37694c55-bae9-4069-9621-e9605b4f2758 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:43.372994 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-37694c55-bae9-4069-9621-e9605b4f2758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:43.384731 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37694c55-bae9-4069-9621-e9605b4f2758 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:43.389872 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bec566-9023-412b-9ece-c2a89c22a7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:43.390892 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bec566-9023-412b-9ece-c2a89c22a7ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:43.391194 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bec566-9023-412b-9ece-c2a89c22a7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:43.391542 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bec566-9023-412b-9ece-c2a89c22a7ed admin admin] PATH_INFO: `/v3/projects/5e2e2fdfbb244cc7bd11cd8800981324` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:43.392803 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bec566-9023-412b-9ece-c2a89c22a7ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e2e2fdfbb244cc7bd11cd8800981324)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:43.395011 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bec566-9023-412b-9ece-c2a89c22a7ed admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:43.461813 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-86bec566-9023-412b-9ece-c2a89c22a7ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e2e2fdfbb244cc7bd11cd8800981324', 'request_id': 'req-86bec566-9023-412b-9ece-c2a89c22a7ed'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:43.470719 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-86bec566-9023-412b-9ece-c2a89c22a7ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e2e2fdfbb244cc7bd11cd8800981324', 'request_id': 'req-86bec566-9023-412b-9ece-c2a89c22a7ed'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:43.476453 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-86bec566-9023-412b-9ece-c2a89c22a7ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e2e2fdfbb244cc7bd11cd8800981324', 'request_id': 'req-86bec566-9023-412b-9ece-c2a89c22a7ed'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:43.487844 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-86bec566-9023-412b-9ece-c2a89c22a7ed admin admin] The token cache is being invalidate because project 5e2e2fdfbb244cc7bd11cd8800981324 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:35:43.488134 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-86bec566-9023-412b-9ece-c2a89c22a7ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:43.488795 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-86bec566-9023-412b-9ece-c2a89c22a7ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:43.499644 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1354/2717] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:35:43 2022] DELETE /identity/v3/projects/5e2e2fdfbb244cc7bd11cd8800981324 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:35:43.499752 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053839e5-857e-4aa3-b882-59dd63d84683 service neutron] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:43.506300 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053839e5-857e-4aa3-b882-59dd63d84683 service neutron] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:43.506981 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bec566-9023-412b-9ece-c2a89c22a7ed admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:43.508683 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-86bec566-9023-412b-9ece-c2a89c22a7ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:43.563628 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e3c79-46ae-4bc6-bec5-fb85e5ae20db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:43.564508 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e3c79-46ae-4bc6-bec5-fb85e5ae20db admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:43.564789 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e3c79-46ae-4bc6-bec5-fb85e5ae20db admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:43.565067 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e3c79-46ae-4bc6-bec5-fb85e5ae20db admin admin] PATH_INFO: `/v3/users/b1a0fc05fac6489781ebcb3e235423c7` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:43.566236 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bec566-9023-412b-9ece-c2a89c22a7ed admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:43.566354 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835e3c79-46ae-4bc6-bec5-fb85e5ae20db admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1a0fc05fac6489781ebcb3e235423c7)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:43.568221 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835e3c79-46ae-4bc6-bec5-fb85e5ae20db admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:43.569892 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d921c3-54b0-459c-a375-2f333c8704cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:43.570518 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d921c3-54b0-459c-a375-2f333c8704cb service neutron] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:43.570831 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d921c3-54b0-459c-a375-2f333c8704cb service neutron] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:43.571103 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d921c3-54b0-459c-a375-2f333c8704cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:43.572886 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-29d921c3-54b0-459c-a375-2f333c8704cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:43.615352 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-835e3c79-46ae-4bc6-bec5-fb85e5ae20db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1a0fc05fac6489781ebcb3e235423c7'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:43.625376 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-835e3c79-46ae-4bc6-bec5-fb85e5ae20db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1a0fc05fac6489781ebcb3e235423c7'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:43.626004 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-835e3c79-46ae-4bc6-bec5-fb85e5ae20db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1a0fc05fac6489781ebcb3e235423c7'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:43.633053 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-835e3c79-46ae-4bc6-bec5-fb85e5ae20db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1a0fc05fac6489781ebcb3e235423c7'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:43.638738 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d921c3-54b0-459c-a375-2f333c8704cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:43.640277 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d921c3-54b0-459c-a375-2f333c8704cb service neutron] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:43.646861 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-835e3c79-46ae-4bc6-bec5-fb85e5ae20db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1a0fc05fac6489781ebcb3e235423c7'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:43.651229 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1355/2718] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:35:43 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 30 01:35:43.656940 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1364/2719] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:35:43 2022] DELETE /identity/v3/users/b1a0fc05fac6489781ebcb3e235423c7 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:35:44.080683 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d921c3-54b0-459c-a375-2f333c8704cb service neutron] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:44.082215 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-29d921c3-54b0-459c-a375-2f333c8704cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:44.100645 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d921c3-54b0-459c-a375-2f333c8704cb service neutron] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:44.161960 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd27bb42-1b40-46b4-9460-e866a5ea3d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:44.162853 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd27bb42-1b40-46b4-9460-e866a5ea3d16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:44.163138 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd27bb42-1b40-46b4-9460-e866a5ea3d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:44.163416 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd27bb42-1b40-46b4-9460-e866a5ea3d16 admin admin] PATH_INFO: `/v3/projects/a926c39ef2df41229809c17bdad3218b` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:44.164605 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd27bb42-1b40-46b4-9460-e866a5ea3d16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a926c39ef2df41229809c17bdad3218b)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:44.166600 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd27bb42-1b40-46b4-9460-e866a5ea3d16 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:44.213211 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-dd27bb42-1b40-46b4-9460-e866a5ea3d16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a926c39ef2df41229809c17bdad3218b', 'request_id': 'req-dd27bb42-1b40-46b4-9460-e866a5ea3d16'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:44.224314 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-dd27bb42-1b40-46b4-9460-e866a5ea3d16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a926c39ef2df41229809c17bdad3218b', 'request_id': 'req-dd27bb42-1b40-46b4-9460-e866a5ea3d16'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:44.230293 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-dd27bb42-1b40-46b4-9460-e866a5ea3d16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a926c39ef2df41229809c17bdad3218b', 'request_id': 'req-dd27bb42-1b40-46b4-9460-e866a5ea3d16'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:44.243087 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-dd27bb42-1b40-46b4-9460-e866a5ea3d16 admin admin] The token cache is being invalidate because project a926c39ef2df41229809c17bdad3218b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:35:44.243370 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-dd27bb42-1b40-46b4-9460-e866a5ea3d16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:44.244047 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-dd27bb42-1b40-46b4-9460-e866a5ea3d16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:44.245630 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1356/2720] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:35:44 2022] DELETE /identity/v3/projects/a926c39ef2df41229809c17bdad3218b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:35:44.251586 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3b0fa-a0db-4925-b783-a64dd5ecc1bc None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:44.252076 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3b0fa-a0db-4925-b783-a64dd5ecc1bc None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:44.252447 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3b0fa-a0db-4925-b783-a64dd5ecc1bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:44.271007 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-fbd3b0fa-a0db-4925-b783-a64dd5ecc1bc None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:35:44.272346 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-fbd3b0fa-a0db-4925-b783-a64dd5ecc1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:44.333133 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1365/2721] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:35:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:35:44.341086 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb5a2c0-7b9e-4384-b2eb-5a00acebc82e None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:44.341598 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb5a2c0-7b9e-4384-b2eb-5a00acebc82e None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:44.341909 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb5a2c0-7b9e-4384-b2eb-5a00acebc82e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:44.361461 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-7fb5a2c0-7b9e-4384-b2eb-5a00acebc82e None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:35:44.362885 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-7fb5a2c0-7b9e-4384-b2eb-5a00acebc82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:44.374065 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1357/2722] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:35:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:35:44.378258 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd3b0fa-a0db-4925-b783-a64dd5ecc1bc None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:44.388141 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd3b0fa-a0db-4925-b783-a64dd5ecc1bc None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:44.392890 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85913586-57b6-4fd5-954a-c39507fabb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:44.393577 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85913586-57b6-4fd5-954a-c39507fabb3e admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:44.393861 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85913586-57b6-4fd5-954a-c39507fabb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:44.394138 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85913586-57b6-4fd5-954a-c39507fabb3e admin admin] PATH_INFO: `/v3/domains` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:44.394893 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85913586-57b6-4fd5-954a-c39507fabb3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:35:44.395200 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85913586-57b6-4fd5-954a-c39507fabb3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:44.396799 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85913586-57b6-4fd5-954a-c39507fabb3e admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:44.408872 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1366/2723] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Mar 30 01:35:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:35:44.413169 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb5a2c0-7b9e-4384-b2eb-5a00acebc82e None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:44.422905 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb5a2c0-7b9e-4384-b2eb-5a00acebc82e None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:44.428007 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eff6c4-e541-4ee3-92b4-7cb456395259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:44.428668 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eff6c4-e541-4ee3-92b4-7cb456395259 admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:44.428960 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eff6c4-e541-4ee3-92b4-7cb456395259 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:44.429239 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eff6c4-e541-4ee3-92b4-7cb456395259 admin admin] PATH_INFO: `/v3/projects` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:44.429929 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eff6c4-e541-4ee3-92b4-7cb456395259 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:44.431876 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eff6c4-e541-4ee3-92b4-7cb456395259 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:44.462957 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1358/2724] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:35:44 2022] POST /identity/v3/projects => generated 361 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:35:44.464479 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85913586-57b6-4fd5-954a-c39507fabb3e admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:44.474943 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85913586-57b6-4fd5-954a-c39507fabb3e admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:44.540278 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1373c520-efa3-4063-ae9b-bc450de3e902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:44.540964 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373c520-efa3-4063-ae9b-bc450de3e902 admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:44.541247 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373c520-efa3-4063-ae9b-bc450de3e902 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:44.541522 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373c520-efa3-4063-ae9b-bc450de3e902 admin admin] PATH_INFO: `/v3/users` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:44.542220 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1373c520-efa3-4063-ae9b-bc450de3e902 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:44.544876 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1373c520-efa3-4063-ae9b-bc450de3e902 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:44.565957 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1367/2725] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:35:44 2022] POST /identity/v3/users => generated 281 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:35:44.570505 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eff6c4-e541-4ee3-92b4-7cb456395259 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:44.588770 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eff6c4-e541-4ee3-92b4-7cb456395259 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:44.594674 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4568ab-2ae9-4316-ae26-28c6e2e160cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:44.595416 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4568ab-2ae9-4316-ae26-28c6e2e160cc admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:44.595774 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4568ab-2ae9-4316-ae26-28c6e2e160cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:44.596048 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4568ab-2ae9-4316-ae26-28c6e2e160cc admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:44.596771 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4568ab-2ae9-4316-ae26-28c6e2e160cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:44.598384 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4568ab-2ae9-4316-ae26-28c6e2e160cc admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:44.609170 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1359/2726] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:35:44 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:35:44.613248 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1373c520-efa3-4063-ae9b-bc450de3e902 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:44.629901 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1373c520-efa3-4063-ae9b-bc450de3e902 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:44.634544 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274be994-4493-4165-9056-cee3c94023eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:44.635234 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274be994-4493-4165-9056-cee3c94023eb admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:44.635515 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274be994-4493-4165-9056-cee3c94023eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:44.635816 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274be994-4493-4165-9056-cee3c94023eb admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:44.636535 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274be994-4493-4165-9056-cee3c94023eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:44.639139 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274be994-4493-4165-9056-cee3c94023eb admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:44.650270 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1368/2727] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:35:44 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 01:35:44.655163 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4568ab-2ae9-4316-ae26-28c6e2e160cc admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:44.665072 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4568ab-2ae9-4316-ae26-28c6e2e160cc admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:44.675391 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d922a823-b6a0-49db-9d66-fe93f06d8cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:44.675391 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d922a823-b6a0-49db-9d66-fe93f06d8cd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:44.675391 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d922a823-b6a0-49db-9d66-fe93f06d8cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:44.675391 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d922a823-b6a0-49db-9d66-fe93f06d8cd3 admin admin] PATH_INFO: `/v3/projects/7a9d98a0683545dc81b24b1a0b0f2fb4/users/828abed734a04f569953c2a361735ad7/roles/7185d0cfbcd44502b1613bcfe1b42f6f` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:44.690243 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d922a823-b6a0-49db-9d66-fe93f06d8cd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a9d98a0683545dc81b24b1a0b0f2fb4, user_id=828abed734a04f569953c2a361735ad7, role_id=7185d0cfbcd44502b1613bcfe1b42f6f)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:44.693792 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d922a823-b6a0-49db-9d66-fe93f06d8cd3 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:44.709258 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1360/2728] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:35:44 2022] PUT /identity/v3/projects/7a9d98a0683545dc81b24b1a0b0f2fb4/users/828abed734a04f569953c2a361735ad7/roles/7185d0cfbcd44502b1613bcfe1b42f6f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:35:44.720837 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82902250-e9bf-460e-8551-b88075630a69 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:44.721120 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82902250-e9bf-460e-8551-b88075630a69 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:44.721406 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82902250-e9bf-460e-8551-b88075630a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:44.748019 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-82902250-e9bf-460e-8551-b88075630a69 None None] MFA Rules not processed for user `828abed734a04f569953c2a361735ad7`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:35:44.749248 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-82902250-e9bf-460e-8551-b88075630a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:44.812664 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1369/2729] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:35:44 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:35:44.844437 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d922a823-b6a0-49db-9d66-fe93f06d8cd3 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:44.847775 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-d922a823-b6a0-49db-9d66-fe93f06d8cd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:44.905449 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d922a823-b6a0-49db-9d66-fe93f06d8cd3 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:44.909129 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e890ab99-fdcb-42fd-b98c-4fea189e4cf1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45219f386f0147b6bd380efe4ab62812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:44.909770 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e890ab99-fdcb-42fd-b98c-4fea189e4cf1 service cinder] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:44.910049 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e890ab99-fdcb-42fd-b98c-4fea189e4cf1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:44.910324 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e890ab99-fdcb-42fd-b98c-4fea189e4cf1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:44.918586 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e890ab99-fdcb-42fd-b98c-4fea189e4cf1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:44.920609 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e890ab99-fdcb-42fd-b98c-4fea189e4cf1 service cinder] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:44.929210 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1361/2730] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:35:44 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:35:44.943016 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82902250-e9bf-460e-8551-b88075630a69 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:45.005070 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82902250-e9bf-460e-8551-b88075630a69 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:45.009616 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05342795-147a-4728-8ba4-3ba8359b7d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:45.010514 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05342795-147a-4728-8ba4-3ba8359b7d24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:45.010830 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05342795-147a-4728-8ba4-3ba8359b7d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:45.011103 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05342795-147a-4728-8ba4-3ba8359b7d24 admin admin] PATH_INFO: `/v3/users/828abed734a04f569953c2a361735ad7` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:45.012272 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05342795-147a-4728-8ba4-3ba8359b7d24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=828abed734a04f569953c2a361735ad7)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:45.014671 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05342795-147a-4728-8ba4-3ba8359b7d24 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:45.063503 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-05342795-147a-4728-8ba4-3ba8359b7d24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '828abed734a04f569953c2a361735ad7'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:45.072301 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-05342795-147a-4728-8ba4-3ba8359b7d24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '828abed734a04f569953c2a361735ad7'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:45.073143 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-05342795-147a-4728-8ba4-3ba8359b7d24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '828abed734a04f569953c2a361735ad7'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:45.080803 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-05342795-147a-4728-8ba4-3ba8359b7d24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '828abed734a04f569953c2a361735ad7'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:45.092910 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-05342795-147a-4728-8ba4-3ba8359b7d24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '828abed734a04f569953c2a361735ad7'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:45.099400 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1370/2731] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:35:44 2022] DELETE /identity/v3/users/828abed734a04f569953c2a361735ad7 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:35:45.104040 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d2978e-49d5-4eca-a4d7-c2358594875a None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:45.104603 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d2978e-49d5-4eca-a4d7-c2358594875a None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:45.104737 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d2978e-49d5-4eca-a4d7-c2358594875a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:45.124369 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-40d2978e-49d5-4eca-a4d7-c2358594875a None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:35:45.125691 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-40d2978e-49d5-4eca-a4d7-c2358594875a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:45.186251 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1362/2732] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:35:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:35:45.196244 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05342795-147a-4728-8ba4-3ba8359b7d24 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:45.197918 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-05342795-147a-4728-8ba4-3ba8359b7d24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:45.255994 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05342795-147a-4728-8ba4-3ba8359b7d24 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:45.259703 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf79b14-ff2d-4cbc-ba19-29eaf81a9796 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:45.260356 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf79b14-ff2d-4cbc-ba19-29eaf81a9796 service neutron] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:45.260635 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf79b14-ff2d-4cbc-ba19-29eaf81a9796 service neutron] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:45.260912 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf79b14-ff2d-4cbc-ba19-29eaf81a9796 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:45.271035 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf79b14-ff2d-4cbc-ba19-29eaf81a9796 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:45.272480 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf79b14-ff2d-4cbc-ba19-29eaf81a9796 service neutron] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:45.282174 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1371/2733] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:35:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:35:45.544367 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d2978e-49d5-4eca-a4d7-c2358594875a None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:35:45.546384 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-40d2978e-49d5-4eca-a4d7-c2358594875a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:35:45.560826 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d2978e-49d5-4eca-a4d7-c2358594875a None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:35:45.566056 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cea0c1-0daa-4fbe-9de2-584b2e898c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:35:45.566952 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cea0c1-0daa-4fbe-9de2-584b2e898c1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:35:45.567234 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cea0c1-0daa-4fbe-9de2-584b2e898c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:35:45.567949 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cea0c1-0daa-4fbe-9de2-584b2e898c1c admin admin] PATH_INFO: `/v3/projects/7a9d98a0683545dc81b24b1a0b0f2fb4` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:35:45.568803 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cea0c1-0daa-4fbe-9de2-584b2e898c1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a9d98a0683545dc81b24b1a0b0f2fb4)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:35:45.570888 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cea0c1-0daa-4fbe-9de2-584b2e898c1c admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:35:45.630751 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-90cea0c1-0daa-4fbe-9de2-584b2e898c1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a9d98a0683545dc81b24b1a0b0f2fb4', 'request_id': 'req-90cea0c1-0daa-4fbe-9de2-584b2e898c1c'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:45.641329 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-90cea0c1-0daa-4fbe-9de2-584b2e898c1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a9d98a0683545dc81b24b1a0b0f2fb4', 'request_id': 'req-90cea0c1-0daa-4fbe-9de2-584b2e898c1c'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:45.647881 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-90cea0c1-0daa-4fbe-9de2-584b2e898c1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a9d98a0683545dc81b24b1a0b0f2fb4', 'request_id': 'req-90cea0c1-0daa-4fbe-9de2-584b2e898c1c'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:45.663927 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-90cea0c1-0daa-4fbe-9de2-584b2e898c1c admin admin] The token cache is being invalidate because project 7a9d98a0683545dc81b24b1a0b0f2fb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:35:45.664331 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-90cea0c1-0daa-4fbe-9de2-584b2e898c1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:45.665070 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-90cea0c1-0daa-4fbe-9de2-584b2e898c1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:35:45.667114 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1363/2734] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:35:45 2022] DELETE /identity/v3/projects/7a9d98a0683545dc81b24b1a0b0f2fb4 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:36:10.988729 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf79b14-ff2d-4cbc-ba19-29eaf81a9796 service neutron] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:36:10.990131 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-2cf79b14-ff2d-4cbc-ba19-29eaf81a9796 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:36:11.043463 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf79b14-ff2d-4cbc-ba19-29eaf81a9796 service neutron] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:36:11.088147 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7daeaa8-9805-4dbf-bb8a-903396e845cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45219f386f0147b6bd380efe4ab62812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:36:11.088780 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7daeaa8-9805-4dbf-bb8a-903396e845cd service cinder] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:36:11.089057 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7daeaa8-9805-4dbf-bb8a-903396e845cd service cinder] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:36:11.089324 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7daeaa8-9805-4dbf-bb8a-903396e845cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:36:11.091617 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-a7daeaa8-9805-4dbf-bb8a-903396e845cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:36:11.147472 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7daeaa8-9805-4dbf-bb8a-903396e845cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:36:11.148900 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7daeaa8-9805-4dbf-bb8a-903396e845cd service cinder] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:36:11.158595 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1372/2735] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:36:10 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:36:17.951458 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a00ff30-96bc-4366-ae0c-79aa012669d7 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:36:17.951971 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a00ff30-96bc-4366-ae0c-79aa012669d7 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:36:17.952079 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a00ff30-96bc-4366-ae0c-79aa012669d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:36:17.970942 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-9a00ff30-96bc-4366-ae0c-79aa012669d7 None None] MFA Rules not processed for user `35958469e64e490f919742685700caa9`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:36:17.972125 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-9a00ff30-96bc-4366-ae0c-79aa012669d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:36:17.979022 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1364/2736] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:36:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:36:18.332919 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7daeaa8-9805-4dbf-bb8a-903396e845cd service cinder] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:36:18.335123 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-a7daeaa8-9805-4dbf-bb8a-903396e845cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:36:18.407835 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7daeaa8-9805-4dbf-bb8a-903396e845cd service cinder] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:36:18.412169 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab5fa34-37ff-46de-9636-539c4e2e540e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:36:18.412937 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab5fa34-37ff-46de-9636-539c4e2e540e service neutron] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:36:18.413254 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab5fa34-37ff-46de-9636-539c4e2e540e service neutron] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:36:18.413570 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab5fa34-37ff-46de-9636-539c4e2e540e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:36:18.415686 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-cab5fa34-37ff-46de-9636-539c4e2e540e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:36:18.430056 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab5fa34-37ff-46de-9636-539c4e2e540e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:36:18.431544 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab5fa34-37ff-46de-9636-539c4e2e540e service neutron] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:36:18.440313 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1373/2737] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:36:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:36:29.160755 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce8160-4de1-4fe4-b4f5-4dad72041718 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:36:29.161240 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce8160-4de1-4fe4-b4f5-4dad72041718 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:36:29.161240 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce8160-4de1-4fe4-b4f5-4dad72041718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:36:29.179497 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-06ce8160-4de1-4fe4-b4f5-4dad72041718 None None] MFA Rules not processed for user `02c86bc6b7194462ab9f00b4bdc9f3e9`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:36:29.180707 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-06ce8160-4de1-4fe4-b4f5-4dad72041718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:36:29.235042 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1365/2738] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:36:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:36:41.592790 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab5fa34-37ff-46de-9636-539c4e2e540e service neutron] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:36:41.595241 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-cab5fa34-37ff-46de-9636-539c4e2e540e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:36:41.606123 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab5fa34-37ff-46de-9636-539c4e2e540e service neutron] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:36:41.610588 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736f5c2a-8358-4341-a6d3-c7f517cd75c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:36:41.611381 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f5c2a-8358-4341-a6d3-c7f517cd75c8 service neutron] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:36:41.611672 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f5c2a-8358-4341-a6d3-c7f517cd75c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:36:41.611944 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f5c2a-8358-4341-a6d3-c7f517cd75c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:36:41.613744 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-736f5c2a-8358-4341-a6d3-c7f517cd75c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:36:41.678679 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736f5c2a-8358-4341-a6d3-c7f517cd75c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:36:41.680131 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736f5c2a-8358-4341-a6d3-c7f517cd75c8 service neutron] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:36:41.689688 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1374/2739] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:36:41 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:37:19.276235 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ce8160-4de1-4fe4-b4f5-4dad72041718 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:37:19.277746 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-06ce8160-4de1-4fe4-b4f5-4dad72041718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:37:19.361315 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ce8160-4de1-4fe4-b4f5-4dad72041718 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:37:19.366824 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be44dce-458e-4816-86f4-d3f781eaa707 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7343cd5457264dabb4c2b3a62df59431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:37:19.367485 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be44dce-458e-4816-86f4-d3f781eaa707 service placement] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:37:19.367767 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be44dce-458e-4816-86f4-d3f781eaa707 service placement] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:37:19.368039 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be44dce-458e-4816-86f4-d3f781eaa707 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:37:19.370061 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-9be44dce-458e-4816-86f4-d3f781eaa707 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:37:19.383076 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be44dce-458e-4816-86f4-d3f781eaa707 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:37:19.384657 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be44dce-458e-4816-86f4-d3f781eaa707 service placement] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:37:19.394640 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1366/2740] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:37:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:37:27.733012 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95bd6a4-a78c-43c2-9e37-3a39fc0ea5a5 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:37:27.734218 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95bd6a4-a78c-43c2-9e37-3a39fc0ea5a5 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:37:27.734218 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95bd6a4-a78c-43c2-9e37-3a39fc0ea5a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:37:27.750784 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-c95bd6a4-a78c-43c2-9e37-3a39fc0ea5a5 None None] MFA Rules not processed for user `02c86bc6b7194462ab9f00b4bdc9f3e9`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:37:27.751962 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-c95bd6a4-a78c-43c2-9e37-3a39fc0ea5a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:37:27.758645 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1375/2741] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:37:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:37:56.979587 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be44dce-458e-4816-86f4-d3f781eaa707 service placement] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:37:56.988854 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be44dce-458e-4816-86f4-d3f781eaa707 service placement] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:37:56.992499 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a5602f-d8a3-4e18-b42e-29c130aaf2ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:37:56.993134 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5602f-d8a3-4e18-b42e-29c130aaf2ae service neutron] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:37:56.993421 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5602f-d8a3-4e18-b42e-29c130aaf2ae service neutron] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:37:56.993697 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5602f-d8a3-4e18-b42e-29c130aaf2ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:37:56.995482 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-a9a5602f-d8a3-4e18-b42e-29c130aaf2ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:37:57.005943 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a5602f-d8a3-4e18-b42e-29c130aaf2ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:37:57.007516 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a5602f-d8a3-4e18-b42e-29c130aaf2ae service neutron] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:37:57.015814 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1367/2742] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:37:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:37:57.105572 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95bd6a4-a78c-43c2-9e37-3a39fc0ea5a5 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:37:57.115604 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95bd6a4-a78c-43c2-9e37-3a39fc0ea5a5 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:37:57.119972 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5960aff3-2cf3-4437-ba1c-4d1a006b175c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:37:57.120691 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5960aff3-2cf3-4437-ba1c-4d1a006b175c service neutron] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:37:57.121107 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5960aff3-2cf3-4437-ba1c-4d1a006b175c service neutron] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:37:57.121356 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5960aff3-2cf3-4437-ba1c-4d1a006b175c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:37:57.123152 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-5960aff3-2cf3-4437-ba1c-4d1a006b175c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:37:57.194210 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5960aff3-2cf3-4437-ba1c-4d1a006b175c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:37:57.195676 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5960aff3-2cf3-4437-ba1c-4d1a006b175c service neutron] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:37:57.206751 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1376/2743] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:37:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:38:24.458521 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a5602f-d8a3-4e18-b42e-29c130aaf2ae service neutron] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:38:24.467792 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a5602f-d8a3-4e18-b42e-29c130aaf2ae service neutron] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:38:24.471422 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d441728e-e2ba-434e-8167-89bf6d6ffe0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:38:24.472808 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441728e-e2ba-434e-8167-89bf6d6ffe0b service neutron] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:38:24.473090 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441728e-e2ba-434e-8167-89bf6d6ffe0b service neutron] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:38:24.473362 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441728e-e2ba-434e-8167-89bf6d6ffe0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:38:24.475182 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-d441728e-e2ba-434e-8167-89bf6d6ffe0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:38:24.490163 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d441728e-e2ba-434e-8167-89bf6d6ffe0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:38:24.491660 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d441728e-e2ba-434e-8167-89bf6d6ffe0b service neutron] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:38:24.502548 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1368/2744] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:38:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:38:29.891200 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef4a71-d856-463b-afca-5aae9725bdd3 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:38:29.891710 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef4a71-d856-463b-afca-5aae9725bdd3 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:38:29.891820 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef4a71-d856-463b-afca-5aae9725bdd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:38:29.914187 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-85ef4a71-d856-463b-afca-5aae9725bdd3 None None] MFA Rules not processed for user `02c86bc6b7194462ab9f00b4bdc9f3e9`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:38:29.915650 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-85ef4a71-d856-463b-afca-5aae9725bdd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:38:29.923856 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1377/2745] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:38:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:38:30.126787 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d441728e-e2ba-434e-8167-89bf6d6ffe0b service neutron] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:38:30.135970 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d441728e-e2ba-434e-8167-89bf6d6ffe0b service neutron] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:38:30.140104 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea488e4-f92d-42d8-bd3c-ee0392678c19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:38:30.140851 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea488e4-f92d-42d8-bd3c-ee0392678c19 service neutron] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:38:30.141231 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea488e4-f92d-42d8-bd3c-ee0392678c19 service neutron] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:38:30.141601 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea488e4-f92d-42d8-bd3c-ee0392678c19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:38:30.143533 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-8ea488e4-f92d-42d8-bd3c-ee0392678c19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:38:30.158222 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea488e4-f92d-42d8-bd3c-ee0392678c19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:38:30.163142 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea488e4-f92d-42d8-bd3c-ee0392678c19 service neutron] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:38:30.182961 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1369/2746] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:38:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:38:35.543525 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef4a71-d856-463b-afca-5aae9725bdd3 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:38:35.553255 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef4a71-d856-463b-afca-5aae9725bdd3 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:38:35.556933 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6facc101-8ade-4e10-93a3-9b054d4324ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:38:35.557763 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6facc101-8ade-4e10-93a3-9b054d4324ea service neutron] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:38:35.558051 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6facc101-8ade-4e10-93a3-9b054d4324ea service neutron] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:38:35.558380 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6facc101-8ade-4e10-93a3-9b054d4324ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:38:35.560206 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-6facc101-8ade-4e10-93a3-9b054d4324ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:38:35.626522 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6facc101-8ade-4e10-93a3-9b054d4324ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:38:35.628011 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6facc101-8ade-4e10-93a3-9b054d4324ea service neutron] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:38:35.638145 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1378/2747] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:38:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:38:42.650913 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea488e4-f92d-42d8-bd3c-ee0392678c19 service neutron] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:38:42.652933 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-8ea488e4-f92d-42d8-bd3c-ee0392678c19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:38:42.667761 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea488e4-f92d-42d8-bd3c-ee0392678c19 service neutron] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:38:42.672349 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52313d32-5234-4605-9dc8-f59f71341f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:38:42.673202 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52313d32-5234-4605-9dc8-f59f71341f70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:38:42.673518 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52313d32-5234-4605-9dc8-f59f71341f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:38:42.673798 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52313d32-5234-4605-9dc8-f59f71341f70 admin admin] PATH_INFO: `/v3/users/35958469e64e490f919742685700caa9` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:38:42.675029 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52313d32-5234-4605-9dc8-f59f71341f70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35958469e64e490f919742685700caa9)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:38:42.676975 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52313d32-5234-4605-9dc8-f59f71341f70 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:38:42.720982 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-52313d32-5234-4605-9dc8-f59f71341f70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35958469e64e490f919742685700caa9'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:38:42.732175 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-52313d32-5234-4605-9dc8-f59f71341f70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35958469e64e490f919742685700caa9'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:38:42.739040 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-52313d32-5234-4605-9dc8-f59f71341f70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35958469e64e490f919742685700caa9'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:38:42.739652 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-52313d32-5234-4605-9dc8-f59f71341f70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35958469e64e490f919742685700caa9'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:38:42.746157 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-52313d32-5234-4605-9dc8-f59f71341f70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35958469e64e490f919742685700caa9'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:38:42.751823 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1370/2748] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:38:42 2022] DELETE /identity/v3/users/35958469e64e490f919742685700caa9 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:38:42.919038 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6facc101-8ade-4e10-93a3-9b054d4324ea service neutron] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:38:42.929586 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6facc101-8ade-4e10-93a3-9b054d4324ea service neutron] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:38:42.985922 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650b78e4-e31b-4c47-b589-634f33da7b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:38:42.986720 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b78e4-e31b-4c47-b589-634f33da7b28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:38:42.987025 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b78e4-e31b-4c47-b589-634f33da7b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:38:42.987291 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b78e4-e31b-4c47-b589-634f33da7b28 admin admin] PATH_INFO: `/v3/projects/e85d97e5ef8a4dc3a0fed53b8b299a52` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:38:42.989291 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650b78e4-e31b-4c47-b589-634f33da7b28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e85d97e5ef8a4dc3a0fed53b8b299a52)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:38:42.991279 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650b78e4-e31b-4c47-b589-634f33da7b28 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:38:43.037324 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-650b78e4-e31b-4c47-b589-634f33da7b28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e85d97e5ef8a4dc3a0fed53b8b299a52', 'request_id': 'req-650b78e4-e31b-4c47-b589-634f33da7b28'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:38:43.042550 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-650b78e4-e31b-4c47-b589-634f33da7b28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e85d97e5ef8a4dc3a0fed53b8b299a52', 'request_id': 'req-650b78e4-e31b-4c47-b589-634f33da7b28'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:38:43.049557 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-650b78e4-e31b-4c47-b589-634f33da7b28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e85d97e5ef8a4dc3a0fed53b8b299a52', 'request_id': 'req-650b78e4-e31b-4c47-b589-634f33da7b28'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:38:43.061270 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-650b78e4-e31b-4c47-b589-634f33da7b28 admin admin] The token cache is being invalidate because project e85d97e5ef8a4dc3a0fed53b8b299a52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:38:43.061557 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-650b78e4-e31b-4c47-b589-634f33da7b28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:38:43.062208 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-650b78e4-e31b-4c47-b589-634f33da7b28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:38:43.063930 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1379/2749] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:38:42 2022] DELETE /identity/v3/projects/e85d97e5ef8a4dc3a0fed53b8b299a52 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:38:43.068874 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52313d32-5234-4605-9dc8-f59f71341f70 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:38:43.070291 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-52313d32-5234-4605-9dc8-f59f71341f70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:38:43.083241 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52313d32-5234-4605-9dc8-f59f71341f70 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:38:43.138175 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3262aa19-f5b7-46cb-9280-449f9e85857e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:38:43.139070 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3262aa19-f5b7-46cb-9280-449f9e85857e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:38:43.139352 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3262aa19-f5b7-46cb-9280-449f9e85857e admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:38:43.139624 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3262aa19-f5b7-46cb-9280-449f9e85857e admin admin] PATH_INFO: `/v3/users/388f989915d543eb950e29989d491854` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:38:43.140799 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3262aa19-f5b7-46cb-9280-449f9e85857e admin admin] RBAC: Authorizing `identity:delete_user(user_id=388f989915d543eb950e29989d491854)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:38:43.142692 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3262aa19-f5b7-46cb-9280-449f9e85857e admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:38:43.187153 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-3262aa19-f5b7-46cb-9280-449f9e85857e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '388f989915d543eb950e29989d491854'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:38:43.199243 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-3262aa19-f5b7-46cb-9280-449f9e85857e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '388f989915d543eb950e29989d491854'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:38:43.206447 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-3262aa19-f5b7-46cb-9280-449f9e85857e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '388f989915d543eb950e29989d491854'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:38:43.207490 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-3262aa19-f5b7-46cb-9280-449f9e85857e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '388f989915d543eb950e29989d491854'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:38:43.214160 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-3262aa19-f5b7-46cb-9280-449f9e85857e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '388f989915d543eb950e29989d491854'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:38:43.219996 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1371/2750] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:38:43 2022] DELETE /identity/v3/users/388f989915d543eb950e29989d491854 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:38:43.389399 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650b78e4-e31b-4c47-b589-634f33da7b28 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:38:43.390855 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-650b78e4-e31b-4c47-b589-634f33da7b28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:38:43.404547 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650b78e4-e31b-4c47-b589-634f33da7b28 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:38:43.460868 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579de836-32c2-4d4c-bf2f-31e7945608a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:38:43.461729 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579de836-32c2-4d4c-bf2f-31e7945608a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:38:43.462007 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579de836-32c2-4d4c-bf2f-31e7945608a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:38:43.462277 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579de836-32c2-4d4c-bf2f-31e7945608a4 admin admin] PATH_INFO: `/v3/projects/e8d04ccbb0464a5d9c3bc1835e4d48b0` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:38:43.463456 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579de836-32c2-4d4c-bf2f-31e7945608a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8d04ccbb0464a5d9c3bc1835e4d48b0)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:38:43.465332 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579de836-32c2-4d4c-bf2f-31e7945608a4 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:38:43.508885 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-579de836-32c2-4d4c-bf2f-31e7945608a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8d04ccbb0464a5d9c3bc1835e4d48b0', 'request_id': 'req-579de836-32c2-4d4c-bf2f-31e7945608a4'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:38:43.514144 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-579de836-32c2-4d4c-bf2f-31e7945608a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8d04ccbb0464a5d9c3bc1835e4d48b0', 'request_id': 'req-579de836-32c2-4d4c-bf2f-31e7945608a4'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:38:43.521657 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-579de836-32c2-4d4c-bf2f-31e7945608a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8d04ccbb0464a5d9c3bc1835e4d48b0', 'request_id': 'req-579de836-32c2-4d4c-bf2f-31e7945608a4'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:38:43.532446 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-579de836-32c2-4d4c-bf2f-31e7945608a4 admin admin] The token cache is being invalidate because project e8d04ccbb0464a5d9c3bc1835e4d48b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:38:43.532733 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-579de836-32c2-4d4c-bf2f-31e7945608a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:38:43.533358 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-579de836-32c2-4d4c-bf2f-31e7945608a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:38:43.534888 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1380/2751] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:38:43 2022] DELETE /identity/v3/projects/e8d04ccbb0464a5d9c3bc1835e4d48b0 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:39:22.745260 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3262aa19-f5b7-46cb-9280-449f9e85857e admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:39:22.746994 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-3262aa19-f5b7-46cb-9280-449f9e85857e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:39:22.850637 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3262aa19-f5b7-46cb-9280-449f9e85857e admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:39:22.941506 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c084029a-983e-42d7-860a-a0314c1d8e5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140c6d1a20e94192bde06e72040f162d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:39:22.942171 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084029a-983e-42d7-860a-a0314c1d8e5c service nova] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:22.942447 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084029a-983e-42d7-860a-a0314c1d8e5c service nova] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:22.942734 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084029a-983e-42d7-860a-a0314c1d8e5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:22.945620 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-c084029a-983e-42d7-860a-a0314c1d8e5c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:39:22.959193 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c084029a-983e-42d7-860a-a0314c1d8e5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:39:22.960782 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c084029a-983e-42d7-860a-a0314c1d8e5c service nova] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:39:22.972294 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1372/2752] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:39:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:39:25.874163 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579de836-32c2-4d4c-bf2f-31e7945608a4 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:39:25.875786 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-579de836-32c2-4d4c-bf2f-31e7945608a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:39:25.953103 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579de836-32c2-4d4c-bf2f-31e7945608a4 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:39:25.965626 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7a0172-628f-4e62-b96c-9aae262a3490 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:39:25.966487 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a0172-628f-4e62-b96c-9aae262a3490 service neutron] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:25.966933 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a0172-628f-4e62-b96c-9aae262a3490 service neutron] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:25.967349 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a0172-628f-4e62-b96c-9aae262a3490 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:25.969385 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-4e7a0172-628f-4e62-b96c-9aae262a3490 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:39:25.985564 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7a0172-628f-4e62-b96c-9aae262a3490 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:39:25.987609 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7a0172-628f-4e62-b96c-9aae262a3490 service neutron] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:39:25.999032 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1381/2753] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:39:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:39:31.380598 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c084029a-983e-42d7-860a-a0314c1d8e5c service nova] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:39:31.387764 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-c084029a-983e-42d7-860a-a0314c1d8e5c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:39:31.469860 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c084029a-983e-42d7-860a-a0314c1d8e5c service nova] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:39:31.474426 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946bcf9b-219a-42d1-bf40-be440d010449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:39:31.475444 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946bcf9b-219a-42d1-bf40-be440d010449 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:31.475728 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946bcf9b-219a-42d1-bf40-be440d010449 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:31.476000 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946bcf9b-219a-42d1-bf40-be440d010449 admin admin] PATH_INFO: `/v3/users/02c86bc6b7194462ab9f00b4bdc9f3e9` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:31.477185 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946bcf9b-219a-42d1-bf40-be440d010449 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02c86bc6b7194462ab9f00b4bdc9f3e9)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:39:31.479690 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946bcf9b-219a-42d1-bf40-be440d010449 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:39:31.527521 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-946bcf9b-219a-42d1-bf40-be440d010449 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02c86bc6b7194462ab9f00b4bdc9f3e9'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:31.539040 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-946bcf9b-219a-42d1-bf40-be440d010449 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02c86bc6b7194462ab9f00b4bdc9f3e9'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:31.546394 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-946bcf9b-219a-42d1-bf40-be440d010449 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02c86bc6b7194462ab9f00b4bdc9f3e9'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:31.547103 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-946bcf9b-219a-42d1-bf40-be440d010449 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02c86bc6b7194462ab9f00b4bdc9f3e9'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:31.557786 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-946bcf9b-219a-42d1-bf40-be440d010449 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02c86bc6b7194462ab9f00b4bdc9f3e9'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:31.560542 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1373/2754] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:39:31 2022] DELETE /identity/v3/users/02c86bc6b7194462ab9f00b4bdc9f3e9 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:39:31.981938 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7a0172-628f-4e62-b96c-9aae262a3490 service neutron] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:39:31.995191 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7a0172-628f-4e62-b96c-9aae262a3490 service neutron] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:39:32.058141 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9c64a0-d0f8-490b-bb5a-affb5e75ea6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:39:32.059068 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c64a0-d0f8-490b-bb5a-affb5e75ea6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:32.059351 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c64a0-d0f8-490b-bb5a-affb5e75ea6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:32.059630 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c64a0-d0f8-490b-bb5a-affb5e75ea6b admin admin] PATH_INFO: `/v3/projects/f209b912e4bd4a87ae03b6ffd2abe157` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:32.060832 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9c64a0-d0f8-490b-bb5a-affb5e75ea6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f209b912e4bd4a87ae03b6ffd2abe157)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:39:32.062772 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9c64a0-d0f8-490b-bb5a-affb5e75ea6b admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:39:32.116744 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-0a9c64a0-d0f8-490b-bb5a-affb5e75ea6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f209b912e4bd4a87ae03b6ffd2abe157', 'request_id': 'req-0a9c64a0-d0f8-490b-bb5a-affb5e75ea6b'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:32.122589 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-0a9c64a0-d0f8-490b-bb5a-affb5e75ea6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f209b912e4bd4a87ae03b6ffd2abe157', 'request_id': 'req-0a9c64a0-d0f8-490b-bb5a-affb5e75ea6b'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:32.131616 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-0a9c64a0-d0f8-490b-bb5a-affb5e75ea6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f209b912e4bd4a87ae03b6ffd2abe157', 'request_id': 'req-0a9c64a0-d0f8-490b-bb5a-affb5e75ea6b'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:32.143942 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-0a9c64a0-d0f8-490b-bb5a-affb5e75ea6b admin admin] The token cache is being invalidate because project f209b912e4bd4a87ae03b6ffd2abe157 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:39:32.144231 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-0a9c64a0-d0f8-490b-bb5a-affb5e75ea6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:32.145074 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-0a9c64a0-d0f8-490b-bb5a-affb5e75ea6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:32.146957 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1382/2755] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:39:31 2022] DELETE /identity/v3/projects/f209b912e4bd4a87ae03b6ffd2abe157 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:39:32.152369 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17d6d0-aa25-4054-9d67-4bc653a04d8d None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:32.153032 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17d6d0-aa25-4054-9d67-4bc653a04d8d None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:32.153477 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17d6d0-aa25-4054-9d67-4bc653a04d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:32.177722 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-2b17d6d0-aa25-4054-9d67-4bc653a04d8d None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:39:32.178395 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-2b17d6d0-aa25-4054-9d67-4bc653a04d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:39:32.244433 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1374/2756] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:39:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:39:32.252590 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa5471-5fb9-4223-88eb-15bc899f7248 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:32.253085 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa5471-5fb9-4223-88eb-15bc899f7248 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:32.253538 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa5471-5fb9-4223-88eb-15bc899f7248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:32.276468 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-0bfa5471-5fb9-4223-88eb-15bc899f7248 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:39:32.278042 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-0bfa5471-5fb9-4223-88eb-15bc899f7248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:39:32.286814 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1383/2757] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:39:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:39:32.290733 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17d6d0-aa25-4054-9d67-4bc653a04d8d None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:39:32.301014 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17d6d0-aa25-4054-9d67-4bc653a04d8d None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:39:32.307888 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d43c7b-af35-464c-8e63-d2993a4aed93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:39:32.308567 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d43c7b-af35-464c-8e63-d2993a4aed93 admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:32.308907 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d43c7b-af35-464c-8e63-d2993a4aed93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:32.309193 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d43c7b-af35-464c-8e63-d2993a4aed93 admin admin] PATH_INFO: `/v3/domains` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:32.309921 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d43c7b-af35-464c-8e63-d2993a4aed93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:39:32.310229 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d43c7b-af35-464c-8e63-d2993a4aed93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:39:32.312173 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d43c7b-af35-464c-8e63-d2993a4aed93 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:39:32.329366 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1375/2758] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Mar 30 01:39:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:39:32.330856 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfa5471-5fb9-4223-88eb-15bc899f7248 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:39:32.352042 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfa5471-5fb9-4223-88eb-15bc899f7248 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:39:32.364476 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19cdde9-bd3c-4380-ac49-9f814c4acb7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:39:32.365434 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19cdde9-bd3c-4380-ac49-9f814c4acb7f admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:32.365847 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19cdde9-bd3c-4380-ac49-9f814c4acb7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:32.366264 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19cdde9-bd3c-4380-ac49-9f814c4acb7f admin admin] PATH_INFO: `/v3/projects` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:32.367240 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19cdde9-bd3c-4380-ac49-9f814c4acb7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:39:32.370624 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19cdde9-bd3c-4380-ac49-9f814c4acb7f admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:39:32.401052 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1384/2759] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:39:32 2022] POST /identity/v3/projects => generated 367 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:39:32.405379 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d43c7b-af35-464c-8e63-d2993a4aed93 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:39:32.416077 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d43c7b-af35-464c-8e63-d2993a4aed93 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:39:32.475974 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55360131-5fd3-4e06-83d5-7b5da60c86eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:39:32.476649 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55360131-5fd3-4e06-83d5-7b5da60c86eb admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:32.476935 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55360131-5fd3-4e06-83d5-7b5da60c86eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:32.477215 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55360131-5fd3-4e06-83d5-7b5da60c86eb admin admin] PATH_INFO: `/v3/users` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:32.477905 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55360131-5fd3-4e06-83d5-7b5da60c86eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:39:32.479862 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55360131-5fd3-4e06-83d5-7b5da60c86eb admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:39:32.500148 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1376/2760] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:39:32 2022] POST /identity/v3/users => generated 284 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 01:39:32.504295 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19cdde9-bd3c-4380-ac49-9f814c4acb7f admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:39:32.515657 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19cdde9-bd3c-4380-ac49-9f814c4acb7f admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:39:32.520621 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38d8107-15f4-453e-92f0-a939efdb1121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:39:32.521448 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d8107-15f4-453e-92f0-a939efdb1121 admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:32.521827 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d8107-15f4-453e-92f0-a939efdb1121 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:32.522196 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d8107-15f4-453e-92f0-a939efdb1121 admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:32.523065 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38d8107-15f4-453e-92f0-a939efdb1121 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:39:32.524740 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38d8107-15f4-453e-92f0-a939efdb1121 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:39:32.535687 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1385/2761] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:39:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 01:39:32.539810 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55360131-5fd3-4e06-83d5-7b5da60c86eb admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:39:32.549856 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55360131-5fd3-4e06-83d5-7b5da60c86eb admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:39:32.554895 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d84ca-1a74-4bdf-b5f0-f11b30106fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:39:32.555668 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d84ca-1a74-4bdf-b5f0-f11b30106fa6 admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:32.555998 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d84ca-1a74-4bdf-b5f0-f11b30106fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:32.556935 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d84ca-1a74-4bdf-b5f0-f11b30106fa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:32.557800 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972d84ca-1a74-4bdf-b5f0-f11b30106fa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:39:32.559465 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972d84ca-1a74-4bdf-b5f0-f11b30106fa6 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:39:32.569620 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1377/2762] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:39:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 01:39:32.574498 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38d8107-15f4-453e-92f0-a939efdb1121 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:39:32.584664 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38d8107-15f4-453e-92f0-a939efdb1121 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:39:32.589649 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d59364-c6ce-424f-9e87-e935f6edc0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:39:32.590824 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d59364-c6ce-424f-9e87-e935f6edc0c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:32.593303 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d59364-c6ce-424f-9e87-e935f6edc0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:32.593303 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d59364-c6ce-424f-9e87-e935f6edc0c0 admin admin] PATH_INFO: `/v3/projects/dcfcf698f8c24315ab42e5f87f2074e2/users/20d4ce347dd545a7b62039f9ff09f0c3/roles/7185d0cfbcd44502b1613bcfe1b42f6f` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:32.608933 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d59364-c6ce-424f-9e87-e935f6edc0c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcfcf698f8c24315ab42e5f87f2074e2, user_id=20d4ce347dd545a7b62039f9ff09f0c3, role_id=7185d0cfbcd44502b1613bcfe1b42f6f)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:39:32.611909 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d59364-c6ce-424f-9e87-e935f6edc0c0 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:39:32.629378 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1386/2763] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:39:32 2022] PUT /identity/v3/projects/dcfcf698f8c24315ab42e5f87f2074e2/users/20d4ce347dd545a7b62039f9ff09f0c3/roles/7185d0cfbcd44502b1613bcfe1b42f6f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:39:32.641246 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f751c5-3be0-48db-8550-96794a90a234 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:32.641524 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f751c5-3be0-48db-8550-96794a90a234 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:32.641810 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f751c5-3be0-48db-8550-96794a90a234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:32.701523 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-c3f751c5-3be0-48db-8550-96794a90a234 None None] MFA Rules not processed for user `20d4ce347dd545a7b62039f9ff09f0c3`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:39:32.702780 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-c3f751c5-3be0-48db-8550-96794a90a234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:39:32.854978 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1378/2764] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:39:32 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:39:32.865535 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d59364-c6ce-424f-9e87-e935f6edc0c0 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:39:32.869912 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-05d59364-c6ce-424f-9e87-e935f6edc0c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:39:32.952162 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d59364-c6ce-424f-9e87-e935f6edc0c0 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:39:32.957280 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bdc8bc-8657-4e6b-bae3-2d45c49a0bbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45219f386f0147b6bd380efe4ab62812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:39:32.958293 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bdc8bc-8657-4e6b-bae3-2d45c49a0bbc service cinder] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:32.958575 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bdc8bc-8657-4e6b-bae3-2d45c49a0bbc service cinder] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:32.958892 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bdc8bc-8657-4e6b-bae3-2d45c49a0bbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:32.968384 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bdc8bc-8657-4e6b-bae3-2d45c49a0bbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:39:32.970077 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bdc8bc-8657-4e6b-bae3-2d45c49a0bbc service cinder] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:39:32.988612 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1387/2765] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:39:32 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 30 01:39:36.909602 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f751c5-3be0-48db-8550-96794a90a234 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:39:36.911216 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-c3f751c5-3be0-48db-8550-96794a90a234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:39:36.980957 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f751c5-3be0-48db-8550-96794a90a234 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:39:36.985636 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff799a4-bcd3-4e14-a295-d89200ff3171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:39:36.986471 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff799a4-bcd3-4e14-a295-d89200ff3171 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:36.986790 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff799a4-bcd3-4e14-a295-d89200ff3171 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:36.987067 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff799a4-bcd3-4e14-a295-d89200ff3171 admin admin] PATH_INFO: `/v3/users/bd10fd958b4d420881a837e0403de153` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:36.988254 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff799a4-bcd3-4e14-a295-d89200ff3171 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd10fd958b4d420881a837e0403de153)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:39:36.990167 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff799a4-bcd3-4e14-a295-d89200ff3171 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:39:37.039369 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-9ff799a4-bcd3-4e14-a295-d89200ff3171 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd10fd958b4d420881a837e0403de153'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:37.051058 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-9ff799a4-bcd3-4e14-a295-d89200ff3171 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd10fd958b4d420881a837e0403de153'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:37.059229 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-9ff799a4-bcd3-4e14-a295-d89200ff3171 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd10fd958b4d420881a837e0403de153'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:37.059880 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-9ff799a4-bcd3-4e14-a295-d89200ff3171 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd10fd958b4d420881a837e0403de153'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:37.066473 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-9ff799a4-bcd3-4e14-a295-d89200ff3171 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd10fd958b4d420881a837e0403de153'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:37.072818 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1379/2766] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:39:36 2022] DELETE /identity/v3/users/bd10fd958b4d420881a837e0403de153 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:39:37.247034 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bdc8bc-8657-4e6b-bae3-2d45c49a0bbc service cinder] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:39:37.260357 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bdc8bc-8657-4e6b-bae3-2d45c49a0bbc service cinder] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:39:37.324324 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7aceda-7340-4365-8468-c65d1bdffaaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:39:37.325286 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7aceda-7340-4365-8468-c65d1bdffaaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:37.325567 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7aceda-7340-4365-8468-c65d1bdffaaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:37.325836 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7aceda-7340-4365-8468-c65d1bdffaaa admin admin] PATH_INFO: `/v3/projects/41e905053f284f86801ebd7f370ff78a` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:37.327162 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7aceda-7340-4365-8468-c65d1bdffaaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=41e905053f284f86801ebd7f370ff78a)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:39:37.329040 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7aceda-7340-4365-8468-c65d1bdffaaa admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:39:37.375079 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-7c7aceda-7340-4365-8468-c65d1bdffaaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41e905053f284f86801ebd7f370ff78a', 'request_id': 'req-7c7aceda-7340-4365-8468-c65d1bdffaaa'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:37.380717 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-7c7aceda-7340-4365-8468-c65d1bdffaaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41e905053f284f86801ebd7f370ff78a', 'request_id': 'req-7c7aceda-7340-4365-8468-c65d1bdffaaa'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:37.389839 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-7c7aceda-7340-4365-8468-c65d1bdffaaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41e905053f284f86801ebd7f370ff78a', 'request_id': 'req-7c7aceda-7340-4365-8468-c65d1bdffaaa'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:37.402270 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-7c7aceda-7340-4365-8468-c65d1bdffaaa admin admin] The token cache is being invalidate because project 41e905053f284f86801ebd7f370ff78a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:39:37.402557 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-7c7aceda-7340-4365-8468-c65d1bdffaaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:37.403227 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-7c7aceda-7340-4365-8468-c65d1bdffaaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:37.404824 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1388/2767] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:39:37 2022] DELETE /identity/v3/projects/41e905053f284f86801ebd7f370ff78a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:39:37.409153 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff799a4-bcd3-4e14-a295-d89200ff3171 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:39:37.410577 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-9ff799a4-bcd3-4e14-a295-d89200ff3171 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:39:37.423741 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff799a4-bcd3-4e14-a295-d89200ff3171 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:39:37.479908 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4344e39e-3255-4856-b6bc-7aace0ace99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:39:37.480841 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344e39e-3255-4856-b6bc-7aace0ace99a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:37.481121 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344e39e-3255-4856-b6bc-7aace0ace99a admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:37.481397 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344e39e-3255-4856-b6bc-7aace0ace99a admin admin] PATH_INFO: `/v3/users/528cd42356fc4365b95b0d214ff04d48` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:37.482631 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4344e39e-3255-4856-b6bc-7aace0ace99a admin admin] RBAC: Authorizing `identity:delete_user(user_id=528cd42356fc4365b95b0d214ff04d48)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:39:37.484605 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4344e39e-3255-4856-b6bc-7aace0ace99a admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:39:37.533134 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-4344e39e-3255-4856-b6bc-7aace0ace99a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '528cd42356fc4365b95b0d214ff04d48'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:37.544423 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-4344e39e-3255-4856-b6bc-7aace0ace99a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '528cd42356fc4365b95b0d214ff04d48'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:37.551954 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-4344e39e-3255-4856-b6bc-7aace0ace99a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '528cd42356fc4365b95b0d214ff04d48'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:37.552672 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-4344e39e-3255-4856-b6bc-7aace0ace99a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '528cd42356fc4365b95b0d214ff04d48'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:37.563759 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-4344e39e-3255-4856-b6bc-7aace0ace99a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '528cd42356fc4365b95b0d214ff04d48'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:37.569815 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1380/2768] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:39:37 2022] DELETE /identity/v3/users/528cd42356fc4365b95b0d214ff04d48 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:39:37.744791 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7aceda-7340-4365-8468-c65d1bdffaaa admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:39:37.746252 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-7c7aceda-7340-4365-8468-c65d1bdffaaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:39:37.768675 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7aceda-7340-4365-8468-c65d1bdffaaa admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:39:37.825592 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d601bd8-8b1a-4764-9859-b10520f98b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:39:37.826364 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d601bd8-8b1a-4764-9859-b10520f98b22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:37.826641 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d601bd8-8b1a-4764-9859-b10520f98b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:37.826942 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d601bd8-8b1a-4764-9859-b10520f98b22 admin admin] PATH_INFO: `/v3/projects/b883cc6c4a874c66b775b02471346e61` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:37.828111 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d601bd8-8b1a-4764-9859-b10520f98b22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b883cc6c4a874c66b775b02471346e61)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:39:37.829997 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d601bd8-8b1a-4764-9859-b10520f98b22 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:39:37.879013 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-9d601bd8-8b1a-4764-9859-b10520f98b22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b883cc6c4a874c66b775b02471346e61', 'request_id': 'req-9d601bd8-8b1a-4764-9859-b10520f98b22'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:37.884892 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-9d601bd8-8b1a-4764-9859-b10520f98b22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b883cc6c4a874c66b775b02471346e61', 'request_id': 'req-9d601bd8-8b1a-4764-9859-b10520f98b22'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:37.895655 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-9d601bd8-8b1a-4764-9859-b10520f98b22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b883cc6c4a874c66b775b02471346e61', 'request_id': 'req-9d601bd8-8b1a-4764-9859-b10520f98b22'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:37.907645 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-9d601bd8-8b1a-4764-9859-b10520f98b22 admin admin] The token cache is being invalidate because project b883cc6c4a874c66b775b02471346e61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:39:37.907997 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-9d601bd8-8b1a-4764-9859-b10520f98b22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:37.908659 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-9d601bd8-8b1a-4764-9859-b10520f98b22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:37.910200 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1389/2769] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:39:37 2022] DELETE /identity/v3/projects/b883cc6c4a874c66b775b02471346e61 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:39:41.425137 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4344e39e-3255-4856-b6bc-7aace0ace99a admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:39:41.426478 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-4344e39e-3255-4856-b6bc-7aace0ace99a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:39:41.439557 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4344e39e-3255-4856-b6bc-7aace0ace99a admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:39:41.494223 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d41e81-d3ac-4f63-b051-87b1925e9c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:39:41.495109 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d41e81-d3ac-4f63-b051-87b1925e9c35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:41.495392 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d41e81-d3ac-4f63-b051-87b1925e9c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:41.495667 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d41e81-d3ac-4f63-b051-87b1925e9c35 admin admin] PATH_INFO: `/v3/users/20d4ce347dd545a7b62039f9ff09f0c3` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:41.496844 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d41e81-d3ac-4f63-b051-87b1925e9c35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20d4ce347dd545a7b62039f9ff09f0c3)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:39:41.498766 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d41e81-d3ac-4f63-b051-87b1925e9c35 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:39:41.543687 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-07d41e81-d3ac-4f63-b051-87b1925e9c35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20d4ce347dd545a7b62039f9ff09f0c3'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:41.554819 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-07d41e81-d3ac-4f63-b051-87b1925e9c35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20d4ce347dd545a7b62039f9ff09f0c3'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:41.562479 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-07d41e81-d3ac-4f63-b051-87b1925e9c35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20d4ce347dd545a7b62039f9ff09f0c3'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:41.563119 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-07d41e81-d3ac-4f63-b051-87b1925e9c35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20d4ce347dd545a7b62039f9ff09f0c3'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:41.569781 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-07d41e81-d3ac-4f63-b051-87b1925e9c35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20d4ce347dd545a7b62039f9ff09f0c3'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:41.576315 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1381/2770] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:39:41 2022] DELETE /identity/v3/users/20d4ce347dd545a7b62039f9ff09f0c3 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:39:41.580843 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e3867e-ddf9-489c-98b8-45b6582c3f3b None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:41.581330 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e3867e-ddf9-489c-98b8-45b6582c3f3b None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:41.581431 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e3867e-ddf9-489c-98b8-45b6582c3f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:41.598933 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-a6e3867e-ddf9-489c-98b8-45b6582c3f3b None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:39:41.600135 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-a6e3867e-ddf9-489c-98b8-45b6582c3f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:39:41.660036 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1390/2771] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:39:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:39:41.670293 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d41e81-d3ac-4f63-b051-87b1925e9c35 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:39:41.671733 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-07d41e81-d3ac-4f63-b051-87b1925e9c35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:39:41.727278 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d41e81-d3ac-4f63-b051-87b1925e9c35 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:39:41.731256 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8493bd5-be84-4386-b0bd-9b604e1cc4ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:39:41.734535 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8493bd5-be84-4386-b0bd-9b604e1cc4ae service neutron] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:41.734535 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8493bd5-be84-4386-b0bd-9b604e1cc4ae service neutron] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:41.734535 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8493bd5-be84-4386-b0bd-9b604e1cc4ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:41.741683 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8493bd5-be84-4386-b0bd-9b604e1cc4ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:39:41.743163 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8493bd5-be84-4386-b0bd-9b604e1cc4ae service neutron] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:39:41.753181 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1382/2772] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:39:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:39:42.013071 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e3867e-ddf9-489c-98b8-45b6582c3f3b None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:39:42.014547 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-a6e3867e-ddf9-489c-98b8-45b6582c3f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:39:42.029739 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e3867e-ddf9-489c-98b8-45b6582c3f3b None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:39:42.034649 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803e75f5-acbd-464a-817a-f41398815e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:39:42.035550 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e75f5-acbd-464a-817a-f41398815e3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:42.035832 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e75f5-acbd-464a-817a-f41398815e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:42.036110 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e75f5-acbd-464a-817a-f41398815e3b admin admin] PATH_INFO: `/v3/projects/dcfcf698f8c24315ab42e5f87f2074e2` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:42.037299 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803e75f5-acbd-464a-817a-f41398815e3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcfcf698f8c24315ab42e5f87f2074e2)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:39:42.039312 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803e75f5-acbd-464a-817a-f41398815e3b admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:39:42.084718 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-803e75f5-acbd-464a-817a-f41398815e3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcfcf698f8c24315ab42e5f87f2074e2', 'request_id': 'req-803e75f5-acbd-464a-817a-f41398815e3b'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:42.090048 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-803e75f5-acbd-464a-817a-f41398815e3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcfcf698f8c24315ab42e5f87f2074e2', 'request_id': 'req-803e75f5-acbd-464a-817a-f41398815e3b'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:42.098266 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-803e75f5-acbd-464a-817a-f41398815e3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcfcf698f8c24315ab42e5f87f2074e2', 'request_id': 'req-803e75f5-acbd-464a-817a-f41398815e3b'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:42.109287 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-803e75f5-acbd-464a-817a-f41398815e3b admin admin] The token cache is being invalidate because project dcfcf698f8c24315ab42e5f87f2074e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:39:42.109602 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-803e75f5-acbd-464a-817a-f41398815e3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:42.110230 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-803e75f5-acbd-464a-817a-f41398815e3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:42.111795 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1391/2773] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:39:42 2022] DELETE /identity/v3/projects/dcfcf698f8c24315ab42e5f87f2074e2 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:39:42.116692 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a96363-debf-4aa7-b400-f1ffedf099a5 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:42.116984 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a96363-debf-4aa7-b400-f1ffedf099a5 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:42.117267 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a96363-debf-4aa7-b400-f1ffedf099a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:42.136549 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-20a96363-debf-4aa7-b400-f1ffedf099a5 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:39:42.137743 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-20a96363-debf-4aa7-b400-f1ffedf099a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:39:42.195528 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1383/2774] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:39:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:39:42.203916 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5890d481-ba47-4fa7-89e0-141546845b87 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:42.204240 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5890d481-ba47-4fa7-89e0-141546845b87 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:42.204518 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5890d481-ba47-4fa7-89e0-141546845b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:42.222615 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-5890d481-ba47-4fa7-89e0-141546845b87 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:39:42.223866 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-5890d481-ba47-4fa7-89e0-141546845b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:39:42.231806 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1392/2775] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:39:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:39:42.235847 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a96363-debf-4aa7-b400-f1ffedf099a5 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:39:42.245940 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a96363-debf-4aa7-b400-f1ffedf099a5 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:39:42.250492 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e36f3aa-d8d8-49d4-b19c-e7bb2cddd288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:39:42.251177 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e36f3aa-d8d8-49d4-b19c-e7bb2cddd288 admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:42.251463 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e36f3aa-d8d8-49d4-b19c-e7bb2cddd288 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:42.251740 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e36f3aa-d8d8-49d4-b19c-e7bb2cddd288 admin admin] PATH_INFO: `/v3/domains` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:42.252683 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e36f3aa-d8d8-49d4-b19c-e7bb2cddd288 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:39:42.252998 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e36f3aa-d8d8-49d4-b19c-e7bb2cddd288 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:39:42.254579 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e36f3aa-d8d8-49d4-b19c-e7bb2cddd288 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:39:42.266840 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1384/2776] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Mar 30 01:39:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 01:39:42.270998 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5890d481-ba47-4fa7-89e0-141546845b87 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:39:42.280167 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5890d481-ba47-4fa7-89e0-141546845b87 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:39:42.285011 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e696f93-a839-4585-9320-c4321874658e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:39:42.285660 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e696f93-a839-4585-9320-c4321874658e admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:42.285935 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e696f93-a839-4585-9320-c4321874658e admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:42.286205 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e696f93-a839-4585-9320-c4321874658e admin admin] PATH_INFO: `/v3/projects` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:42.286929 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e696f93-a839-4585-9320-c4321874658e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:39:42.288835 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e696f93-a839-4585-9320-c4321874658e admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:39:42.313588 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1393/2777] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:39:42 2022] POST /identity/v3/projects => generated 403 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 01:39:42.317733 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e36f3aa-d8d8-49d4-b19c-e7bb2cddd288 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:39:42.328763 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e36f3aa-d8d8-49d4-b19c-e7bb2cddd288 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:39:42.382184 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7df60f-8b6e-40e8-ac10-702914722c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:39:42.382865 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7df60f-8b6e-40e8-ac10-702914722c12 admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:42.383147 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7df60f-8b6e-40e8-ac10-702914722c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:42.383420 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7df60f-8b6e-40e8-ac10-702914722c12 admin admin] PATH_INFO: `/v3/users` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:42.384111 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7df60f-8b6e-40e8-ac10-702914722c12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:39:42.386817 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7df60f-8b6e-40e8-ac10-702914722c12 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:39:42.406325 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1385/2778] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:39:42 2022] POST /identity/v3/users => generated 302 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:39:42.410607 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e696f93-a839-4585-9320-c4321874658e admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:39:42.421574 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e696f93-a839-4585-9320-c4321874658e admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:39:42.426323 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa01122-6e97-433b-be23-3e73e676460a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:39:42.427018 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa01122-6e97-433b-be23-3e73e676460a admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:42.427313 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa01122-6e97-433b-be23-3e73e676460a admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:42.427587 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa01122-6e97-433b-be23-3e73e676460a admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:42.428304 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa01122-6e97-433b-be23-3e73e676460a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:39:42.429898 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa01122-6e97-433b-be23-3e73e676460a admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:39:42.441123 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1394/2779] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:39:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:39:42.445076 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7df60f-8b6e-40e8-ac10-702914722c12 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:39:42.454873 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7df60f-8b6e-40e8-ac10-702914722c12 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:39:42.459662 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea20bd55-cffd-4f90-86e1-8e908111a9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:39:42.460315 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20bd55-cffd-4f90-86e1-8e908111a9fb admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:42.460602 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20bd55-cffd-4f90-86e1-8e908111a9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:42.460880 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20bd55-cffd-4f90-86e1-8e908111a9fb admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:42.461663 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea20bd55-cffd-4f90-86e1-8e908111a9fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:39:42.463358 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea20bd55-cffd-4f90-86e1-8e908111a9fb admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:39:42.473044 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1386/2780] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:39:42 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 01:39:42.479341 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa01122-6e97-433b-be23-3e73e676460a admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:39:42.489140 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa01122-6e97-433b-be23-3e73e676460a admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:39:42.494275 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65011c59-950d-4863-96e3-e0fe5afa0c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:39:42.495205 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65011c59-950d-4863-96e3-e0fe5afa0c42 admin admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:42.495484 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65011c59-950d-4863-96e3-e0fe5afa0c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:42.495756 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65011c59-950d-4863-96e3-e0fe5afa0c42 admin admin] PATH_INFO: `/v3/projects/7975918319be45ecadcc3aa85c7ed40d/users/b0d9de80881e4d549d6402c54b664784/roles/7185d0cfbcd44502b1613bcfe1b42f6f` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:42.510442 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65011c59-950d-4863-96e3-e0fe5afa0c42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7975918319be45ecadcc3aa85c7ed40d, user_id=b0d9de80881e4d549d6402c54b664784, role_id=7185d0cfbcd44502b1613bcfe1b42f6f)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:39:42.513133 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65011c59-950d-4863-96e3-e0fe5afa0c42 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:39:42.527538 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1395/2781] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:39:42 2022] PUT /identity/v3/projects/7975918319be45ecadcc3aa85c7ed40d/users/b0d9de80881e4d549d6402c54b664784/roles/7185d0cfbcd44502b1613bcfe1b42f6f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:39:42.537837 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43506a35-eb6e-4d43-93e4-e74621dca626 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:42.538136 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43506a35-eb6e-4d43-93e4-e74621dca626 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:42.538442 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43506a35-eb6e-4d43-93e4-e74621dca626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:42.565838 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-43506a35-eb6e-4d43-93e4-e74621dca626 None None] MFA Rules not processed for user `b0d9de80881e4d549d6402c54b664784`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:39:42.567105 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-43506a35-eb6e-4d43-93e4-e74621dca626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:39:42.628758 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1387/2782] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:39:42 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:39:42.633210 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65011c59-950d-4863-96e3-e0fe5afa0c42 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:39:42.693213 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65011c59-950d-4863-96e3-e0fe5afa0c42 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:39:42.697811 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02762c23-08ce-4ce4-95e6-43cbab823fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:39:42.698493 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02762c23-08ce-4ce4-95e6-43cbab823fe9 admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:42.698800 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02762c23-08ce-4ce4-95e6-43cbab823fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:42.699078 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02762c23-08ce-4ce4-95e6-43cbab823fe9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:42.699761 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02762c23-08ce-4ce4-95e6-43cbab823fe9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:39:42.701675 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02762c23-08ce-4ce4-95e6-43cbab823fe9 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:39:42.725265 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1396/2783] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:39:42 2022] POST /identity/v3/projects => generated 405 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:39:42.729962 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43506a35-eb6e-4d43-93e4-e74621dca626 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:39:42.740538 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43506a35-eb6e-4d43-93e4-e74621dca626 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:39:42.795131 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519122ab-3d77-4e61-b9e0-90bf8ffb59af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:39:42.795783 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519122ab-3d77-4e61-b9e0-90bf8ffb59af admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:42.796067 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519122ab-3d77-4e61-b9e0-90bf8ffb59af admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:42.796342 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519122ab-3d77-4e61-b9e0-90bf8ffb59af admin admin] PATH_INFO: `/v3/users` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:42.797027 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519122ab-3d77-4e61-b9e0-90bf8ffb59af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:39:42.798946 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519122ab-3d77-4e61-b9e0-90bf8ffb59af admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:39:42.817743 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1388/2784] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:39:42 2022] POST /identity/v3/users => generated 309 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 01:39:42.821900 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02762c23-08ce-4ce4-95e6-43cbab823fe9 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:39:42.832292 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02762c23-08ce-4ce4-95e6-43cbab823fe9 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:39:42.836901 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2acd4e7-d40b-4417-aa52-fa6d2753e414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:39:42.838305 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2acd4e7-d40b-4417-aa52-fa6d2753e414 admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:42.838662 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2acd4e7-d40b-4417-aa52-fa6d2753e414 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:42.838973 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2acd4e7-d40b-4417-aa52-fa6d2753e414 admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:42.839693 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2acd4e7-d40b-4417-aa52-fa6d2753e414 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:39:42.841277 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2acd4e7-d40b-4417-aa52-fa6d2753e414 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:39:42.852437 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1397/2785] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:39:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:39:42.857213 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519122ab-3d77-4e61-b9e0-90bf8ffb59af admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:39:42.866969 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519122ab-3d77-4e61-b9e0-90bf8ffb59af admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:39:42.871910 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7a86d0-b476-4ec2-be5f-5d350f664938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:39:42.872776 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a86d0-b476-4ec2-be5f-5d350f664938 admin admin] REQUEST_METHOD: `PUT` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:42.873057 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a86d0-b476-4ec2-be5f-5d350f664938 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:42.873335 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a86d0-b476-4ec2-be5f-5d350f664938 admin admin] PATH_INFO: `/v3/projects/2e0305fe803f4b1e9d7e14cd18ef6db6/users/2eeeb003f73d4a31b6d39901f0369142/roles/36909bbf31d04993bb2a9fe587b572dc` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:42.887967 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7a86d0-b476-4ec2-be5f-5d350f664938 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e0305fe803f4b1e9d7e14cd18ef6db6, user_id=2eeeb003f73d4a31b6d39901f0369142, role_id=36909bbf31d04993bb2a9fe587b572dc)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:39:42.890607 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7a86d0-b476-4ec2-be5f-5d350f664938 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:39:42.903885 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1389/2786] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:39:42 2022] PUT /identity/v3/projects/2e0305fe803f4b1e9d7e14cd18ef6db6/users/2eeeb003f73d4a31b6d39901f0369142/roles/36909bbf31d04993bb2a9fe587b572dc => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:39:42.908203 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2acd4e7-d40b-4417-aa52-fa6d2753e414 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:39:42.918651 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2acd4e7-d40b-4417-aa52-fa6d2753e414 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:39:42.971827 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e412b52-ecf3-4c43-a99b-075d08950ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:39:42.972482 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e412b52-ecf3-4c43-a99b-075d08950ac7 admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:42.972761 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e412b52-ecf3-4c43-a99b-075d08950ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:42.973031 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e412b52-ecf3-4c43-a99b-075d08950ac7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:42.973737 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e412b52-ecf3-4c43-a99b-075d08950ac7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:39:42.975407 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e412b52-ecf3-4c43-a99b-075d08950ac7 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:39:42.985159 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1398/2787] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:39:42 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:39:42.989296 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7a86d0-b476-4ec2-be5f-5d350f664938 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:39:42.999325 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7a86d0-b476-4ec2-be5f-5d350f664938 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:39:43.003854 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e282f9-a24f-41cf-a2e4-ca0266921a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:39:43.004717 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e282f9-a24f-41cf-a2e4-ca0266921a76 admin admin] REQUEST_METHOD: `PUT` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:43.004996 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e282f9-a24f-41cf-a2e4-ca0266921a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:43.005269 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e282f9-a24f-41cf-a2e4-ca0266921a76 admin admin] PATH_INFO: `/v3/projects/2e0305fe803f4b1e9d7e14cd18ef6db6/users/2eeeb003f73d4a31b6d39901f0369142/roles/36909bbf31d04993bb2a9fe587b572dc` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:43.007240 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e282f9-a24f-41cf-a2e4-ca0266921a76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e0305fe803f4b1e9d7e14cd18ef6db6, user_id=2eeeb003f73d4a31b6d39901f0369142, role_id=36909bbf31d04993bb2a9fe587b572dc)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:39:43.009915 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e282f9-a24f-41cf-a2e4-ca0266921a76 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:39:43.020086 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1390/2788] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:39:42 2022] PUT /identity/v3/projects/2e0305fe803f4b1e9d7e14cd18ef6db6/users/2eeeb003f73d4a31b6d39901f0369142/roles/36909bbf31d04993bb2a9fe587b572dc => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:39:43.030426 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af280fff-993b-4a15-a300-1ba786481053 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:43.030748 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af280fff-993b-4a15-a300-1ba786481053 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:43.031034 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af280fff-993b-4a15-a300-1ba786481053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:43.057313 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-af280fff-993b-4a15-a300-1ba786481053 None None] MFA Rules not processed for user `2eeeb003f73d4a31b6d39901f0369142`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:39:43.058516 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-af280fff-993b-4a15-a300-1ba786481053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:39:43.123790 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1399/2789] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:39:43 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:39:43.134646 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e282f9-a24f-41cf-a2e4-ca0266921a76 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:39:43.136455 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-20e282f9-a24f-41cf-a2e4-ca0266921a76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:39:43.191312 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e282f9-a24f-41cf-a2e4-ca0266921a76 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:39:43.194976 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd493c6-ad24-49ea-a2dd-aedb51413196 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45219f386f0147b6bd380efe4ab62812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:39:43.195610 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd493c6-ad24-49ea-a2dd-aedb51413196 service cinder] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:43.195892 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd493c6-ad24-49ea-a2dd-aedb51413196 service cinder] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:43.196167 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd493c6-ad24-49ea-a2dd-aedb51413196 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:43.207304 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd493c6-ad24-49ea-a2dd-aedb51413196 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:39:43.208720 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd493c6-ad24-49ea-a2dd-aedb51413196 service cinder] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:39:43.218898 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1391/2790] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:39:43 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:39:43.346230 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af280fff-993b-4a15-a300-1ba786481053 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:39:43.405228 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af280fff-993b-4a15-a300-1ba786481053 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:39:43.409975 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8fc9fa-9093-4df0-a498-5db2fc2f971a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:39:43.410867 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8fc9fa-9093-4df0-a498-5db2fc2f971a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:43.411147 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8fc9fa-9093-4df0-a498-5db2fc2f971a admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:43.411421 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8fc9fa-9093-4df0-a498-5db2fc2f971a admin admin] PATH_INFO: `/v3/users/b0d9de80881e4d549d6402c54b664784` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:43.412581 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8fc9fa-9093-4df0-a498-5db2fc2f971a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0d9de80881e4d549d6402c54b664784)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:39:43.414459 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8fc9fa-9093-4df0-a498-5db2fc2f971a admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:39:43.457426 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-dd8fc9fa-9093-4df0-a498-5db2fc2f971a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0d9de80881e4d549d6402c54b664784'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:43.464937 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-dd8fc9fa-9093-4df0-a498-5db2fc2f971a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0d9de80881e4d549d6402c54b664784'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:43.465544 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-dd8fc9fa-9093-4df0-a498-5db2fc2f971a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0d9de80881e4d549d6402c54b664784'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:43.472209 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-dd8fc9fa-9093-4df0-a498-5db2fc2f971a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0d9de80881e4d549d6402c54b664784'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:43.483739 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-dd8fc9fa-9093-4df0-a498-5db2fc2f971a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0d9de80881e4d549d6402c54b664784'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:43.489372 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1400/2791] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:39:43 2022] DELETE /identity/v3/users/b0d9de80881e4d549d6402c54b664784 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:39:43.493985 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e059633-10d5-4a53-8221-1fee485e12b1 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:43.494479 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e059633-10d5-4a53-8221-1fee485e12b1 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:43.494597 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e059633-10d5-4a53-8221-1fee485e12b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:43.512407 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-9e059633-10d5-4a53-8221-1fee485e12b1 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:39:43.513584 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-9e059633-10d5-4a53-8221-1fee485e12b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:39:43.571347 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1392/2792] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:39:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 01:39:43.581966 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8fc9fa-9093-4df0-a498-5db2fc2f971a admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:39:43.583385 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-dd8fc9fa-9093-4df0-a498-5db2fc2f971a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:39:43.640505 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8fc9fa-9093-4df0-a498-5db2fc2f971a admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:39:43.644345 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6605b95-9c3a-4ac5-a901-64588fa9fa7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:39:43.644995 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6605b95-9c3a-4ac5-a901-64588fa9fa7d service neutron] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:43.645261 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6605b95-9c3a-4ac5-a901-64588fa9fa7d service neutron] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:43.645533 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6605b95-9c3a-4ac5-a901-64588fa9fa7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:43.654804 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6605b95-9c3a-4ac5-a901-64588fa9fa7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:39:43.656225 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6605b95-9c3a-4ac5-a901-64588fa9fa7d service neutron] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:39:43.667203 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1401/2793] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:39:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:39:43.928144 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e059633-10d5-4a53-8221-1fee485e12b1 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:39:43.929910 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-9e059633-10d5-4a53-8221-1fee485e12b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:39:43.944405 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e059633-10d5-4a53-8221-1fee485e12b1 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:39:43.950236 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52e3e70-bbda-40d6-ad98-80c6803acdc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:39:43.951067 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e3e70-bbda-40d6-ad98-80c6803acdc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:43.951350 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e3e70-bbda-40d6-ad98-80c6803acdc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:43.951614 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e3e70-bbda-40d6-ad98-80c6803acdc3 admin admin] PATH_INFO: `/v3/projects/7975918319be45ecadcc3aa85c7ed40d` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:43.952911 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52e3e70-bbda-40d6-ad98-80c6803acdc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7975918319be45ecadcc3aa85c7ed40d)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:39:43.954713 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52e3e70-bbda-40d6-ad98-80c6803acdc3 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:39:44.001158 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-b52e3e70-bbda-40d6-ad98-80c6803acdc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7975918319be45ecadcc3aa85c7ed40d', 'request_id': 'req-b52e3e70-bbda-40d6-ad98-80c6803acdc3'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:44.008379 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-b52e3e70-bbda-40d6-ad98-80c6803acdc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7975918319be45ecadcc3aa85c7ed40d', 'request_id': 'req-b52e3e70-bbda-40d6-ad98-80c6803acdc3'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:44.013803 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-b52e3e70-bbda-40d6-ad98-80c6803acdc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7975918319be45ecadcc3aa85c7ed40d', 'request_id': 'req-b52e3e70-bbda-40d6-ad98-80c6803acdc3'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:44.024440 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-b52e3e70-bbda-40d6-ad98-80c6803acdc3 admin admin] The token cache is being invalidate because project 7975918319be45ecadcc3aa85c7ed40d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:39:44.024765 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-b52e3e70-bbda-40d6-ad98-80c6803acdc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:44.025577 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-b52e3e70-bbda-40d6-ad98-80c6803acdc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:44.027218 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1393/2794] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:39:43 2022] DELETE /identity/v3/projects/7975918319be45ecadcc3aa85c7ed40d => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:39:44.031261 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6605b95-9c3a-4ac5-a901-64588fa9fa7d service neutron] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:39:44.041294 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6605b95-9c3a-4ac5-a901-64588fa9fa7d service neutron] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:39:44.094120 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407601bb-cdbf-4d28-83c8-774e532b972d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:39:44.095012 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407601bb-cdbf-4d28-83c8-774e532b972d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:44.095292 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407601bb-cdbf-4d28-83c8-774e532b972d admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:44.095562 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407601bb-cdbf-4d28-83c8-774e532b972d admin admin] PATH_INFO: `/v3/users/2eeeb003f73d4a31b6d39901f0369142` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:44.096719 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407601bb-cdbf-4d28-83c8-774e532b972d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2eeeb003f73d4a31b6d39901f0369142)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:39:44.098609 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407601bb-cdbf-4d28-83c8-774e532b972d admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:39:44.143549 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-407601bb-cdbf-4d28-83c8-774e532b972d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2eeeb003f73d4a31b6d39901f0369142'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:44.150496 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-407601bb-cdbf-4d28-83c8-774e532b972d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2eeeb003f73d4a31b6d39901f0369142'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:44.151144 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-407601bb-cdbf-4d28-83c8-774e532b972d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2eeeb003f73d4a31b6d39901f0369142'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:44.157997 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-407601bb-cdbf-4d28-83c8-774e532b972d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2eeeb003f73d4a31b6d39901f0369142'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:44.169859 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-407601bb-cdbf-4d28-83c8-774e532b972d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2eeeb003f73d4a31b6d39901f0369142'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:44.175577 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1402/2795] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:39:44 2022] DELETE /identity/v3/users/2eeeb003f73d4a31b6d39901f0369142 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:39:44.432611 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52e3e70-bbda-40d6-ad98-80c6803acdc3 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:39:44.434108 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-b52e3e70-bbda-40d6-ad98-80c6803acdc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:39:44.447207 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52e3e70-bbda-40d6-ad98-80c6803acdc3 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:39:44.503182 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e471d4-d400-45ea-a4f3-0b456504a397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:39:44.504043 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e471d4-d400-45ea-a4f3-0b456504a397 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:44.504323 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e471d4-d400-45ea-a4f3-0b456504a397 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:44.504598 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e471d4-d400-45ea-a4f3-0b456504a397 admin admin] PATH_INFO: `/v3/projects/2e0305fe803f4b1e9d7e14cd18ef6db6` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:44.505797 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e471d4-d400-45ea-a4f3-0b456504a397 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e0305fe803f4b1e9d7e14cd18ef6db6)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:39:44.507739 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e471d4-d400-45ea-a4f3-0b456504a397 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:39:44.554802 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-d3e471d4-d400-45ea-a4f3-0b456504a397 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e0305fe803f4b1e9d7e14cd18ef6db6', 'request_id': 'req-d3e471d4-d400-45ea-a4f3-0b456504a397'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:44.562077 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-d3e471d4-d400-45ea-a4f3-0b456504a397 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e0305fe803f4b1e9d7e14cd18ef6db6', 'request_id': 'req-d3e471d4-d400-45ea-a4f3-0b456504a397'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:44.567442 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-d3e471d4-d400-45ea-a4f3-0b456504a397 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e0305fe803f4b1e9d7e14cd18ef6db6', 'request_id': 'req-d3e471d4-d400-45ea-a4f3-0b456504a397'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:44.578149 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-d3e471d4-d400-45ea-a4f3-0b456504a397 admin admin] The token cache is being invalidate because project 2e0305fe803f4b1e9d7e14cd18ef6db6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:39:44.578438 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-d3e471d4-d400-45ea-a4f3-0b456504a397 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:44.579084 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-d3e471d4-d400-45ea-a4f3-0b456504a397 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:44.580625 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1394/2796] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:39:44 2022] DELETE /identity/v3/projects/2e0305fe803f4b1e9d7e14cd18ef6db6 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:39:44.585591 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5537b782-8e7c-485d-a02f-b499912d511e None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:44.585941 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5537b782-8e7c-485d-a02f-b499912d511e None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:44.586225 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5537b782-8e7c-485d-a02f-b499912d511e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:44.605101 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-5537b782-8e7c-485d-a02f-b499912d511e None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:39:44.606314 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-5537b782-8e7c-485d-a02f-b499912d511e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:39:44.666753 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1403/2797] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:39:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:39:44.675693 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba342c8b-3305-4059-8da7-49e72b64cad7 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:44.675988 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba342c8b-3305-4059-8da7-49e72b64cad7 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:44.676271 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba342c8b-3305-4059-8da7-49e72b64cad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:44.695611 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-ba342c8b-3305-4059-8da7-49e72b64cad7 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:39:44.697418 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-ba342c8b-3305-4059-8da7-49e72b64cad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:39:44.705301 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1395/2798] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:39:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:39:44.709496 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5537b782-8e7c-485d-a02f-b499912d511e None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:39:44.719903 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5537b782-8e7c-485d-a02f-b499912d511e None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:39:44.724383 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09054820-7ea5-4b09-bfc7-f1606ab5b37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:39:44.725023 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09054820-7ea5-4b09-bfc7-f1606ab5b37b admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:44.725303 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09054820-7ea5-4b09-bfc7-f1606ab5b37b admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:44.725574 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09054820-7ea5-4b09-bfc7-f1606ab5b37b admin admin] PATH_INFO: `/v3/domains` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:44.726286 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09054820-7ea5-4b09-bfc7-f1606ab5b37b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:39:44.726585 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09054820-7ea5-4b09-bfc7-f1606ab5b37b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:39:44.728797 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09054820-7ea5-4b09-bfc7-f1606ab5b37b admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:39:44.739872 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1404/2799] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Mar 30 01:39:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:39:44.744518 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba342c8b-3305-4059-8da7-49e72b64cad7 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:39:44.753621 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba342c8b-3305-4059-8da7-49e72b64cad7 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:39:44.758538 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e919bf80-1e42-4ca6-b48d-9bc7f1e8428f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:39:44.759220 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e919bf80-1e42-4ca6-b48d-9bc7f1e8428f admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:44.759503 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e919bf80-1e42-4ca6-b48d-9bc7f1e8428f admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:44.759778 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e919bf80-1e42-4ca6-b48d-9bc7f1e8428f admin admin] PATH_INFO: `/v3/projects` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:44.760472 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e919bf80-1e42-4ca6-b48d-9bc7f1e8428f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:39:44.762345 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e919bf80-1e42-4ca6-b48d-9bc7f1e8428f admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:39:44.787863 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1396/2800] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:39:44 2022] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:39:44.793091 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09054820-7ea5-4b09-bfc7-f1606ab5b37b admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:39:44.802795 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09054820-7ea5-4b09-bfc7-f1606ab5b37b admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:39:44.858207 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0cd062-ca8f-4ec9-b8d6-e37ca88d439e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:39:44.858825 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0cd062-ca8f-4ec9-b8d6-e37ca88d439e admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:44.859113 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0cd062-ca8f-4ec9-b8d6-e37ca88d439e admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:44.859391 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0cd062-ca8f-4ec9-b8d6-e37ca88d439e admin admin] PATH_INFO: `/v3/users` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:44.860072 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0cd062-ca8f-4ec9-b8d6-e37ca88d439e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:39:44.861992 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0cd062-ca8f-4ec9-b8d6-e37ca88d439e admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:39:44.883144 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1405/2801] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:39:44 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:39:44.887273 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e919bf80-1e42-4ca6-b48d-9bc7f1e8428f admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:39:44.897638 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e919bf80-1e42-4ca6-b48d-9bc7f1e8428f admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:39:44.903030 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c2c241-c10f-4e17-a761-2cc0ad898dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:39:44.903687 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c2c241-c10f-4e17-a761-2cc0ad898dd5 admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:44.903973 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c2c241-c10f-4e17-a761-2cc0ad898dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:44.904255 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c2c241-c10f-4e17-a761-2cc0ad898dd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:44.904982 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c2c241-c10f-4e17-a761-2cc0ad898dd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:39:44.906844 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c2c241-c10f-4e17-a761-2cc0ad898dd5 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:39:44.917567 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1397/2802] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:39:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:39:44.921604 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0cd062-ca8f-4ec9-b8d6-e37ca88d439e admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:39:44.932468 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0cd062-ca8f-4ec9-b8d6-e37ca88d439e admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:39:44.937084 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ced67c-c9b0-49cc-b2fa-4f84aea4370d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:39:44.937727 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ced67c-c9b0-49cc-b2fa-4f84aea4370d admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:44.938008 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ced67c-c9b0-49cc-b2fa-4f84aea4370d admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:44.938284 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ced67c-c9b0-49cc-b2fa-4f84aea4370d admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:44.939046 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ced67c-c9b0-49cc-b2fa-4f84aea4370d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:39:44.940635 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ced67c-c9b0-49cc-b2fa-4f84aea4370d admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:39:44.950676 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1406/2803] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:39:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:39:44.954622 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c2c241-c10f-4e17-a761-2cc0ad898dd5 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:39:44.964602 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c2c241-c10f-4e17-a761-2cc0ad898dd5 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:39:44.969218 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665351dc-9993-44de-ba4e-5c6ed298772b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:39:44.970079 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665351dc-9993-44de-ba4e-5c6ed298772b admin admin] REQUEST_METHOD: `PUT` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:44.970357 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665351dc-9993-44de-ba4e-5c6ed298772b admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:44.970632 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665351dc-9993-44de-ba4e-5c6ed298772b admin admin] PATH_INFO: `/v3/projects/fb0192c831c04f5497f566a121255d8d/users/5b7309060e374c12a2369cd16fdf6fcc/roles/7185d0cfbcd44502b1613bcfe1b42f6f` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:44.985515 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665351dc-9993-44de-ba4e-5c6ed298772b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb0192c831c04f5497f566a121255d8d, user_id=5b7309060e374c12a2369cd16fdf6fcc, role_id=7185d0cfbcd44502b1613bcfe1b42f6f)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:39:44.988187 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665351dc-9993-44de-ba4e-5c6ed298772b admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:39:45.001167 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1398/2804] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:39:44 2022] PUT /identity/v3/projects/fb0192c831c04f5497f566a121255d8d/users/5b7309060e374c12a2369cd16fdf6fcc/roles/7185d0cfbcd44502b1613bcfe1b42f6f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:39:45.011310 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa524aae-e16d-4862-b3da-eacc3831cafc None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:45.011603 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa524aae-e16d-4862-b3da-eacc3831cafc None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:45.011883 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa524aae-e16d-4862-b3da-eacc3831cafc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:45.038614 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-aa524aae-e16d-4862-b3da-eacc3831cafc None None] MFA Rules not processed for user `5b7309060e374c12a2369cd16fdf6fcc`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:39:45.039821 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-aa524aae-e16d-4862-b3da-eacc3831cafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:39:45.104040 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1407/2805] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:39:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:39:45.108549 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665351dc-9993-44de-ba4e-5c6ed298772b admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:39:45.170524 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665351dc-9993-44de-ba4e-5c6ed298772b admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:39:45.175241 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c272f9-a880-46dd-953d-f4dc54957984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:39:45.175904 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c272f9-a880-46dd-953d-f4dc54957984 admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:45.176191 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c272f9-a880-46dd-953d-f4dc54957984 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:45.176468 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c272f9-a880-46dd-953d-f4dc54957984 admin admin] PATH_INFO: `/v3/projects` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:45.177170 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c272f9-a880-46dd-953d-f4dc54957984 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:39:45.179146 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c272f9-a880-46dd-953d-f4dc54957984 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:39:45.206788 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1399/2806] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:39:45 2022] POST /identity/v3/projects => generated 379 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 01:39:45.210743 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa524aae-e16d-4862-b3da-eacc3831cafc None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:39:45.221772 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa524aae-e16d-4862-b3da-eacc3831cafc None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:39:45.274046 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ffdf4-47f8-439c-8bbe-b7cdcb403249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:39:45.275226 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ffdf4-47f8-439c-8bbe-b7cdcb403249 admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:45.275544 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ffdf4-47f8-439c-8bbe-b7cdcb403249 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:45.275818 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ffdf4-47f8-439c-8bbe-b7cdcb403249 admin admin] PATH_INFO: `/v3/users` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:45.276489 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81ffdf4-47f8-439c-8bbe-b7cdcb403249 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:39:45.278380 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81ffdf4-47f8-439c-8bbe-b7cdcb403249 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:39:45.297105 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1408/2807] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:39:45 2022] POST /identity/v3/users => generated 290 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:39:45.301113 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c272f9-a880-46dd-953d-f4dc54957984 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:39:45.311340 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c272f9-a880-46dd-953d-f4dc54957984 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:39:45.315952 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9189a9d9-312b-4879-b2e9-5382b8fa39f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:39:45.316627 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189a9d9-312b-4879-b2e9-5382b8fa39f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:45.316908 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189a9d9-312b-4879-b2e9-5382b8fa39f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:45.317182 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189a9d9-312b-4879-b2e9-5382b8fa39f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:45.317903 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9189a9d9-312b-4879-b2e9-5382b8fa39f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:39:45.319527 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9189a9d9-312b-4879-b2e9-5382b8fa39f5 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:39:45.329833 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1400/2808] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:39:45.333822 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ffdf4-47f8-439c-8bbe-b7cdcb403249 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:39:45.344042 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ffdf4-47f8-439c-8bbe-b7cdcb403249 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:39:45.348760 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74219a0b-e711-461c-9726-9f9270888f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:39:45.349417 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74219a0b-e711-461c-9726-9f9270888f81 admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:45.349701 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74219a0b-e711-461c-9726-9f9270888f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:45.349977 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74219a0b-e711-461c-9726-9f9270888f81 admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:45.350718 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74219a0b-e711-461c-9726-9f9270888f81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:39:45.352345 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74219a0b-e711-461c-9726-9f9270888f81 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:39:45.362998 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1409/2809] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:39:45.367003 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9189a9d9-312b-4879-b2e9-5382b8fa39f5 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:39:45.376646 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9189a9d9-312b-4879-b2e9-5382b8fa39f5 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:39:45.381157 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8377dc77-063f-4bc5-a331-a5e056b3a471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:39:45.382017 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8377dc77-063f-4bc5-a331-a5e056b3a471 admin admin] REQUEST_METHOD: `PUT` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:45.382291 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8377dc77-063f-4bc5-a331-a5e056b3a471 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:45.382558 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8377dc77-063f-4bc5-a331-a5e056b3a471 admin admin] PATH_INFO: `/v3/projects/b9d5edf0f3d54e28b6aee5e635f5a12b/users/caafe26395cf4cbcb24a4b480b4c6d48/roles/7185d0cfbcd44502b1613bcfe1b42f6f` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:45.396812 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8377dc77-063f-4bc5-a331-a5e056b3a471 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9d5edf0f3d54e28b6aee5e635f5a12b, user_id=caafe26395cf4cbcb24a4b480b4c6d48, role_id=7185d0cfbcd44502b1613bcfe1b42f6f)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:39:45.399467 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8377dc77-063f-4bc5-a331-a5e056b3a471 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:39:45.412760 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1401/2810] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:39:45 2022] PUT /identity/v3/projects/b9d5edf0f3d54e28b6aee5e635f5a12b/users/caafe26395cf4cbcb24a4b480b4c6d48/roles/7185d0cfbcd44502b1613bcfe1b42f6f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:39:45.423015 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e28ec34-fec3-48b1-bb73-589d91d114bd None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:45.423307 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e28ec34-fec3-48b1-bb73-589d91d114bd None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:45.423589 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e28ec34-fec3-48b1-bb73-589d91d114bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:45.449918 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-9e28ec34-fec3-48b1-bb73-589d91d114bd None None] MFA Rules not processed for user `caafe26395cf4cbcb24a4b480b4c6d48`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:39:45.451158 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-9e28ec34-fec3-48b1-bb73-589d91d114bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:39:45.512266 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1410/2811] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:39:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:39:45.516825 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8377dc77-063f-4bc5-a331-a5e056b3a471 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:39:45.576724 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8377dc77-063f-4bc5-a331-a5e056b3a471 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:39:45.581358 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b642cb-ca2e-486b-97fe-df2259ec7499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:39:45.581997 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b642cb-ca2e-486b-97fe-df2259ec7499 admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:45.582276 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b642cb-ca2e-486b-97fe-df2259ec7499 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:45.582545 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b642cb-ca2e-486b-97fe-df2259ec7499 admin admin] PATH_INFO: `/v3/projects` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:45.583259 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b642cb-ca2e-486b-97fe-df2259ec7499 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:39:45.585128 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b642cb-ca2e-486b-97fe-df2259ec7499 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:39:45.609362 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1402/2812] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:39:45 2022] POST /identity/v3/projects => generated 377 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:39:45.613392 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e28ec34-fec3-48b1-bb73-589d91d114bd None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:39:45.624855 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e28ec34-fec3-48b1-bb73-589d91d114bd None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:39:45.679312 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95aff3f-5751-4198-b39a-b5722b3c8861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:39:45.679974 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95aff3f-5751-4198-b39a-b5722b3c8861 admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:45.680246 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95aff3f-5751-4198-b39a-b5722b3c8861 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:45.680520 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95aff3f-5751-4198-b39a-b5722b3c8861 admin admin] PATH_INFO: `/v3/users` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:45.681861 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95aff3f-5751-4198-b39a-b5722b3c8861 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:39:45.683895 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95aff3f-5751-4198-b39a-b5722b3c8861 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:39:45.702526 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1411/2813] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:39:45 2022] POST /identity/v3/users => generated 295 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:39:45.706446 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b642cb-ca2e-486b-97fe-df2259ec7499 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:39:45.716751 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b642cb-ca2e-486b-97fe-df2259ec7499 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:39:45.721365 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b6803-78a8-4efd-afa9-cb5a24ea6c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:39:45.722015 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b6803-78a8-4efd-afa9-cb5a24ea6c71 admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:45.722296 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b6803-78a8-4efd-afa9-cb5a24ea6c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:45.722571 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b6803-78a8-4efd-afa9-cb5a24ea6c71 admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:45.723331 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178b6803-78a8-4efd-afa9-cb5a24ea6c71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:39:45.724908 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178b6803-78a8-4efd-afa9-cb5a24ea6c71 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:39:45.735853 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1403/2814] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:39:45.739915 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95aff3f-5751-4198-b39a-b5722b3c8861 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:39:45.750228 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95aff3f-5751-4198-b39a-b5722b3c8861 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:39:45.754912 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499a1902-759b-4e82-a293-b0d17b86833b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:39:45.755777 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a1902-759b-4e82-a293-b0d17b86833b admin admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:45.756059 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a1902-759b-4e82-a293-b0d17b86833b admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:45.756333 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a1902-759b-4e82-a293-b0d17b86833b admin admin] PATH_INFO: `/v3/projects/399f9196a6ff4ffb9e5b6e31dbfa08bc/users/a0a4a0ee18f540e69490b0fbbdf63138/roles/36909bbf31d04993bb2a9fe587b572dc` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:45.771090 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499a1902-759b-4e82-a293-b0d17b86833b admin admin] RBAC: Authorizing `identity:create_grant(project_id=399f9196a6ff4ffb9e5b6e31dbfa08bc, user_id=a0a4a0ee18f540e69490b0fbbdf63138, role_id=36909bbf31d04993bb2a9fe587b572dc)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:39:45.773709 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499a1902-759b-4e82-a293-b0d17b86833b admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:39:45.787347 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1412/2815] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:39:45 2022] PUT /identity/v3/projects/399f9196a6ff4ffb9e5b6e31dbfa08bc/users/a0a4a0ee18f540e69490b0fbbdf63138/roles/36909bbf31d04993bb2a9fe587b572dc => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:39:45.791834 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b6803-78a8-4efd-afa9-cb5a24ea6c71 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:39:45.801482 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b6803-78a8-4efd-afa9-cb5a24ea6c71 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:39:45.857015 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7461a6cb-f079-4df3-b8cc-ea7d567a3654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:39:45.857664 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7461a6cb-f079-4df3-b8cc-ea7d567a3654 admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:45.857962 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7461a6cb-f079-4df3-b8cc-ea7d567a3654 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:45.858218 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7461a6cb-f079-4df3-b8cc-ea7d567a3654 admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:45.858962 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7461a6cb-f079-4df3-b8cc-ea7d567a3654 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:39:45.860537 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7461a6cb-f079-4df3-b8cc-ea7d567a3654 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:39:45.870471 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1404/2816] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:39:45.874451 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499a1902-759b-4e82-a293-b0d17b86833b admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:39:45.885721 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499a1902-759b-4e82-a293-b0d17b86833b admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:39:45.890428 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa1f463-14a2-4937-ba20-f0ed37ecfb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:39:45.891335 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa1f463-14a2-4937-ba20-f0ed37ecfb35 admin admin] REQUEST_METHOD: `PUT` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:45.891623 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa1f463-14a2-4937-ba20-f0ed37ecfb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:45.891902 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa1f463-14a2-4937-ba20-f0ed37ecfb35 admin admin] PATH_INFO: `/v3/projects/399f9196a6ff4ffb9e5b6e31dbfa08bc/users/a0a4a0ee18f540e69490b0fbbdf63138/roles/36909bbf31d04993bb2a9fe587b572dc` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:45.893868 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa1f463-14a2-4937-ba20-f0ed37ecfb35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=399f9196a6ff4ffb9e5b6e31dbfa08bc, user_id=a0a4a0ee18f540e69490b0fbbdf63138, role_id=36909bbf31d04993bb2a9fe587b572dc)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:39:45.896634 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa1f463-14a2-4937-ba20-f0ed37ecfb35 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:39:45.908747 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1413/2817] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:39:45 2022] PUT /identity/v3/projects/399f9196a6ff4ffb9e5b6e31dbfa08bc/users/a0a4a0ee18f540e69490b0fbbdf63138/roles/36909bbf31d04993bb2a9fe587b572dc => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:39:45.919689 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb935e-c296-4f60-adf8-c1e18fab00d9 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:45.919976 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb935e-c296-4f60-adf8-c1e18fab00d9 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:45.920251 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb935e-c296-4f60-adf8-c1e18fab00d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:45.948802 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-42bb935e-c296-4f60-adf8-c1e18fab00d9 None None] MFA Rules not processed for user `a0a4a0ee18f540e69490b0fbbdf63138`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:39:45.950015 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-42bb935e-c296-4f60-adf8-c1e18fab00d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:39:46.015313 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1405/2818] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:39:45 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:39:46.026360 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa1f463-14a2-4937-ba20-f0ed37ecfb35 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:39:46.028057 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-ffa1f463-14a2-4937-ba20-f0ed37ecfb35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:39:46.083761 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa1f463-14a2-4937-ba20-f0ed37ecfb35 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:39:46.087498 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44698f5-ee28-449d-aae7-ebd22a171d8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45219f386f0147b6bd380efe4ab62812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:39:46.088131 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44698f5-ee28-449d-aae7-ebd22a171d8a service cinder] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:46.088414 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44698f5-ee28-449d-aae7-ebd22a171d8a service cinder] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:46.088691 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44698f5-ee28-449d-aae7-ebd22a171d8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:46.097572 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44698f5-ee28-449d-aae7-ebd22a171d8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:39:46.099084 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44698f5-ee28-449d-aae7-ebd22a171d8a service cinder] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:39:46.108451 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1414/2819] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:39:46 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:39:46.150316 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bb935e-c296-4f60-adf8-c1e18fab00d9 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:39:46.151743 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-42bb935e-c296-4f60-adf8-c1e18fab00d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:39:46.164112 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bb935e-c296-4f60-adf8-c1e18fab00d9 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:39:46.168305 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97abf81c-3d6d-42bd-8144-7bce964ea9cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45219f386f0147b6bd380efe4ab62812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:39:46.168970 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97abf81c-3d6d-42bd-8144-7bce964ea9cd service cinder] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:46.169255 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97abf81c-3d6d-42bd-8144-7bce964ea9cd service cinder] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:46.169537 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97abf81c-3d6d-42bd-8144-7bce964ea9cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:46.224184 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97abf81c-3d6d-42bd-8144-7bce964ea9cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:39:46.225604 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97abf81c-3d6d-42bd-8144-7bce964ea9cd service cinder] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:39:46.234891 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1406/2820] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:39:46 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:39:49.038321 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44698f5-ee28-449d-aae7-ebd22a171d8a service cinder] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:39:49.098999 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44698f5-ee28-449d-aae7-ebd22a171d8a service cinder] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:39:49.104427 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f566ce-6e2d-4864-93ed-0b0d5f9cca12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:39:49.105314 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f566ce-6e2d-4864-93ed-0b0d5f9cca12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:49.105600 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f566ce-6e2d-4864-93ed-0b0d5f9cca12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:49.105878 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f566ce-6e2d-4864-93ed-0b0d5f9cca12 admin admin] PATH_INFO: `/v3/users/5b7309060e374c12a2369cd16fdf6fcc` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:49.107098 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f566ce-6e2d-4864-93ed-0b0d5f9cca12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b7309060e374c12a2369cd16fdf6fcc)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:39:49.109011 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f566ce-6e2d-4864-93ed-0b0d5f9cca12 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:39:49.153907 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-f4f566ce-6e2d-4864-93ed-0b0d5f9cca12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b7309060e374c12a2369cd16fdf6fcc'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:49.161383 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-f4f566ce-6e2d-4864-93ed-0b0d5f9cca12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b7309060e374c12a2369cd16fdf6fcc'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:49.162000 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-f4f566ce-6e2d-4864-93ed-0b0d5f9cca12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b7309060e374c12a2369cd16fdf6fcc'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:49.168823 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-f4f566ce-6e2d-4864-93ed-0b0d5f9cca12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b7309060e374c12a2369cd16fdf6fcc'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:49.180282 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-f4f566ce-6e2d-4864-93ed-0b0d5f9cca12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b7309060e374c12a2369cd16fdf6fcc'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:49.186346 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1415/2821] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:39:49 2022] DELETE /identity/v3/users/5b7309060e374c12a2369cd16fdf6fcc => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:39:49.191183 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a5604-6720-4e56-a666-73b5d8e13048 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:49.191699 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a5604-6720-4e56-a666-73b5d8e13048 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:49.191817 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a5604-6720-4e56-a666-73b5d8e13048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:49.210632 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-ab0a5604-6720-4e56-a666-73b5d8e13048 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:39:49.211805 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-ab0a5604-6720-4e56-a666-73b5d8e13048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:39:49.268988 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1407/2822] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:39:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:39:49.278922 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f566ce-6e2d-4864-93ed-0b0d5f9cca12 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:39:49.280346 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-f4f566ce-6e2d-4864-93ed-0b0d5f9cca12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:39:49.335263 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f566ce-6e2d-4864-93ed-0b0d5f9cca12 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:39:49.339651 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aff395-a6f7-46de-ada5-e113103e72f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:39:49.340381 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aff395-a6f7-46de-ada5-e113103e72f1 service neutron] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:49.340660 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aff395-a6f7-46de-ada5-e113103e72f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:49.340935 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aff395-a6f7-46de-ada5-e113103e72f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:49.349829 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aff395-a6f7-46de-ada5-e113103e72f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:39:49.351288 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aff395-a6f7-46de-ada5-e113103e72f1 service neutron] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:39:49.360465 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1416/2823] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:39:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:39:49.615685 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0a5604-6720-4e56-a666-73b5d8e13048 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:39:49.617779 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-ab0a5604-6720-4e56-a666-73b5d8e13048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:39:49.630989 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0a5604-6720-4e56-a666-73b5d8e13048 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:39:49.636819 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc563e83-4415-4fa1-b71a-c4dca6fb27c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:39:49.637713 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc563e83-4415-4fa1-b71a-c4dca6fb27c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:49.637994 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc563e83-4415-4fa1-b71a-c4dca6fb27c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:49.638264 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc563e83-4415-4fa1-b71a-c4dca6fb27c4 admin admin] PATH_INFO: `/v3/projects/fb0192c831c04f5497f566a121255d8d` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:49.639477 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc563e83-4415-4fa1-b71a-c4dca6fb27c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb0192c831c04f5497f566a121255d8d)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:39:49.641484 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc563e83-4415-4fa1-b71a-c4dca6fb27c4 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:39:49.688992 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-bc563e83-4415-4fa1-b71a-c4dca6fb27c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb0192c831c04f5497f566a121255d8d', 'request_id': 'req-bc563e83-4415-4fa1-b71a-c4dca6fb27c4'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:49.695986 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-bc563e83-4415-4fa1-b71a-c4dca6fb27c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb0192c831c04f5497f566a121255d8d', 'request_id': 'req-bc563e83-4415-4fa1-b71a-c4dca6fb27c4'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:49.702023 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-bc563e83-4415-4fa1-b71a-c4dca6fb27c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb0192c831c04f5497f566a121255d8d', 'request_id': 'req-bc563e83-4415-4fa1-b71a-c4dca6fb27c4'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:49.712825 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-bc563e83-4415-4fa1-b71a-c4dca6fb27c4 admin admin] The token cache is being invalidate because project fb0192c831c04f5497f566a121255d8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:39:49.713115 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-bc563e83-4415-4fa1-b71a-c4dca6fb27c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:49.713743 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-bc563e83-4415-4fa1-b71a-c4dca6fb27c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:49.715305 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1408/2824] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:39:49 2022] DELETE /identity/v3/projects/fb0192c831c04f5497f566a121255d8d => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:39:49.719300 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aff395-a6f7-46de-ada5-e113103e72f1 service neutron] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:39:49.728665 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aff395-a6f7-46de-ada5-e113103e72f1 service neutron] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:39:49.783468 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a1d1b-2bdc-4d9b-86ad-52d6f9176d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:39:49.784253 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a1d1b-2bdc-4d9b-86ad-52d6f9176d9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:49.784527 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a1d1b-2bdc-4d9b-86ad-52d6f9176d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:49.784796 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a1d1b-2bdc-4d9b-86ad-52d6f9176d9c admin admin] PATH_INFO: `/v3/users/caafe26395cf4cbcb24a4b480b4c6d48` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:49.785949 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226a1d1b-2bdc-4d9b-86ad-52d6f9176d9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=caafe26395cf4cbcb24a4b480b4c6d48)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:39:49.787887 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226a1d1b-2bdc-4d9b-86ad-52d6f9176d9c admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:39:49.831881 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-226a1d1b-2bdc-4d9b-86ad-52d6f9176d9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'caafe26395cf4cbcb24a4b480b4c6d48'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:49.839356 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-226a1d1b-2bdc-4d9b-86ad-52d6f9176d9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'caafe26395cf4cbcb24a4b480b4c6d48'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:49.839979 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-226a1d1b-2bdc-4d9b-86ad-52d6f9176d9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'caafe26395cf4cbcb24a4b480b4c6d48'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:49.846645 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-226a1d1b-2bdc-4d9b-86ad-52d6f9176d9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'caafe26395cf4cbcb24a4b480b4c6d48'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:49.857946 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-226a1d1b-2bdc-4d9b-86ad-52d6f9176d9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'caafe26395cf4cbcb24a4b480b4c6d48'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:49.863589 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1417/2825] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:39:49 2022] DELETE /identity/v3/users/caafe26395cf4cbcb24a4b480b4c6d48 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:39:50.128577 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc563e83-4415-4fa1-b71a-c4dca6fb27c4 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:39:50.130041 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-bc563e83-4415-4fa1-b71a-c4dca6fb27c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:39:50.143232 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc563e83-4415-4fa1-b71a-c4dca6fb27c4 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:39:50.206069 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d696cd9a-bb34-4a6f-b378-486537f0d069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:39:50.206946 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d696cd9a-bb34-4a6f-b378-486537f0d069 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:50.207230 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d696cd9a-bb34-4a6f-b378-486537f0d069 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:50.207503 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d696cd9a-bb34-4a6f-b378-486537f0d069 admin admin] PATH_INFO: `/v3/projects/b9d5edf0f3d54e28b6aee5e635f5a12b` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:50.208685 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d696cd9a-bb34-4a6f-b378-486537f0d069 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9d5edf0f3d54e28b6aee5e635f5a12b)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:39:50.210578 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d696cd9a-bb34-4a6f-b378-486537f0d069 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:39:50.254620 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-d696cd9a-bb34-4a6f-b378-486537f0d069 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9d5edf0f3d54e28b6aee5e635f5a12b', 'request_id': 'req-d696cd9a-bb34-4a6f-b378-486537f0d069'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:50.262078 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-d696cd9a-bb34-4a6f-b378-486537f0d069 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9d5edf0f3d54e28b6aee5e635f5a12b', 'request_id': 'req-d696cd9a-bb34-4a6f-b378-486537f0d069'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:50.267412 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-d696cd9a-bb34-4a6f-b378-486537f0d069 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9d5edf0f3d54e28b6aee5e635f5a12b', 'request_id': 'req-d696cd9a-bb34-4a6f-b378-486537f0d069'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:50.280097 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-d696cd9a-bb34-4a6f-b378-486537f0d069 admin admin] The token cache is being invalidate because project b9d5edf0f3d54e28b6aee5e635f5a12b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:39:50.280422 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-d696cd9a-bb34-4a6f-b378-486537f0d069 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:50.281092 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-d696cd9a-bb34-4a6f-b378-486537f0d069 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:50.282934 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1409/2826] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:39:50 2022] DELETE /identity/v3/projects/b9d5edf0f3d54e28b6aee5e635f5a12b => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:39:50.287027 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a1d1b-2bdc-4d9b-86ad-52d6f9176d9c admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:39:50.288784 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-226a1d1b-2bdc-4d9b-86ad-52d6f9176d9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:39:50.301989 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a1d1b-2bdc-4d9b-86ad-52d6f9176d9c admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:39:50.358862 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dee7e7-9f2b-44f4-89c4-8f2743a9d365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:39:50.359730 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dee7e7-9f2b-44f4-89c4-8f2743a9d365 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:50.360007 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dee7e7-9f2b-44f4-89c4-8f2743a9d365 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:50.360277 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dee7e7-9f2b-44f4-89c4-8f2743a9d365 admin admin] PATH_INFO: `/v3/users/a0a4a0ee18f540e69490b0fbbdf63138` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:50.361444 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dee7e7-9f2b-44f4-89c4-8f2743a9d365 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0a4a0ee18f540e69490b0fbbdf63138)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:39:50.363394 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dee7e7-9f2b-44f4-89c4-8f2743a9d365 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:39:50.408294 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-e3dee7e7-9f2b-44f4-89c4-8f2743a9d365 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0a4a0ee18f540e69490b0fbbdf63138'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:50.415116 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-e3dee7e7-9f2b-44f4-89c4-8f2743a9d365 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0a4a0ee18f540e69490b0fbbdf63138'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:50.415903 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-e3dee7e7-9f2b-44f4-89c4-8f2743a9d365 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0a4a0ee18f540e69490b0fbbdf63138'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:50.422903 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-e3dee7e7-9f2b-44f4-89c4-8f2743a9d365 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0a4a0ee18f540e69490b0fbbdf63138'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:50.434664 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-e3dee7e7-9f2b-44f4-89c4-8f2743a9d365 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0a4a0ee18f540e69490b0fbbdf63138'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:50.440583 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1418/2827] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:39:50 2022] DELETE /identity/v3/users/a0a4a0ee18f540e69490b0fbbdf63138 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:39:50.704005 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d696cd9a-bb34-4a6f-b378-486537f0d069 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:39:50.705477 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-d696cd9a-bb34-4a6f-b378-486537f0d069 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:39:50.721657 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d696cd9a-bb34-4a6f-b378-486537f0d069 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:39:50.777574 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77e8f15-4f3c-43d4-ac23-715f733921bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:39:50.778462 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e8f15-4f3c-43d4-ac23-715f733921bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:50.778778 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e8f15-4f3c-43d4-ac23-715f733921bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:50.779060 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e8f15-4f3c-43d4-ac23-715f733921bd admin admin] PATH_INFO: `/v3/projects/399f9196a6ff4ffb9e5b6e31dbfa08bc` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:50.780263 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77e8f15-4f3c-43d4-ac23-715f733921bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=399f9196a6ff4ffb9e5b6e31dbfa08bc)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:39:50.782426 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77e8f15-4f3c-43d4-ac23-715f733921bd admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:39:50.828255 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-b77e8f15-4f3c-43d4-ac23-715f733921bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '399f9196a6ff4ffb9e5b6e31dbfa08bc', 'request_id': 'req-b77e8f15-4f3c-43d4-ac23-715f733921bd'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:50.835306 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-b77e8f15-4f3c-43d4-ac23-715f733921bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '399f9196a6ff4ffb9e5b6e31dbfa08bc', 'request_id': 'req-b77e8f15-4f3c-43d4-ac23-715f733921bd'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:50.840642 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-b77e8f15-4f3c-43d4-ac23-715f733921bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '399f9196a6ff4ffb9e5b6e31dbfa08bc', 'request_id': 'req-b77e8f15-4f3c-43d4-ac23-715f733921bd'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:50.851249 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-b77e8f15-4f3c-43d4-ac23-715f733921bd admin admin] The token cache is being invalidate because project 399f9196a6ff4ffb9e5b6e31dbfa08bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:39:50.851534 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-b77e8f15-4f3c-43d4-ac23-715f733921bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:50.852157 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-b77e8f15-4f3c-43d4-ac23-715f733921bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:50.854166 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1410/2828] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:39:50 2022] DELETE /identity/v3/projects/399f9196a6ff4ffb9e5b6e31dbfa08bc => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:39:50.860221 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c85bd-daf1-4c2b-b8ed-6888bc6870d4 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:50.860513 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c85bd-daf1-4c2b-b8ed-6888bc6870d4 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:50.860792 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c85bd-daf1-4c2b-b8ed-6888bc6870d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:50.878340 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-d88c85bd-daf1-4c2b-b8ed-6888bc6870d4 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:39:50.879501 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-d88c85bd-daf1-4c2b-b8ed-6888bc6870d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:39:50.939780 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1419/2829] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:39:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:39:50.948721 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4177a831-2cbc-4771-8d73-88b29e72d3d2 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:50.949010 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4177a831-2cbc-4771-8d73-88b29e72d3d2 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:50.949292 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4177a831-2cbc-4771-8d73-88b29e72d3d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:50.968179 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-4177a831-2cbc-4771-8d73-88b29e72d3d2 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:39:50.969387 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-4177a831-2cbc-4771-8d73-88b29e72d3d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:39:50.979418 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1411/2830] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:39:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:39:50.983611 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c85bd-daf1-4c2b-b8ed-6888bc6870d4 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:39:50.993263 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c85bd-daf1-4c2b-b8ed-6888bc6870d4 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:39:50.998652 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba46f392-478f-4b08-8908-9ebf130f937c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:39:50.999341 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba46f392-478f-4b08-8908-9ebf130f937c admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:50.999622 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba46f392-478f-4b08-8908-9ebf130f937c admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:50.999924 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba46f392-478f-4b08-8908-9ebf130f937c admin admin] PATH_INFO: `/v3/domains` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:51.000646 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba46f392-478f-4b08-8908-9ebf130f937c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:39:51.000952 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba46f392-478f-4b08-8908-9ebf130f937c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:39:51.002541 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba46f392-478f-4b08-8908-9ebf130f937c admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:39:51.013765 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1420/2831] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Mar 30 01:39:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:39:51.017979 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4177a831-2cbc-4771-8d73-88b29e72d3d2 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:39:51.027627 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4177a831-2cbc-4771-8d73-88b29e72d3d2 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:39:51.032571 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d18cb3-2a36-487f-ae79-e2c7f7568cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:39:51.033218 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d18cb3-2a36-487f-ae79-e2c7f7568cc1 admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:51.033506 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d18cb3-2a36-487f-ae79-e2c7f7568cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:51.033787 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d18cb3-2a36-487f-ae79-e2c7f7568cc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:51.034476 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d18cb3-2a36-487f-ae79-e2c7f7568cc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:39:51.036403 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d18cb3-2a36-487f-ae79-e2c7f7568cc1 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:39:51.062179 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1412/2832] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:39:51 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:39:51.066618 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba46f392-478f-4b08-8908-9ebf130f937c admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:39:51.076847 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba46f392-478f-4b08-8908-9ebf130f937c admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:39:51.133892 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0479a367-dc33-436f-b587-dd89472176a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:39:51.134546 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0479a367-dc33-436f-b587-dd89472176a8 admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:51.134869 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0479a367-dc33-436f-b587-dd89472176a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:51.135150 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0479a367-dc33-436f-b587-dd89472176a8 admin admin] PATH_INFO: `/v3/users` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:51.135826 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0479a367-dc33-436f-b587-dd89472176a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:39:51.137730 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0479a367-dc33-436f-b587-dd89472176a8 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:39:51.157319 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1421/2833] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:39:51 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:39:51.161560 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d18cb3-2a36-487f-ae79-e2c7f7568cc1 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:39:51.172422 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d18cb3-2a36-487f-ae79-e2c7f7568cc1 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:39:51.176980 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9756ba93-1344-4cf3-8b44-71bbc9eb8148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:39:51.177624 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9756ba93-1344-4cf3-8b44-71bbc9eb8148 admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:51.177905 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9756ba93-1344-4cf3-8b44-71bbc9eb8148 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:51.178337 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9756ba93-1344-4cf3-8b44-71bbc9eb8148 admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:51.179086 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9756ba93-1344-4cf3-8b44-71bbc9eb8148 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:39:51.180658 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9756ba93-1344-4cf3-8b44-71bbc9eb8148 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:39:51.190789 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1413/2834] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:39:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:39:51.194496 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0479a367-dc33-436f-b587-dd89472176a8 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:39:51.204437 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0479a367-dc33-436f-b587-dd89472176a8 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:39:51.209050 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6bcf47-5502-4470-9807-876c43f41677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:39:51.209730 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6bcf47-5502-4470-9807-876c43f41677 admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:51.210017 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6bcf47-5502-4470-9807-876c43f41677 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:51.210299 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6bcf47-5502-4470-9807-876c43f41677 admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:51.211089 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6bcf47-5502-4470-9807-876c43f41677 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:39:51.213239 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6bcf47-5502-4470-9807-876c43f41677 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:39:51.223032 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1422/2835] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:39:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:39:51.227019 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9756ba93-1344-4cf3-8b44-71bbc9eb8148 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:39:51.237088 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9756ba93-1344-4cf3-8b44-71bbc9eb8148 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:39:51.242175 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203bf252-e8cc-426c-919b-5f8303a740b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:39:51.243086 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203bf252-e8cc-426c-919b-5f8303a740b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:51.243375 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203bf252-e8cc-426c-919b-5f8303a740b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:51.244195 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203bf252-e8cc-426c-919b-5f8303a740b0 admin admin] PATH_INFO: `/v3/projects/56e291db07044694afffa3c66ae39ec5/users/a819d0070de042bfadccd2d1eac800b1/roles/7185d0cfbcd44502b1613bcfe1b42f6f` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:51.258942 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203bf252-e8cc-426c-919b-5f8303a740b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56e291db07044694afffa3c66ae39ec5, user_id=a819d0070de042bfadccd2d1eac800b1, role_id=7185d0cfbcd44502b1613bcfe1b42f6f)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:39:51.262139 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203bf252-e8cc-426c-919b-5f8303a740b0 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:39:51.275416 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1414/2836] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:39:51 2022] PUT /identity/v3/projects/56e291db07044694afffa3c66ae39ec5/users/a819d0070de042bfadccd2d1eac800b1/roles/7185d0cfbcd44502b1613bcfe1b42f6f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:39:51.286859 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9281f3-712f-4b4c-ade4-e7de8336d260 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:51.287156 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9281f3-712f-4b4c-ade4-e7de8336d260 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:51.287707 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9281f3-712f-4b4c-ade4-e7de8336d260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:51.313784 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-fd9281f3-712f-4b4c-ade4-e7de8336d260 None None] MFA Rules not processed for user `a819d0070de042bfadccd2d1eac800b1`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:39:51.315020 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-fd9281f3-712f-4b4c-ade4-e7de8336d260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:39:51.376470 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1423/2837] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:39:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:39:51.388481 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203bf252-e8cc-426c-919b-5f8303a740b0 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:39:51.390059 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-203bf252-e8cc-426c-919b-5f8303a740b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:39:51.445083 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203bf252-e8cc-426c-919b-5f8303a740b0 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:39:51.449073 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bed37a-0b97-425f-a0e5-3aa82f634898 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45219f386f0147b6bd380efe4ab62812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:39:51.449712 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bed37a-0b97-425f-a0e5-3aa82f634898 service cinder] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:51.449999 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bed37a-0b97-425f-a0e5-3aa82f634898 service cinder] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:51.450281 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bed37a-0b97-425f-a0e5-3aa82f634898 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:51.458607 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bed37a-0b97-425f-a0e5-3aa82f634898 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:39:51.460129 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bed37a-0b97-425f-a0e5-3aa82f634898 service cinder] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:39:51.468860 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1415/2838] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:39:51 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:39:51.488874 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9281f3-712f-4b4c-ade4-e7de8336d260 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:39:51.548510 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9281f3-712f-4b4c-ade4-e7de8336d260 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:39:51.553020 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be815235-66db-4139-969a-3589caeabbf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:39:51.553872 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be815235-66db-4139-969a-3589caeabbf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:51.554147 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be815235-66db-4139-969a-3589caeabbf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:51.554417 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be815235-66db-4139-969a-3589caeabbf5 admin admin] PATH_INFO: `/v3/users/a819d0070de042bfadccd2d1eac800b1` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:51.555786 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be815235-66db-4139-969a-3589caeabbf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a819d0070de042bfadccd2d1eac800b1)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:39:51.558459 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be815235-66db-4139-969a-3589caeabbf5 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:39:51.602458 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-be815235-66db-4139-969a-3589caeabbf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a819d0070de042bfadccd2d1eac800b1'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:51.610195 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-be815235-66db-4139-969a-3589caeabbf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a819d0070de042bfadccd2d1eac800b1'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:51.610917 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-be815235-66db-4139-969a-3589caeabbf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a819d0070de042bfadccd2d1eac800b1'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:51.617666 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-be815235-66db-4139-969a-3589caeabbf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a819d0070de042bfadccd2d1eac800b1'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:51.629669 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-be815235-66db-4139-969a-3589caeabbf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a819d0070de042bfadccd2d1eac800b1'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:51.635913 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1424/2839] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:39:51 2022] DELETE /identity/v3/users/a819d0070de042bfadccd2d1eac800b1 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:39:51.640734 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c564c1-9766-4830-8386-afb8ff223683 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:51.641157 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c564c1-9766-4830-8386-afb8ff223683 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:51.641283 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c564c1-9766-4830-8386-afb8ff223683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:51.658786 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-14c564c1-9766-4830-8386-afb8ff223683 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:39:51.659978 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-14c564c1-9766-4830-8386-afb8ff223683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:39:51.717843 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1416/2840] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:39:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 01:39:51.727411 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be815235-66db-4139-969a-3589caeabbf5 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:39:51.729579 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-be815235-66db-4139-969a-3589caeabbf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:39:51.785040 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be815235-66db-4139-969a-3589caeabbf5 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:39:51.788627 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e07d5c-2132-4e13-8f8e-ad3c02cbd140 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:39:51.789258 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e07d5c-2132-4e13-8f8e-ad3c02cbd140 service neutron] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:51.789539 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e07d5c-2132-4e13-8f8e-ad3c02cbd140 service neutron] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:51.789812 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e07d5c-2132-4e13-8f8e-ad3c02cbd140 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:51.799344 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e07d5c-2132-4e13-8f8e-ad3c02cbd140 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:39:51.800761 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e07d5c-2132-4e13-8f8e-ad3c02cbd140 service neutron] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:39:51.810380 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1425/2841] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:39:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:39:52.065745 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c564c1-9766-4830-8386-afb8ff223683 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:39:52.067176 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-14c564c1-9766-4830-8386-afb8ff223683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:39:52.078884 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c564c1-9766-4830-8386-afb8ff223683 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:39:52.083656 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b5efa8-4d3a-4005-bb61-07e129c114c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:39:52.084609 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5efa8-4d3a-4005-bb61-07e129c114c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:52.084900 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5efa8-4d3a-4005-bb61-07e129c114c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:52.085176 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5efa8-4d3a-4005-bb61-07e129c114c1 admin admin] PATH_INFO: `/v3/projects/56e291db07044694afffa3c66ae39ec5` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:52.086362 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b5efa8-4d3a-4005-bb61-07e129c114c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56e291db07044694afffa3c66ae39ec5)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:39:52.089012 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b5efa8-4d3a-4005-bb61-07e129c114c1 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:39:52.133255 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-04b5efa8-4d3a-4005-bb61-07e129c114c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56e291db07044694afffa3c66ae39ec5', 'request_id': 'req-04b5efa8-4d3a-4005-bb61-07e129c114c1'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:52.140331 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-04b5efa8-4d3a-4005-bb61-07e129c114c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56e291db07044694afffa3c66ae39ec5', 'request_id': 'req-04b5efa8-4d3a-4005-bb61-07e129c114c1'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:52.145599 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-04b5efa8-4d3a-4005-bb61-07e129c114c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56e291db07044694afffa3c66ae39ec5', 'request_id': 'req-04b5efa8-4d3a-4005-bb61-07e129c114c1'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:52.157168 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-04b5efa8-4d3a-4005-bb61-07e129c114c1 admin admin] The token cache is being invalidate because project 56e291db07044694afffa3c66ae39ec5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:39:52.157390 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-04b5efa8-4d3a-4005-bb61-07e129c114c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:52.158010 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-04b5efa8-4d3a-4005-bb61-07e129c114c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:39:52.159546 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1417/2842] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:39:52 2022] DELETE /identity/v3/projects/56e291db07044694afffa3c66ae39ec5 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:39:52.165590 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437eab8-5682-41d6-bbd5-0cf4ca3806f3 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:52.165891 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437eab8-5682-41d6-bbd5-0cf4ca3806f3 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:52.166169 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437eab8-5682-41d6-bbd5-0cf4ca3806f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:52.183193 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-5437eab8-5682-41d6-bbd5-0cf4ca3806f3 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:39:52.184369 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-5437eab8-5682-41d6-bbd5-0cf4ca3806f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:39:52.241703 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1426/2843] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:39:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:39:52.251159 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042388e9-51eb-46c1-8938-01b5c70a6608 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:52.251687 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042388e9-51eb-46c1-8938-01b5c70a6608 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:52.251687 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042388e9-51eb-46c1-8938-01b5c70a6608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:52.269662 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-042388e9-51eb-46c1-8938-01b5c70a6608 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:39:52.270907 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-042388e9-51eb-46c1-8938-01b5c70a6608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:39:52.279489 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1418/2844] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:39:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:39:52.283999 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5437eab8-5682-41d6-bbd5-0cf4ca3806f3 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:39:52.294791 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5437eab8-5682-41d6-bbd5-0cf4ca3806f3 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:39:52.299383 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef0c55-1b59-465a-b963-df5736b1117f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:39:52.300068 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef0c55-1b59-465a-b963-df5736b1117f admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:52.300352 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef0c55-1b59-465a-b963-df5736b1117f admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:52.300626 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef0c55-1b59-465a-b963-df5736b1117f admin admin] PATH_INFO: `/v3/domains` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:52.301348 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cef0c55-1b59-465a-b963-df5736b1117f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:39:52.301653 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cef0c55-1b59-465a-b963-df5736b1117f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:39:52.303289 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cef0c55-1b59-465a-b963-df5736b1117f admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:39:52.315200 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1427/2845] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Mar 30 01:39:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:39:52.319319 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042388e9-51eb-46c1-8938-01b5c70a6608 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:39:52.328510 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042388e9-51eb-46c1-8938-01b5c70a6608 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:39:52.333115 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801997db-baa9-4cb5-9fbf-a540e7111e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:39:52.333760 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801997db-baa9-4cb5-9fbf-a540e7111e1b admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:52.334046 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801997db-baa9-4cb5-9fbf-a540e7111e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:52.334335 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801997db-baa9-4cb5-9fbf-a540e7111e1b admin admin] PATH_INFO: `/v3/projects` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:52.335055 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801997db-baa9-4cb5-9fbf-a540e7111e1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:39:52.336924 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801997db-baa9-4cb5-9fbf-a540e7111e1b admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:39:52.361984 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1419/2846] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:39:52 2022] POST /identity/v3/projects => generated 369 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 01:39:52.366099 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef0c55-1b59-465a-b963-df5736b1117f admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:39:52.377089 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef0c55-1b59-465a-b963-df5736b1117f admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:39:52.430843 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df88193-c9ef-4407-bec3-7b6e16ee2be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:39:52.432054 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df88193-c9ef-4407-bec3-7b6e16ee2be2 admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:52.432347 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df88193-c9ef-4407-bec3-7b6e16ee2be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:52.432627 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df88193-c9ef-4407-bec3-7b6e16ee2be2 admin admin] PATH_INFO: `/v3/users` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:52.433319 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df88193-c9ef-4407-bec3-7b6e16ee2be2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:39:52.435283 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df88193-c9ef-4407-bec3-7b6e16ee2be2 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:39:52.454522 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1428/2847] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:39:52 2022] POST /identity/v3/users => generated 285 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 01:39:52.458693 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801997db-baa9-4cb5-9fbf-a540e7111e1b admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:39:52.468952 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801997db-baa9-4cb5-9fbf-a540e7111e1b admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:39:52.473714 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa14930-4d20-4766-8898-46abe4f3bbd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:39:52.474366 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa14930-4d20-4766-8898-46abe4f3bbd5 admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:52.474650 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa14930-4d20-4766-8898-46abe4f3bbd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:52.474963 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa14930-4d20-4766-8898-46abe4f3bbd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:52.475683 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa14930-4d20-4766-8898-46abe4f3bbd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:39:52.477272 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa14930-4d20-4766-8898-46abe4f3bbd5 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:39:52.488410 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1420/2848] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:39:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 01:39:52.491553 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df88193-c9ef-4407-bec3-7b6e16ee2be2 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:39:52.502063 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df88193-c9ef-4407-bec3-7b6e16ee2be2 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:39:52.506781 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e806e5-77d5-41c9-8c20-69256a8497ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:39:52.507431 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e806e5-77d5-41c9-8c20-69256a8497ec admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:52.507715 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e806e5-77d5-41c9-8c20-69256a8497ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:52.507992 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e806e5-77d5-41c9-8c20-69256a8497ec admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:52.508713 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e806e5-77d5-41c9-8c20-69256a8497ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:39:52.510419 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e806e5-77d5-41c9-8c20-69256a8497ec admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:39:52.520120 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1429/2849] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:39:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:39:52.524066 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa14930-4d20-4766-8898-46abe4f3bbd5 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:39:52.536041 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa14930-4d20-4766-8898-46abe4f3bbd5 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:39:52.541633 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e585a754-73ce-4046-8dc9-d1b604fec1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:39:52.542819 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e585a754-73ce-4046-8dc9-d1b604fec1fd admin admin] REQUEST_METHOD: `PUT` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:52.543124 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e585a754-73ce-4046-8dc9-d1b604fec1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:52.543387 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e585a754-73ce-4046-8dc9-d1b604fec1fd admin admin] PATH_INFO: `/v3/projects/80ca85a5ffb4470e8a0644707f024267/users/697bf2bbd4f84e98bd7b804c95b88fac/roles/7185d0cfbcd44502b1613bcfe1b42f6f` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:52.558465 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e585a754-73ce-4046-8dc9-d1b604fec1fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=80ca85a5ffb4470e8a0644707f024267, user_id=697bf2bbd4f84e98bd7b804c95b88fac, role_id=7185d0cfbcd44502b1613bcfe1b42f6f)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:39:52.561162 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e585a754-73ce-4046-8dc9-d1b604fec1fd admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:39:52.574104 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1421/2850] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:39:52 2022] PUT /identity/v3/projects/80ca85a5ffb4470e8a0644707f024267/users/697bf2bbd4f84e98bd7b804c95b88fac/roles/7185d0cfbcd44502b1613bcfe1b42f6f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:39:52.584211 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc0bdc-8599-4f34-a43b-a6be93797f9c None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:52.584503 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc0bdc-8599-4f34-a43b-a6be93797f9c None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:52.584781 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc0bdc-8599-4f34-a43b-a6be93797f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:52.611529 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-ecfc0bdc-8599-4f34-a43b-a6be93797f9c None None] MFA Rules not processed for user `697bf2bbd4f84e98bd7b804c95b88fac`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:39:52.612737 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-ecfc0bdc-8599-4f34-a43b-a6be93797f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:39:52.678513 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1430/2851] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:39:52 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:39:52.690334 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e585a754-73ce-4046-8dc9-d1b604fec1fd admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:39:52.692054 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-e585a754-73ce-4046-8dc9-d1b604fec1fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:39:52.746188 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e585a754-73ce-4046-8dc9-d1b604fec1fd admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:39:52.750090 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f607a220-40d2-4fae-bb18-c555d13736f8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf28c0ec3d94fb99bcd573dd8dd0e30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:39:52.750760 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607a220-40d2-4fae-bb18-c555d13736f8 service glance] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:39:52.751051 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607a220-40d2-4fae-bb18-c555d13736f8 service glance] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:39:52.751351 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607a220-40d2-4fae-bb18-c555d13736f8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:39:52.760060 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f607a220-40d2-4fae-bb18-c555d13736f8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:39:52.761481 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f607a220-40d2-4fae-bb18-c555d13736f8 service glance] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:39:52.770067 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1422/2852] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:39:52 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:40:16.105249 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc0bdc-8599-4f34-a43b-a6be93797f9c None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:40:16.166494 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc0bdc-8599-4f34-a43b-a6be93797f9c None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:40:16.171619 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a4fdbd-1688-40dc-9334-5a95d3d0a9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:40:16.172513 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4fdbd-1688-40dc-9334-5a95d3d0a9c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:40:16.172795 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4fdbd-1688-40dc-9334-5a95d3d0a9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:40:16.173071 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4fdbd-1688-40dc-9334-5a95d3d0a9c7 admin admin] PATH_INFO: `/v3/users/697bf2bbd4f84e98bd7b804c95b88fac` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:40:16.174262 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a4fdbd-1688-40dc-9334-5a95d3d0a9c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=697bf2bbd4f84e98bd7b804c95b88fac)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:40:16.176189 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a4fdbd-1688-40dc-9334-5a95d3d0a9c7 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:40:16.221092 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-b9a4fdbd-1688-40dc-9334-5a95d3d0a9c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '697bf2bbd4f84e98bd7b804c95b88fac'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:40:16.227997 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-b9a4fdbd-1688-40dc-9334-5a95d3d0a9c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '697bf2bbd4f84e98bd7b804c95b88fac'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:40:16.228609 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-b9a4fdbd-1688-40dc-9334-5a95d3d0a9c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '697bf2bbd4f84e98bd7b804c95b88fac'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:40:16.235910 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-b9a4fdbd-1688-40dc-9334-5a95d3d0a9c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '697bf2bbd4f84e98bd7b804c95b88fac'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:40:16.247087 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-b9a4fdbd-1688-40dc-9334-5a95d3d0a9c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '697bf2bbd4f84e98bd7b804c95b88fac'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:40:16.252880 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1431/2853] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:40:16 2022] DELETE /identity/v3/users/697bf2bbd4f84e98bd7b804c95b88fac => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:40:16.257558 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053908ae-2107-4fef-a9f8-96012aa1a6d9 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:40:16.258071 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053908ae-2107-4fef-a9f8-96012aa1a6d9 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:40:16.258180 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053908ae-2107-4fef-a9f8-96012aa1a6d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:40:16.275300 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-053908ae-2107-4fef-a9f8-96012aa1a6d9 None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:40:16.276487 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-053908ae-2107-4fef-a9f8-96012aa1a6d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:40:16.332553 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1423/2854] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:40:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:40:16.342092 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a4fdbd-1688-40dc-9334-5a95d3d0a9c7 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:40:16.344332 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-b9a4fdbd-1688-40dc-9334-5a95d3d0a9c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:40:16.399867 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a4fdbd-1688-40dc-9334-5a95d3d0a9c7 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:40:16.403507 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ad351-763b-4d22-b443-fdcd62cd3061 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:40:16.404152 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ad351-763b-4d22-b443-fdcd62cd3061 service neutron] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:40:16.404435 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ad351-763b-4d22-b443-fdcd62cd3061 service neutron] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:40:16.404712 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ad351-763b-4d22-b443-fdcd62cd3061 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:40:16.414684 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3ad351-763b-4d22-b443-fdcd62cd3061 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:40:16.416128 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3ad351-763b-4d22-b443-fdcd62cd3061 service neutron] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:40:16.425573 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1432/2855] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:40:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:40:16.695088 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053908ae-2107-4fef-a9f8-96012aa1a6d9 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:40:16.696580 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-053908ae-2107-4fef-a9f8-96012aa1a6d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:40:16.708696 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053908ae-2107-4fef-a9f8-96012aa1a6d9 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:40:16.713251 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3094b4ae-9a6b-490e-91c0-242240083fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:40:16.714103 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094b4ae-9a6b-490e-91c0-242240083fe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:40:16.714383 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094b4ae-9a6b-490e-91c0-242240083fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:40:16.714655 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094b4ae-9a6b-490e-91c0-242240083fe0 admin admin] PATH_INFO: `/v3/projects/80ca85a5ffb4470e8a0644707f024267` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:40:16.715849 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3094b4ae-9a6b-490e-91c0-242240083fe0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80ca85a5ffb4470e8a0644707f024267)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:40:16.717869 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3094b4ae-9a6b-490e-91c0-242240083fe0 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:40:16.763261 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-3094b4ae-9a6b-490e-91c0-242240083fe0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80ca85a5ffb4470e8a0644707f024267', 'request_id': 'req-3094b4ae-9a6b-490e-91c0-242240083fe0'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:40:16.770127 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-3094b4ae-9a6b-490e-91c0-242240083fe0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80ca85a5ffb4470e8a0644707f024267', 'request_id': 'req-3094b4ae-9a6b-490e-91c0-242240083fe0'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:40:16.775353 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-3094b4ae-9a6b-490e-91c0-242240083fe0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80ca85a5ffb4470e8a0644707f024267', 'request_id': 'req-3094b4ae-9a6b-490e-91c0-242240083fe0'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:40:16.786790 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-3094b4ae-9a6b-490e-91c0-242240083fe0 admin admin] The token cache is being invalidate because project 80ca85a5ffb4470e8a0644707f024267 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:40:16.787075 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-3094b4ae-9a6b-490e-91c0-242240083fe0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:40:16.787694 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-3094b4ae-9a6b-490e-91c0-242240083fe0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:40:16.789194 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1424/2856] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:40:16 2022] DELETE /identity/v3/projects/80ca85a5ffb4470e8a0644707f024267 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:40:16.794075 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2571e40-3f3b-44d5-8763-e1a54a2feb9a None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:40:16.794367 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2571e40-3f3b-44d5-8763-e1a54a2feb9a None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:40:16.794646 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2571e40-3f3b-44d5-8763-e1a54a2feb9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:40:16.812731 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-b2571e40-3f3b-44d5-8763-e1a54a2feb9a None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:40:16.813930 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-b2571e40-3f3b-44d5-8763-e1a54a2feb9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:40:16.870322 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1433/2857] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:40:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:40:16.879151 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186f375-1022-4ae1-a77b-ebe98fed938f None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:40:16.879437 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186f375-1022-4ae1-a77b-ebe98fed938f None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:40:16.879713 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186f375-1022-4ae1-a77b-ebe98fed938f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:40:16.897358 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-f186f375-1022-4ae1-a77b-ebe98fed938f None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:40:16.898536 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-f186f375-1022-4ae1-a77b-ebe98fed938f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:40:16.906793 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1425/2858] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:40:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:40:16.911087 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2571e40-3f3b-44d5-8763-e1a54a2feb9a None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:40:16.921415 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2571e40-3f3b-44d5-8763-e1a54a2feb9a None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:40:16.926104 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68030adf-1bf9-4070-a51b-4b76d74861d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:40:16.926784 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68030adf-1bf9-4070-a51b-4b76d74861d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:40:16.927068 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68030adf-1bf9-4070-a51b-4b76d74861d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:40:16.927341 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68030adf-1bf9-4070-a51b-4b76d74861d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:40:16.928063 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68030adf-1bf9-4070-a51b-4b76d74861d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 01:40:16.928368 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68030adf-1bf9-4070-a51b-4b76d74861d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:40:16.929949 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68030adf-1bf9-4070-a51b-4b76d74861d6 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:40:16.941237 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1434/2859] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Mar 30 01:40:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 01:40:16.945389 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f186f375-1022-4ae1-a77b-ebe98fed938f None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:40:16.954322 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f186f375-1022-4ae1-a77b-ebe98fed938f None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:40:16.958979 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef0562d-baeb-4bf9-8bf7-3b5e8729bec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:40:16.959616 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef0562d-baeb-4bf9-8bf7-3b5e8729bec9 admin admin] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:40:16.959895 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef0562d-baeb-4bf9-8bf7-3b5e8729bec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:40:16.960168 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef0562d-baeb-4bf9-8bf7-3b5e8729bec9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:40:16.960851 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef0562d-baeb-4bf9-8bf7-3b5e8729bec9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:40:16.962725 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef0562d-baeb-4bf9-8bf7-3b5e8729bec9 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:40:16.988582 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1426/2860] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Mar 30 01:40:16 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:40:16.992608 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68030adf-1bf9-4070-a51b-4b76d74861d6 admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:40:17.003007 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68030adf-1bf9-4070-a51b-4b76d74861d6 admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:40:17.056525 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93732756-c598-49be-bd52-58610184c20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:40:17.057183 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93732756-c598-49be-bd52-58610184c20c admin admin] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:40:17.057466 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93732756-c598-49be-bd52-58610184c20c admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:40:17.057743 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93732756-c598-49be-bd52-58610184c20c admin admin] PATH_INFO: `/v3/users` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:40:17.058418 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93732756-c598-49be-bd52-58610184c20c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:40:17.060454 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93732756-c598-49be-bd52-58610184c20c admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:40:17.081325 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1435/2861] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Mar 30 01:40:16 2022] POST /identity/v3/users => generated 287 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 01:40:17.085541 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef0562d-baeb-4bf9-8bf7-3b5e8729bec9 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:40:17.096233 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef0562d-baeb-4bf9-8bf7-3b5e8729bec9 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:40:17.100830 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a14b0a-ab0b-4ee6-ad01-1de431c6350c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:40:17.101477 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a14b0a-ab0b-4ee6-ad01-1de431c6350c admin admin] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:40:17.101763 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a14b0a-ab0b-4ee6-ad01-1de431c6350c admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:40:17.102043 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a14b0a-ab0b-4ee6-ad01-1de431c6350c admin admin] PATH_INFO: `/v3/roles` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:40:17.102798 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a14b0a-ab0b-4ee6-ad01-1de431c6350c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:40:17.104373 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a14b0a-ab0b-4ee6-ad01-1de431c6350c admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:40:17.115011 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1427/2862] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:40:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 01:40:17.172113 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93732756-c598-49be-bd52-58610184c20c admin admin] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:40:17.182309 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93732756-c598-49be-bd52-58610184c20c admin admin] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:40:17.187604 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b452f7d0-53e0-4d3e-8095-42756c334a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:40:17.188262 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b452f7d0-53e0-4d3e-8095-42756c334a4e admin admin] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:40:17.188536 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b452f7d0-53e0-4d3e-8095-42756c334a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:40:17.188807 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b452f7d0-53e0-4d3e-8095-42756c334a4e admin admin] PATH_INFO: `/v3/roles` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:40:17.189563 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b452f7d0-53e0-4d3e-8095-42756c334a4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:40:17.191202 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b452f7d0-53e0-4d3e-8095-42756c334a4e admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:40:17.201009 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1436/2863] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Mar 30 01:40:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 01:40:17.205141 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a14b0a-ab0b-4ee6-ad01-1de431c6350c admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:40:17.215113 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a14b0a-ab0b-4ee6-ad01-1de431c6350c admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:40:17.220035 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749a1485-8ad1-4aa0-b5a4-2714e7969297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:40:17.220907 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a1485-8ad1-4aa0-b5a4-2714e7969297 admin admin] REQUEST_METHOD: `PUT` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:40:17.221191 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a1485-8ad1-4aa0-b5a4-2714e7969297 admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:40:17.221468 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a1485-8ad1-4aa0-b5a4-2714e7969297 admin admin] PATH_INFO: `/v3/projects/62830c4fab6a49b4ae7f2533a643ffa6/users/bc9380fd6eef41cdac32eef0cdcdc3ca/roles/7185d0cfbcd44502b1613bcfe1b42f6f` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:40:17.236146 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749a1485-8ad1-4aa0-b5a4-2714e7969297 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62830c4fab6a49b4ae7f2533a643ffa6, user_id=bc9380fd6eef41cdac32eef0cdcdc3ca, role_id=7185d0cfbcd44502b1613bcfe1b42f6f)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:40:17.238827 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749a1485-8ad1-4aa0-b5a4-2714e7969297 admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:40:17.252353 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1428/2864] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Mar 30 01:40:17 2022] PUT /identity/v3/projects/62830c4fab6a49b4ae7f2533a643ffa6/users/bc9380fd6eef41cdac32eef0cdcdc3ca/roles/7185d0cfbcd44502b1613bcfe1b42f6f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:40:17.262046 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7604e6c-5683-4575-a961-3ead76c855b3 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:40:17.262358 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7604e6c-5683-4575-a961-3ead76c855b3 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:40:17.262838 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7604e6c-5683-4575-a961-3ead76c855b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:40:17.288924 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-f7604e6c-5683-4575-a961-3ead76c855b3 None None] MFA Rules not processed for user `bc9380fd6eef41cdac32eef0cdcdc3ca`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:40:17.290277 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-f7604e6c-5683-4575-a961-3ead76c855b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:40:17.351293 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1437/2865] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:40:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:40:17.362398 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749a1485-8ad1-4aa0-b5a4-2714e7969297 admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:40:17.364130 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-749a1485-8ad1-4aa0-b5a4-2714e7969297 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:40:17.419746 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749a1485-8ad1-4aa0-b5a4-2714e7969297 admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:40:17.424056 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baec73f0-1bcb-40f6-b53d-4ff4491e9f7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45219f386f0147b6bd380efe4ab62812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:40:17.424696 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec73f0-1bcb-40f6-b53d-4ff4491e9f7a service cinder] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:40:17.424982 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec73f0-1bcb-40f6-b53d-4ff4491e9f7a service cinder] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:40:17.425261 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec73f0-1bcb-40f6-b53d-4ff4491e9f7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:40:17.433562 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baec73f0-1bcb-40f6-b53d-4ff4491e9f7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:40:17.435014 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baec73f0-1bcb-40f6-b53d-4ff4491e9f7a service cinder] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:40:17.444182 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1429/2866] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:40:17 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:40:18.787184 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3310643-edf0-41e3-8889-18c3893c5d72 None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:40:18.787753 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3310643-edf0-41e3-8889-18c3893c5d72 None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:40:18.787753 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3310643-edf0-41e3-8889-18c3893c5d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:40:18.806199 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-f3310643-edf0-41e3-8889-18c3893c5d72 None None] MFA Rules not processed for user `bc9380fd6eef41cdac32eef0cdcdc3ca`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:40:18.807429 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-f3310643-edf0-41e3-8889-18c3893c5d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:40:18.815038 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1438/2867] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:40:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 01:40:19.320978 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baec73f0-1bcb-40f6-b53d-4ff4491e9f7a service cinder] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:40:19.323072 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-baec73f0-1bcb-40f6-b53d-4ff4491e9f7a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:40:19.399216 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baec73f0-1bcb-40f6-b53d-4ff4491e9f7a service cinder] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:40:19.404149 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06b1b1f-4229-4175-b493-d7ee27759eda service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7343cd5457264dabb4c2b3a62df59431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:40:19.405866 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b1b1f-4229-4175-b493-d7ee27759eda service placement] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:40:19.406156 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b1b1f-4229-4175-b493-d7ee27759eda service placement] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:40:19.406435 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b1b1f-4229-4175-b493-d7ee27759eda service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:40:19.408524 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-c06b1b1f-4229-4175-b493-d7ee27759eda service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:40:19.422481 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06b1b1f-4229-4175-b493-d7ee27759eda service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:40:19.424102 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06b1b1f-4229-4175-b493-d7ee27759eda service placement] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:40:19.434566 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1430/2868] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:40:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:40:25.774458 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3310643-edf0-41e3-8889-18c3893c5d72 None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:40:25.776916 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-f3310643-edf0-41e3-8889-18c3893c5d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:40:25.851026 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3310643-edf0-41e3-8889-18c3893c5d72 None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:40:25.856446 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6b057f-c90b-4de9-8c33-430104266430 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140c6d1a20e94192bde06e72040f162d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:40:25.857090 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b057f-c90b-4de9-8c33-430104266430 service nova] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:40:25.857380 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b057f-c90b-4de9-8c33-430104266430 service nova] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:40:25.857655 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b057f-c90b-4de9-8c33-430104266430 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:40:25.860216 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-1b6b057f-c90b-4de9-8c33-430104266430 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:40:25.871986 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6b057f-c90b-4de9-8c33-430104266430 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:40:25.874000 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6b057f-c90b-4de9-8c33-430104266430 service nova] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:40:25.884669 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1439/2869] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:40:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 30 01:40:30.433624 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e51e42-6d4f-42bc-bfcb-a8b8d94c53df None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:40:30.434102 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e51e42-6d4f-42bc-bfcb-a8b8d94c53df None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:40:30.434229 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e51e42-6d4f-42bc-bfcb-a8b8d94c53df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:40:30.452964 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-61e51e42-6d4f-42bc-bfcb-a8b8d94c53df None None] MFA Rules not processed for user `0503fdca7f834ef0a81422804dc74812`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:40:30.454316 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-61e51e42-6d4f-42bc-bfcb-a8b8d94c53df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:40:30.507205 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1431/2870] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Mar 30 01:40:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:40:30.552734 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6b057f-c90b-4de9-8c33-430104266430 service nova] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:40:30.554140 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-1b6b057f-c90b-4de9-8c33-430104266430 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:40:30.622930 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6b057f-c90b-4de9-8c33-430104266430 service nova] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:40:30.628430 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7b7fe8-ed5d-42ae-b3c3-dd7d88799c6f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f16de81dfb4c14b027cd6cd1e6ff2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:40:30.629045 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b7fe8-ed5d-42ae-b3c3-dd7d88799c6f service swift] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:40:30.629324 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b7fe8-ed5d-42ae-b3c3-dd7d88799c6f service swift] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:40:30.629594 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b7fe8-ed5d-42ae-b3c3-dd7d88799c6f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:40:30.637637 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7b7fe8-ed5d-42ae-b3c3-dd7d88799c6f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:40:30.639245 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7b7fe8-ed5d-42ae-b3c3-dd7d88799c6f service swift] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:40:30.647191 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1440/2871] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Mar 30 01:40:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 30 01:40:31.150755 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff5940-85ba-4de8-bb71-284f3b318d22 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:40:31.151102 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff5940-85ba-4de8-bb71-284f3b318d22 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:40:31.151388 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff5940-85ba-4de8-bb71-284f3b318d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:40:31.169671 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-81ff5940-85ba-4de8-bb71-284f3b318d22 None None] MFA Rules not processed for user `0503fdca7f834ef0a81422804dc74812`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:40:31.170889 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-81ff5940-85ba-4de8-bb71-284f3b318d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:40:31.178934 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1432/2872] 10.222.0.30 () {58 vars in 967 bytes} [Wed Mar 30 01:40:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:40:31.190927 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7b7fe8-ed5d-42ae-b3c3-dd7d88799c6f service swift] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:40:31.201447 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7b7fe8-ed5d-42ae-b3c3-dd7d88799c6f service swift] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:40:31.206557 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ba6513-812c-4a52-991c-94bd49d7dde5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f16de81dfb4c14b027cd6cd1e6ff2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:40:31.207227 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba6513-812c-4a52-991c-94bd49d7dde5 service swift] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:40:31.207515 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba6513-812c-4a52-991c-94bd49d7dde5 service swift] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:40:31.207793 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba6513-812c-4a52-991c-94bd49d7dde5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:40:31.215635 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ba6513-812c-4a52-991c-94bd49d7dde5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:40:31.217211 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ba6513-812c-4a52-991c-94bd49d7dde5 service swift] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:40:31.225771 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1441/2873] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Mar 30 01:40:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 30 01:40:31.408876 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de9a08-1af6-435e-ac85-2c45e6e727b1 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:40:31.409166 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de9a08-1af6-435e-ac85-2c45e6e727b1 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:40:31.409439 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de9a08-1af6-435e-ac85-2c45e6e727b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:40:31.427489 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-a9de9a08-1af6-435e-ac85-2c45e6e727b1 None None] MFA Rules not processed for user `0503fdca7f834ef0a81422804dc74812`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:40:31.428655 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-a9de9a08-1af6-435e-ac85-2c45e6e727b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:40:31.435916 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1433/2874] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Mar 30 01:40:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:40:31.448108 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ba6513-812c-4a52-991c-94bd49d7dde5 service swift] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:40:31.458993 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ba6513-812c-4a52-991c-94bd49d7dde5 service swift] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:40:31.463936 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b18ba7-143c-48e5-848d-17f5d040de76 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f16de81dfb4c14b027cd6cd1e6ff2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:40:31.464588 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b18ba7-143c-48e5-848d-17f5d040de76 service swift] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:40:31.464867 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b18ba7-143c-48e5-848d-17f5d040de76 service swift] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:40:31.465140 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b18ba7-143c-48e5-848d-17f5d040de76 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:40:31.473212 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b18ba7-143c-48e5-848d-17f5d040de76 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:40:31.474851 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b18ba7-143c-48e5-848d-17f5d040de76 service swift] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:40:31.483016 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1442/2875] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Mar 30 01:40:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Mar 30 01:40:31.790922 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf7116-db11-47bf-bfe7-867166c81c23 None None] REQUEST_METHOD: `POST` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:40:31.791211 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf7116-db11-47bf-bfe7-867166c81c23 None None] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:40:31.791487 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf7116-db11-47bf-bfe7-867166c81c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:40:31.809165 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.auth.core [None req-c4bf7116-db11-47bf-bfe7-867166c81c23 None None] MFA Rules not processed for user `0503fdca7f834ef0a81422804dc74812`. Rule list: `[]` (Enabled: `True`). {{(pid=79701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:40:31.810328 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-c4bf7116-db11-47bf-bfe7-867166c81c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:40:31.817305 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1434/2876] 10.222.0.30 () {58 vars in 967 bytes} [Wed Mar 30 01:40:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:40:31.829173 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b18ba7-143c-48e5-848d-17f5d040de76 service swift] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:40:31.839805 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b18ba7-143c-48e5-848d-17f5d040de76 service swift] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:40:31.845302 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd0823-2fab-44bf-a564-12056cdb8e2d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f16de81dfb4c14b027cd6cd1e6ff2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:40:31.845953 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd0823-2fab-44bf-a564-12056cdb8e2d service swift] REQUEST_METHOD: `GET` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:40:31.846374 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd0823-2fab-44bf-a564-12056cdb8e2d service swift] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:40:31.846657 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd0823-2fab-44bf-a564-12056cdb8e2d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:40:31.854464 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fd0823-2fab-44bf-a564-12056cdb8e2d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:40:31.856078 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fd0823-2fab-44bf-a564-12056cdb8e2d service swift] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:40:31.864543 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1443/2877] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Mar 30 01:40:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Mar 30 01:40:33.874849 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bf7116-db11-47bf-bfe7-867166c81c23 None None] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:40:33.935260 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bf7116-db11-47bf-bfe7-867166c81c23 None None] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:40:33.940425 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e87b89f-1759-44b4-ab72-6531b368469a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:40:33.941281 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87b89f-1759-44b4-ab72-6531b368469a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:40:33.941567 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87b89f-1759-44b4-ab72-6531b368469a admin admin] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:40:33.941844 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87b89f-1759-44b4-ab72-6531b368469a admin admin] PATH_INFO: `/v3/users/bc9380fd6eef41cdac32eef0cdcdc3ca` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:40:33.943053 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e87b89f-1759-44b4-ab72-6531b368469a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc9380fd6eef41cdac32eef0cdcdc3ca)` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:40:33.944965 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e87b89f-1759-44b4-ab72-6531b368469a admin admin] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:40:33.989288 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-4e87b89f-1759-44b4-ab72-6531b368469a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc9380fd6eef41cdac32eef0cdcdc3ca'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:40:34.001288 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-4e87b89f-1759-44b4-ab72-6531b368469a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc9380fd6eef41cdac32eef0cdcdc3ca'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:40:34.009202 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-4e87b89f-1759-44b4-ab72-6531b368469a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc9380fd6eef41cdac32eef0cdcdc3ca'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:40:34.009820 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-4e87b89f-1759-44b4-ab72-6531b368469a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc9380fd6eef41cdac32eef0cdcdc3ca'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:40:34.016694 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.notifications [None req-4e87b89f-1759-44b4-ab72-6531b368469a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc9380fd6eef41cdac32eef0cdcdc3ca'} {{(pid=79701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:40:34.022629 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1435/2878] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Mar 30 01:40:33 2022] DELETE /identity/v3/users/bc9380fd6eef41cdac32eef0cdcdc3ca => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 01:40:34.027242 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc78385-edcd-4bb4-8789-2b27c833c43a None None] REQUEST_METHOD: `POST` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:40:34.027703 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc78385-edcd-4bb4-8789-2b27c833c43a None None] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:40:34.027800 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc78385-edcd-4bb4-8789-2b27c833c43a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:40:34.046169 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.auth.core [None req-fcc78385-edcd-4bb4-8789-2b27c833c43a None None] MFA Rules not processed for user `e9a5ef9b377048458730d23efb1e6534`. Rule list: `[]` (Enabled: `True`). {{(pid=79702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 01:40:34.047638 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-fcc78385-edcd-4bb4-8789-2b27c833c43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:40:34.105205 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1444/2879] 10.222.0.30 () {58 vars in 957 bytes} [Wed Mar 30 01:40:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 01:40:34.115131 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e87b89f-1759-44b4-ab72-6531b368469a admin admin] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:40:34.116523 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-4e87b89f-1759-44b4-ab72-6531b368469a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:40:34.171790 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e87b89f-1759-44b4-ab72-6531b368469a admin admin] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:40:34.175618 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762cd804-423a-4394-b2d5-72306fec5149 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41745b7f8a804e75b490a0a34977b23b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:40:34.176252 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762cd804-423a-4394-b2d5-72306fec5149 service neutron] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:40:34.176534 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762cd804-423a-4394-b2d5-72306fec5149 service neutron] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:40:34.176813 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762cd804-423a-4394-b2d5-72306fec5149 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:40:34.185653 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762cd804-423a-4394-b2d5-72306fec5149 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:40:34.187112 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762cd804-423a-4394-b2d5-72306fec5149 service neutron] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:40:34.197004 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1436/2880] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:40:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 01:40:34.362034 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc78385-edcd-4bb4-8789-2b27c833c43a None None] Authenticating user token {{(pid=79702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:40:34.363498 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.fernet_utils [None req-fcc78385-edcd-4bb4-8789-2b27c833c43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:40:34.375820 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc78385-edcd-4bb4-8789-2b27c833c43a None None] Validating token access rules against request {{(pid=79702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:40:34.380636 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448f71c1-f488-4508-8bd6-e4711e977249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a5ef9b377048458730d23efb1e6534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7672bb827a4f4ea1fedd14bfb4311b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:40:34.381558 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f71c1-f488-4508-8bd6-e4711e977249 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:40:34.381848 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f71c1-f488-4508-8bd6-e4711e977249 admin admin] SCRIPT_NAME: `/identity` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:40:34.382161 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f71c1-f488-4508-8bd6-e4711e977249 admin admin] PATH_INFO: `/v3/projects/62830c4fab6a49b4ae7f2533a643ffa6` {{(pid=79702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:40:34.383512 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448f71c1-f488-4508-8bd6-e4711e977249 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62830c4fab6a49b4ae7f2533a643ffa6)` {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:40:34.386226 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448f71c1-f488-4508-8bd6-e4711e977249 admin admin] RBAC: Authorization granted {{(pid=79702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:40:34.432375 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-448f71c1-f488-4508-8bd6-e4711e977249 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62830c4fab6a49b4ae7f2533a643ffa6', 'request_id': 'req-448f71c1-f488-4508-8bd6-e4711e977249'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:40:34.437520 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-448f71c1-f488-4508-8bd6-e4711e977249 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62830c4fab6a49b4ae7f2533a643ffa6', 'request_id': 'req-448f71c1-f488-4508-8bd6-e4711e977249'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:40:34.444222 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-448f71c1-f488-4508-8bd6-e4711e977249 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62830c4fab6a49b4ae7f2533a643ffa6', 'request_id': 'req-448f71c1-f488-4508-8bd6-e4711e977249'} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:40:34.455456 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-448f71c1-f488-4508-8bd6-e4711e977249 admin admin] The token cache is being invalidate because project 62830c4fab6a49b4ae7f2533a643ffa6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 01:40:34.455742 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-448f71c1-f488-4508-8bd6-e4711e977249 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:40:34.456363 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: DEBUG keystone.notifications [None req-448f71c1-f488-4508-8bd6-e4711e977249 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 01:40:34.457944 dv-cinder-817135-7-iscsi devstack@keystone.service[79702]: [pid: 79702|app: 0|req: 1445/2881] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Mar 30 01:40:34 2022] DELETE /identity/v3/projects/62830c4fab6a49b4ae7f2533a643ffa6 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 01:42:30.233842 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762cd804-423a-4394-b2d5-72306fec5149 service neutron] Authenticating user token {{(pid=79701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 01:42:30.235292 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-762cd804-423a-4394-b2d5-72306fec5149 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:42:30.369755 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762cd804-423a-4394-b2d5-72306fec5149 service neutron] Validating token access rules against request {{(pid=79701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 01:42:30.425780 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e10206c-ffb6-4346-9119-67fb17822da4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7343cd5457264dabb4c2b3a62df59431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9a4444228d4be89a4ba8aa53099531', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 01:42:30.426428 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10206c-ffb6-4346-9119-67fb17822da4 service placement] REQUEST_METHOD: `GET` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 01:42:30.426731 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10206c-ffb6-4346-9119-67fb17822da4 service placement] SCRIPT_NAME: `/identity` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 01:42:30.427675 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10206c-ffb6-4346-9119-67fb17822da4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 01:42:30.429546 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.fernet_utils [None req-9e10206c-ffb6-4346-9119-67fb17822da4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 01:42:30.440513 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e10206c-ffb6-4346-9119-67fb17822da4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 01:42:30.442082 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e10206c-ffb6-4346-9119-67fb17822da4 service placement] RBAC: Authorization granted {{(pid=79701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 01:42:30.452559 dv-cinder-817135-7-iscsi devstack@keystone.service[79701]: [pid: 79701|app: 0|req: 1437/2882] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Mar 30 01:42:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)